Wireless Federated Multi-Task LLM Fine-Tuning via Sparse-and-Orthogonal LoRA

This research introduces sparse-and-orthogonal LoRA, a novel parameter-efficient fine-tuning method designed to optimize multi-task LLMs within wireless fede...

Level: advanced

By Nuocheng Yang, Sihua Wang, Ouwen Huan, Mingzhe Chen, Tony Q. S. Quek, Changchuan Yin

Category: research