Federated Fine-Tuning of Sparsely-Activated Large Language Models on Resource-Constrained Devices
Explore FLUX, a novel federated fine-tuning system designed to deploy Mixture of Experts LLMs on resource-constrained devices with a 4.75x speedup. This rese...