FourierMoE: Fourier Mixture-of-Experts Adaptation of Large Language Models

Discover FourierMoE, a novel spectral-domain approach to fine-tuning Large Language Models that leverages frequency energy distributions to solve multi-task ...

Level: advanced

By Juyong Jiang

Category: research