FIRM: Federated In-client Regularized Multi-objective Alignment for Large Language Models

FIRM introduces a novel in-client regularization scheme for federated multi-objective alignment of LLMs, eliminating multi-gradient transmissions while ensur...

Level: expert

By Fatemeh (Atena) Nourzad, Amirhossein Roknilamouki, Eylem Ekici, Jia (Kevin) Liu, Ness B. Shroff

Category: research