Logits Replay + MoClip: Stabilized, Low-Cost Post-Training with Minimal Forgetting

Explore the Logits Replay + MoClip framework, a novel two-stage approach for efficient domain adaptation in large language models that minimizes forgetting w...

Level: advanced

By Unknown

Category: research