ADEPT: Continual Pretraining via Adaptive Expansion and Dynamic Decoupled Tuning

Explore ADEPT, a novel framework addressing catastrophic forgetting in continual pretraining through adaptive expansion and decoupled tuning. This research d...

Level: advanced

By Unknown

Category: research