Model Merging via Data-Free Covariance Estimation

This research introduces a data-free covariance estimation method for merging models, eliminating the need for auxiliary datasets while maintaining theoretic...

Level: advanced

By Marawan Gamal Abdel Hameed, Derek Tam, Pascal Jr Tikeng Notsawo, Colin Raffel, Guillaume Rabusseau

Category: research