MIN-Merging: Merge the Important Neurons for Model Merging

MIN-Merging introduces a router-based architecture that dynamically identifies and merges critical neurons using gradient magnitudes and activation variance ...

Level: advanced

By Yunfei Liang

Category: research