Influence-Preserving Proxies for Gradient-Based Data Selection in LLM Fine-tuning

Explore Iprox, a novel two-stage framework that leverages low-rank compression to create influence-preserving proxies for efficient LLM fine-tuning. This res...

Level: advanced

By Sirui Chen, Yunzhe Qi, Mengting Ai, Yifan Sun, Ruizhong Qiu, Jiaru Zou, Jingrui He

Category: research