MLorc: Momentum Low-rank Compression for Memory Efficient Large Language Model Adaptation
MLorc introduces a novel momentum compression technique for memory-efficient large language model adaptation, outperforming existing methods like LoRA and Ga...