Quantization Meets Reasoning: Exploring and Mitigating Degradation of Low-Bit LLMs in Mathematical Reasoning
Explore how low-bit quantization impacts mathematical reasoning in LLMs and discover a lightweight framework designed to mitigate performance degradation whi...