CAGE: Curvature-Aware Gradient Estimation For Accurate Quantization-Aware Training

Explore CAGE, a novel curvature-aware gradient estimation method that leverages second-order information to significantly reduce quantization-induced loss in...

Level: advanced

By Soroush Tabesh, Mher Safaryan, Dan Alistarh

Category: research