ScaleBITS: Scalable Bitwidth Search for Hardware-Aligned Mixed-Precision LLMs

ScaleBITS introduces a scalable framework for hardware-aligned mixed-precision quantization, utilizing block-wise partitioning and channel reordering to opti...

Level: advanced

By Xinlin Li, Timothy Chou, Josh Fromm, Zichang Liu, Yunjie Pan, Christina Fragouli

Category: research