CompoDistill: Attention Distillation for Compositional Reasoning in Multimodal LLMs

CompoDistill introduces a novel attention distillation method to align visual attention between student and teacher models, significantly enhancing compositi...

Level: advanced

By Unknown

Category: research