Understanding LLM Performance Degradation in Multi-Instance Processing

This research investigates the critical performance degradation Large Language Models face when processing multiple data instances simultaneously. It reveals...

Level: advanced

By Jingxuan Chen, Mohammad Taher Pilehvar, Jose Camacho-Collados

Category: research