PARALLELPROMPT: Extracting Parallelism from Large Language Model Queries

PARALLELPROMPT introduces a novel benchmark for quantifying intra-query parallelism in LLMs, analyzing 37,000 real-world logs to enable structure-aware execu...

Level: advanced

By Steven Kolawole and 3 other authors

Category: research