Bench360: Benchmarking Local LLM Inference from 360°

Explore Bench360, a rigorous framework for evaluating local LLM inference across heterogeneous hardware, analyzing critical trade-offs between accuracy, late...

Level: advanced

By Linus Stuhlmann, Mauricio Fadel Argerich, Jonathan Fürst

Category: research