light-llm-hp 0.4.5 - PyPI

Discover how light-llm-hp enables high-performance LLM inference on Apple Silicon and CPUs using the MLX backend, offering a fast, GPU-free alternative for l...

Level: intermediate

By Heepengpeng

Category: tools