light-llm-hp: Lightweight LLM Inference Framework

Discover light-llm-hp, a lightweight Python framework designed to run Large Language Models efficiently on CPU and Apple Silicon. Learn how to leverage MLX f...

Level: intermediate

By Heepengpeng

Category: tools