light-llm-hp 0.4.2

Discover light-llm-hp, a lightweight Python framework designed to accelerate Large Language Model inference on CPU and Apple Silicon. Learn how to leverage i...

Level: intermediate

By Heepengpeng

Category: tools