TensorFold

Fast, exact LLM decoding on Apple Silicon (MLX) behind an OpenAI-compatible endpoint

★ 1,023 stars, verified 2026-10-06Category: Local LLMs & InferenceGitHub repository ↗

Fast, exact LLM decoding on Apple Silicon (MLX) behind an OpenAI-compatible endpoint

Run open LLMs on your own machine — no API bills, no data leaving your device.

Stack & tags

aiai-toolsllmllm-inferencellm-tools

★ 181,956

Run LLMs locally with one command: `ollama run llama3`. Mac/Win/Linux supported.

★ 129,965

C/C++ LLM inference engine, birthplace of the GGUF format; powers Ollama under the hood

Local LLMs & InferenceGitHub ↗