AI-Nav Every AI tool, honestly reviewed.

Home / Products / Local LLMs & Inference

LEANN

[MLsys2026 Best Paper]: https://arxiv.org/abs/2506.08276. RAG on Everything with LEANN. Enjoy 97% storage savings while running a fast, accurate, and 100% private RAG application on your personal device.

★ 13,629 stars, verified 2026-10-29Category: Local LLMs & InferenceGitHub repository ↗

[MLsys2026 Best Paper]: https://arxiv.org/abs/2506.08276. RAG on Everything with LEANN. Enjoy 97% storage savings while running a fast, accurate, and 100% private RAG application on your personal device.

Run open LLMs on your own machine — no API bills, no data leaving your device.

Stack & tags

aifaissgpt-osslangchainllama-indexllmlocalstorageoffline-first

Similar open-source projects

Ollama

★ 181,956

Run LLMs locally with one command: `ollama run llama3`. Mac/Win/Linux supported.

Local LLMs & InferenceGitHub ↗In-depth review →

llama.cpp

★ 129,965

C/C++ LLM inference engine, birthplace of the GGUF format; powers Ollama under the hood

Local LLMs & InferenceGitHub ↗