Ollama

Run LLMs locally with one command: `ollama run llama3`. Mac/Win/Linux supported.

★ 181,956 stars, verified 2026-09-30Category: Local LLMs & InferenceGitHub repository ↗

The de-facto standard for running large models locally. Pull up a model with a single command `ollama run llama3`; supports Mac, Windows, and Linux.

Run open LLMs on your own machine — no API bills, no data leaving your device.

Key features

Good for

Stack & tags

PythonJavaScriptllmlocal-inferenceopen-modelsrest-apidockercli

Quick start

curl -fsSL https://ollama.com/install.sh | sh

From the project README on GitHub.

Screenshots

Screenshots from the project’s GitHub README.

Our in-depth review

We covered Ollama in detail: Ollama Review 2026: The Honest Verdict on Running LLMs Locally

Similar open-source projects

llama.cpp

★ 129,965

C/C++ LLM inference engine, birthplace of the GGUF format; powers Ollama under the hood

Local LLMs & InferenceGitHub ↗

vllm

★ 94,426

A high-throughput and memory-efficient inference and serving engine for LLMs

Local LLMs & InferenceGitHub ↗