Ollama
Run local and cloud LLMs, now including Codex App and CLI workflows
Local AI Infrastructure★ Editor's pick · BEST LOCAL AIFree (open-source)★ 120,000Works with OpenClaw
About Ollama
Ollama makes it easy to run large language models locally or through Ollama Cloud. It handles model management, GPU acceleration, an OpenAI-compatible API, and official coding-agent integrations. Ollama v0.24 added Codex App support, and the Ollama Codex CLI docs now document launch/profile paths for using Codex with Ollama-backed local or cloud models.
Curator's verdict · Editor's pick · April 2026
Run any model locally in one command. Free, open-source, no GPU cloud needed.
Features
One-command setup
API server
GPU acceleration
Model library
Modelfile
OpenAI-compatible API
Codex App support
Codex CLI launch/profile support
The tally
FOR
- +Dead simple to use with one command
- +Runs local models offline when hardware fits
- +OpenAI-compatible API
- +Huge model library
- +Official Codex App and Codex CLI integration paths
AGAINST
- −Requires enough local hardware for larger models
- −Local coding-agent quality depends heavily on the selected model
- −Cloud models may require Ollama Cloud subscription or usage costs
- −No built-in general chat UI without a companion app
Related concepts
Kept nearby
whatcani.run
Find which AI models can run locally on your hardware
Free
PrivateGPT
Interact with your documents privately using LLMs
Free (open-source) · ★ 55,000
KoboldCpp
Easy-to-use local AI text generation with GGUF support
Free (open-source) · ★ 5,000
LM Studio
Beautiful desktop app for running local LLMs
Free
Browse all Local AI Infrastructure tools →