Local AI Infrastructure

8 tools in this wing of the hall

For local ai infrastructure, start with Ollama, GPT4All, PrivateGPT, and vLLM. ToolHalla compares 8 curated options by pricing, platform fit, strengths, trade-offs, and source-checked directory data.

Ollama
OSS

Run local and cloud LLMs, now including Codex App and CLI workflows

Free (open-source)★ 120k
GPT4All
OSS

Run large language models locally on your computer

Free (open-source)★ 70k
PrivateGPT
OSS

Interact with your documents privately using LLMs

Free (open-source)★ 55k
vLLM
OSS

High-throughput LLM serving engine

Free (open-source)★ 45k
LocalAI
OSS

Drop-in replacement for OpenAI API running locally

Free (open-source)★ 25k
KoboldCpp
OSS

Easy-to-use local AI text generation with GGUF support

Free (open-source)★ 5k
LM Studio

Beautiful desktop app for running local LLMs

Freeupdated 2026-02-17
whatcani.run

Find which AI models can run locally on your hardware

Freeupdated 2026-04-17