LocalAI
Drop-in replacement for OpenAI API running locally
Local AI InfrastructureFree (open-source)★ 25,000Works with OpenClaw
About LocalAI
LocalAI is a drop-in replacement for the OpenAI API that runs entirely locally. It supports text generation, image generation, audio, and embeddings — all through an OpenAI-compatible API without requiring a GPU.
Features
OpenAI-compatible API
Multiple models
Text-to-speech
Image generation
Embeddings
The tally
FOR
- +Full OpenAI API compatibility
- +CPU inference (no GPU required)
- +Text + image + audio + embeddings
- +Docker-ready
- +Multiple model formats
AGAINST
- −Slower without GPU
- −Complex configuration
- −Some API endpoints incomplete
- −Documentation could be clearer
Related concepts
Kept nearby
whatcani.run
Find which AI models can run locally on your hardware
Free
PrivateGPT
Interact with your documents privately using LLMs
Free (open-source) · ★ 55,000
KoboldCpp
Easy-to-use local AI text generation with GGUF support
Free (open-source) · ★ 5,000
LM Studio
Beautiful desktop app for running local LLMs
Free
Browse all Local AI Infrastructure tools →