🏠 Local AI Infrastructure

Run large language models locally with one command

Run large language models locally on your computer

Interact with your documents privately using LLMs

Drop-in replacement for OpenAI API running locally

Easy-to-use local AI text generation with GGUF support

High-throughput LLM serving engine

Beautiful desktop app for running local LLMs