LocalAI
Self-hosted, OpenAI-compatible API for text, images, audio and more.
- Stars
- 49.5K
- Forks
- 4.5K
- Open issues
- 189
- Last commit
- 2026-10-15
Live from the GitHub API · updated 2026-10-15
What is LocalAI?
LocalAI is a drop-in replacement for the OpenAI API that runs locally. It serves LLMs, image generation, speech-to-text, TTS and embeddings through multiple backends, with a model gallery and web UI.
Key features
- OpenAI API–compatible endpoints
- Text, image, audio and embedding backends
- Runs on CPU or GPU
- Model gallery and P2P distributed inference
System requirements
- Platforms
- Linux · macOS · Docker · Windows
- GPU
- Optional
- RAM
- 8 GB+
How to install LocalAI
Summarized from the project’s README. Projects change quickly — check the GitHub page for the latest instructions.
Docker
- 1Run the CPU image and open http://localhost:8080.
docker run -ti --name local-ai -p 8080:8080 localai/localai:latest
Install script
- 1Install with the official script.
curl https://localai.io/install.sh | sh
Strengths
- One API for many modalities
- Drop-in OpenAI replacement
Limitations
- More moving parts than Ollama
LocalAI alternatives compared
| Software | Stars | License | Platforms | VRAM |
|---|---|---|---|---|
| LocalAI Self-hosted, OpenAI-compatible API for text, images, audio and more. | 49.5K | MIT | — | |
| Ollama Get up and running with large language models locally. | 183.2K | MIT | — | |
| vLLM High-throughput LLM serving engine with PagedAttention. | 93.8K | Apache-2.0 | — | |
| llama.cpp LLM inference in C/C++ — the engine behind most local AI apps. | 131.2K | MIT | — | |
| Jan Open-source ChatGPT-style desktop app that runs 100% offline. | 45K | AGPL-3.0 | — | |
| GPT4All Private, on-device chat with local document Q&A. | 77.4K | MIT | — |
FAQ
Is LocalAI free?
Yes — LocalAI is open-source software released under the MIT license. Check the license (and any model weight licenses) before commercial use.
Does LocalAI run on Windows, Mac and Linux?
LocalAI supports: Linux, macOS, Docker, Windows.
What hardware do I need for LocalAI?
Optional. RAM: 8 GB+
How do I install LocalAI?
1. Run the CPU image and open http://localhost:8080.
What are the best LocalAI alternatives?
Popular alternatives include Ollama, vLLM, llama.cpp, Jan. See the comparison table on this page.