llamafile
Distribute and run an LLM as a single executable file.
- Stars
- 26.3K
- Forks
- 1.7K
- Open issues
- 213
- Last commit
- 2026-10-12
Live from the GitHub API · updated 2026-10-15
What is llamafile?
llamafile from Mozilla combines llama.cpp with Cosmopolitan Libc so a model and its runtime ship as one file that runs on Windows, macOS, Linux and BSD — download, make executable, run.
Key features
- One file runs on most operating systems
- Built-in web chat UI and OpenAI-compatible API
- Fast CPU inference
System requirements
- Platforms
- Windows · macOS · Linux
- RAM
- Depends on the model
How to install llamafile
Summarized from the project’s README. Projects change quickly — check the GitHub page for the latest instructions.
macOS / Linux
- 1Download a .llamafile from the README’s model list, make it executable and run it.
chmod +x Llama-3.2-1B-Instruct.Q6_K.llamafile ./Llama-3.2-1B-Instruct.Q6_K.llamafile
Windows
- 1Rename the downloaded file to end in .exe and run it (Windows limits .exe files to 4 GB).
Strengths
- Easiest distribution format
- No dependencies
Limitations
- 4 GB executable limit on Windows
llamafile alternatives compared
| Software | Stars | License | Platforms | VRAM |
|---|---|---|---|---|
| llamafile Distribute and run an LLM as a single executable file. | 26.3K | Apache-2.0 | — | |
| Ollama Get up and running with large language models locally. | 183.2K | MIT | — | |
| llama.cpp LLM inference in C/C++ — the engine behind most local AI apps. | 131.2K | MIT | — | |
| KoboldCpp Single-file llama.cpp-based runner for GGUF models with a story-writing UI. | 12K | AGPL-3.0 | — | |
| Jan Open-source ChatGPT-style desktop app that runs 100% offline. | 45K | AGPL-3.0 | — | |
| GPT4All Private, on-device chat with local document Q&A. | 77.4K | MIT | — |
FAQ
Is llamafile free?
Yes — llamafile is open-source software released under the Apache-2.0 license. Check the license (and any model weight licenses) before commercial use.
Does llamafile run on Windows, Mac and Linux?
llamafile supports: Windows, macOS, Linux.
What hardware do I need for llamafile?
RAM: Depends on the model
How do I install llamafile?
1. Download a .llamafile from the README’s model list, make it executable and run it.
What are the best llamafile alternatives?
Popular alternatives include Ollama, llama.cpp, KoboldCpp, Jan. See the comparison table on this page.