本地大模型运行AGPL-3.0C++

KoboldCpp

Single-file llama.cpp-based runner for GGUF models with a story-writing UI.

Star 数
12K
Fork 数
791
未关闭 Issue
528
最近提交
2026-10-15

数据来自 GitHub API · 更新于 2026-10-15

KoboldCpp 是什么?

KoboldCpp packages llama.cpp into one executable with the KoboldAI Lite UI for chat and storytelling, plus image generation, speech and an API compatible with OpenAI and KoboldAI clients.

主要功能

  • One executable, no install
  • Story, adventure and chat modes
  • Bundled image generation and TTS
  • Works as a backend for SillyTavern

系统要求

平台
Windows · macOS · Linux
显卡
Optional (CUDA, Vulkan, Metal)
内存
Depends on model size

如何安装 KoboldCpp

根据项目 README 整理。开源项目更新很快,请以 GitHub 页面上的最新说明为准。

Windows

  1. 1
    Download koboldcpp.exe from GitHub Releases and run it.
  2. 2
    Select a GGUF model in the launcher and click Launch.

Linux

  1. 1
    Download the binary and run it.
    curl -fLo koboldcpp https://github.com/LostRuins/koboldcpp/releases/latest/download/koboldcpp-linux-x64 && chmod +x koboldcpp && ./koboldcpp

优势

  • Zero-setup
  • Great for roleplay and fiction

不足

  • UI is niche-focused

KoboldCpp 替代品对比

软件Star 数许可证平台显存
KoboldCpp

Single-file llama.cpp-based runner for GGUF models with a story-writing UI.

12KAGPL-3.0—
llama.cpp

LLM inference in C/C++ — the engine behind most local AI apps.

131.2KMIT—
Text Generation WebUI

The “AUTOMATIC1111 of text generation” — a Gradio UI for local LLMs.

47.7KAGPL-3.0—
llamafile

Distribute and run an LLM as a single executable file.

26.3KApache-2.0—
Ollama

Get up and running with large language models locally.

183.2KMIT—
Jan

Open-source ChatGPT-style desktop app that runs 100% offline.

45KAGPL-3.0—

常见问题

KoboldCpp 免费吗?

是的——KoboldCpp 是开源软件,采用 AGPL-3.0 许可证。商用前请确认软件及模型权重的许可条款。

KoboldCpp 支持 Windows、Mac 和 Linux 吗?

KoboldCpp 支持:Windows, macOS, Linux。

运行 KoboldCpp 需要什么配置?

Optional (CUDA, Vulkan, Metal). RAM: Depends on model size

如何安装 KoboldCpp?

1. Download koboldcpp.exe from GitHub Releases and run it. 2. Select a GGUF model in the launcher and click Launch.

KoboldCpp 有哪些好的替代品?

常见替代品包括 llama.cpp, Text Generation WebUI, llamafile, Ollama,详见本页对比表。