SSelfHostAlts

KoboldCpp

Single-file local AI runner with a built-in story-writing and chat interface

★ Stars12k12,032 on GitHub
Last commit19 Oct 2026
LicenceAGPL-3.0SPDX, from the repository
View on GitHub ↗

From GitHub, fetched 19 Oct 2026.

Visit koboldcpp.net ↗

KoboldCpp is a one-file program built on llama.cpp that runs GGUF models with a web interface for chat, roleplay and story writing. It also bundles image generation, speech-to-text and text-to-speech, and offers Kobold and OpenAI-compatible APIs for other front-ends such as SillyTavern.

Self-hosting requirements

Runs withDocker, C++
DockerYes
The project README documents running it with Docker.

Sources: github.com/LostRuins/koboldcpp, checked 19 Oct 2026. “Runs with” is from this listing. Blank means we haven't found it in official docs yet, not that it's unsupported.

Self-hosted alternative to

In collections

Related tools

Ollama

Generative Artificial Intelligence (GenAI)

Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, and other large language models.

Stars
★ 184k
Licence
MIT
Updated
  • Docker

Alternative to ChatGPT

Open-WebUI

Generative Artificial Intelligence (GenAI)

User-friendly AI Interface, supports Ollama, OpenAI API.

Stars
★ 156k
Licence
BSD-3-Clause
Updated
  • Docker

Alternative to ChatGPT

llama.cpp

Generative Artificial Intelligence (GenAI)

Fast C/C++ engine that runs open AI models on ordinary CPUs and GPUs, with a built-in chat page and OpenAI-style API

Stars
★ 132k
Licence
MIT
Updated
  • Docker

Alternative to ChatGPT, OpenAI API

RAGFlow

Generative Artificial Intelligence (GenAI)

Document-understanding RAG engine for chatting with large collections of files, with cited answers

Stars
★ 92.5k
Licence
Apache-2.0
Updated
  • Docker

Alternative to ChatGPT

NextChat

Generative Artificial Intelligence (GenAI)

Lightweight, fast chat interface for OpenAI, Claude, Gemini and local models

Stars
★ 88.9k
Licence
MIT
Updated
  • Docker

Alternative to ChatGPT

LobeHub

Generative Artificial Intelligence (GenAI)

Modern design AI chat framework supporting multiple AI providers, one click install MCP Marketplace and Artifacts / Thinking.

Stars
★ 83.3k
Licence
Proprietary
Updated
  • Docker

Alternative to ChatGPT