SSelfHostAlts

llama.cpp

Fast C/C++ engine that runs open AI models on ordinary CPUs and GPUs, with a built-in chat page and OpenAI-style API

★ Stars132k131,691 on GitHub
Last commit19 Oct 2026
LicenceMITSPDX, from the repository
View on GitHub ↗

From GitHub, fetched 19 Oct 2026.

Visit github.com ↗

llama.cpp runs GGUF-format language models locally on CPUs, Apple Silicon and NVIDIA, AMD or Intel GPUs. Its llama-server program gives you a simple web chat page and an OpenAI-compatible API, so other self-hosted apps can use it as their AI backend.

Self-hosting requirements

Runs withDocker, C++
DockerYes
The project README documents running it with Docker.

Sources: github.com/ggml-org/llama.cpp, checked 19 Oct 2026. “Runs with” is from this listing. Blank means we haven't found it in official docs yet, not that it's unsupported.

Self-hosted alternative to

In collections

Related tools

Ollama

Generative Artificial Intelligence (GenAI)

Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, and other large language models.

Stars
★ 184k
Licence
MIT
Updated
  • Docker

Alternative to ChatGPT

Open-WebUI

Generative Artificial Intelligence (GenAI)

User-friendly AI Interface, supports Ollama, OpenAI API.

Stars
★ 156k
Licence
BSD-3-Clause
Updated
  • Docker

Alternative to ChatGPT

vLLM

Generative Artificial Intelligence (GenAI)

High-throughput server for running open language models on GPUs behind an OpenAI-compatible API

Stars
★ 94.1k
Licence
Apache-2.0
Updated
  • Docker

Alternative to OpenAI API

RAGFlow

Generative Artificial Intelligence (GenAI)

Document-understanding RAG engine for chatting with large collections of files, with cited answers

Stars
★ 92.5k
Licence
Apache-2.0
Updated
  • Docker

Alternative to ChatGPT

NextChat

Generative Artificial Intelligence (GenAI)

Lightweight, fast chat interface for OpenAI, Claude, Gemini and local models

Stars
★ 88.9k
Licence
MIT
Updated
  • Docker

Alternative to ChatGPT

LobeHub

Generative Artificial Intelligence (GenAI)

Modern design AI chat framework supporting multiple AI providers, one click install MCP Marketplace and Artifacts / Thinking.

Stars
★ 83.3k
Licence
Proprietary
Updated
  • Docker

Alternative to ChatGPT