SSelfHostAlts

LiteLLM

Self-hosted AI gateway that puts 100+ model providers behind one OpenAI-style API

★ Stars61.6k61,561 on GitHub
Last commit19 Oct 2026
LicenceMITPer the project
View on GitHub ↗

From GitHub, fetched 19 Oct 2026.

Visit litellm.ai ↗

LiteLLM Proxy is a gateway you run yourself that gives your apps one OpenAI-compatible endpoint for over a hundred providers and local servers. It adds API keys per user or team, spending limits, logging, fallbacks and load balancing.

The core is MIT; the repo's enterprise/ folder is under a separate commercial licence.

Self-hosting requirements

Runs withDocker, Python
DockerYes
The project README documents running it with Docker.

Sources: github.com/BerriAI/litellm, checked 19 Oct 2026. “Runs with” is from this listing. Blank means we haven't found it in official docs yet, not that it's unsupported.

Self-hosted alternative to

In collections

Related tools

llama.cpp

Generative Artificial Intelligence (GenAI)

Fast C/C++ engine that runs open AI models on ordinary CPUs and GPUs, with a built-in chat page and OpenAI-style API

Stars
★ 132k
Licence
MIT
Updated
  • Docker

Alternative to ChatGPT, OpenAI API

vLLM

Generative Artificial Intelligence (GenAI)

High-throughput server for running open language models on GPUs behind an OpenAI-compatible API

Stars
★ 94.1k
Licence
Apache-2.0
Updated
  • Docker

Alternative to OpenAI API

SGLang

Generative Artificial Intelligence (GenAI)

Fast GPU serving framework for large language and vision models

Stars
★ 37.4k
Licence
Apache-2.0
Updated
  • Docker

Alternative to OpenAI API

Speaches

Generative Artificial Intelligence (GenAI)

OpenAI-compatible speech server for transcription and text-to-speech

Stars
★ 3.7k
Licence
MIT
Updated
  • Docker

Alternative to OpenAI API, ElevenLabs

RamaLama

Generative Artificial Intelligence (GenAI)

Runs AI models in Podman or Docker containers with one command

Stars
★ 3.1k
Licence
MIT
Updated
  • Docker

Alternative to OpenAI API

Ollama

Generative Artificial Intelligence (GenAI)

Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, and other large language models.

Stars
★ 184k
Licence
MIT
Updated
  • Docker

Alternative to ChatGPT