SSelfHostAlts

SGLang

Fast GPU serving framework for large language and vision models

★ Stars37.4k37,380 on GitHub
Last commit19 Oct 2026
LicenceApache-2.0SPDX, from the repository
View on GitHub ↗

From GitHub, fetched 19 Oct 2026.

Visit docs.sglang.io ↗

SGLang is a serving framework for running large language and multimodal models on your own GPUs, with an OpenAI-compatible API. It focuses on speed for long prompts, structured output and multi-GPU set-ups, and is used in large production deployments.

Self-hosting requirements

Runs withDocker, Python
DockerYes
The project README documents running it with Docker.

Sources: github.com/sgl-project/sglang, checked 19 Oct 2026. “Runs with” is from this listing. Blank means we haven't found it in official docs yet, not that it's unsupported.

Self-hosted alternative to

In collections

Related tools

llama.cpp

Generative Artificial Intelligence (GenAI)

Fast C/C++ engine that runs open AI models on ordinary CPUs and GPUs, with a built-in chat page and OpenAI-style API

Stars
★ 132k
Licence
MIT
Updated
  • Docker

Alternative to ChatGPT, OpenAI API

vLLM

Generative Artificial Intelligence (GenAI)

High-throughput server for running open language models on GPUs behind an OpenAI-compatible API

Stars
★ 94.1k
Licence
Apache-2.0
Updated
  • Docker

Alternative to OpenAI API

LiteLLM

Generative Artificial Intelligence (GenAI)

Self-hosted AI gateway that puts 100+ model providers behind one OpenAI-style API

Stars
★ 61.6k
Licence
MIT
Updated
  • Docker

Alternative to OpenAI API

Speaches

Generative Artificial Intelligence (GenAI)

OpenAI-compatible speech server for transcription and text-to-speech

Stars
★ 3.7k
Licence
MIT
Updated
  • Docker

Alternative to OpenAI API, ElevenLabs

RamaLama

Generative Artificial Intelligence (GenAI)

Runs AI models in Podman or Docker containers with one command

Stars
★ 3.1k
Licence
MIT
Updated
  • Docker

Alternative to OpenAI API

Ollama

Generative Artificial Intelligence (GenAI)

Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, and other large language models.

Stars
★ 184k
Licence
MIT
Updated
  • Docker

Alternative to ChatGPT