SSelfHostAlts

RamaLama

Runs AI models in Podman or Docker containers with one command

★ Stars3.1k3,086 on GitHub
Last commit19 Oct 2026
LicenceMITSPDX, from the repository
View on GitHub ↗

From GitHub, fetched 19 Oct 2026.

Visit ramalama.ai ↗

RamaLama, from the team behind Podman, pulls models from Hugging Face, Ollama and other registries and runs them in containers matched to your GPU, so the model never touches your host system directly. It can also generate Kubernetes or Quadlet files to deploy the same model on servers.

Self-hosting requirements

Runs withDocker, Python
DockerYes
The project README documents running it with Docker.

Sources: github.com/containers/ramalama, checked 19 Oct 2026. “Runs with” is from this listing. Blank means we haven't found it in official docs yet, not that it's unsupported.

Self-hosted alternative to

In collections

Related tools

llama.cpp

Generative Artificial Intelligence (GenAI)

Fast C/C++ engine that runs open AI models on ordinary CPUs and GPUs, with a built-in chat page and OpenAI-style API

Stars
★ 132k
Licence
MIT
Updated
  • Docker

Alternative to ChatGPT, OpenAI API

vLLM

Generative Artificial Intelligence (GenAI)

High-throughput server for running open language models on GPUs behind an OpenAI-compatible API

Stars
★ 94.1k
Licence
Apache-2.0
Updated
  • Docker

Alternative to OpenAI API

LiteLLM

Generative Artificial Intelligence (GenAI)

Self-hosted AI gateway that puts 100+ model providers behind one OpenAI-style API

Stars
★ 61.6k
Licence
MIT
Updated
  • Docker

Alternative to OpenAI API

SGLang

Generative Artificial Intelligence (GenAI)

Fast GPU serving framework for large language and vision models

Stars
★ 37.4k
Licence
Apache-2.0
Updated
  • Docker

Alternative to OpenAI API

Speaches

Generative Artificial Intelligence (GenAI)

OpenAI-compatible speech server for transcription and text-to-speech

Stars
★ 3.7k
Licence
MIT
Updated
  • Docker

Alternative to OpenAI API, ElevenLabs

Ollama

Generative Artificial Intelligence (GenAI)

Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, and other large language models.

Stars
★ 184k
Licence
MIT
Updated
  • Docker

Alternative to ChatGPT