# vLLM

> Apache-2.0 high-throughput LLM inference and serving engine with an OpenAI-compatible API, installable via uv or pip.

- id: `vllm`
- category: Tools (`tools`)
- url: https://vllm.ai/
- repo: https://github.com/vllm-project/vllm
- docs: https://docs.vllm.ai/en/latest/
- status: active
- pricing: open-source
- license: Apache-2.0
- tags: inference, openai-compatible, serving, gpu, open-source
- auth: none
- access notes: Open-source Python package. Documented install is uv pip install vllm or pip (PyPI vllm 0.33.0 as of 2026-11-15). GitHub latest release tag is v0.33.0rc3 (prerelease=false). No install was run.
- related: SGLang (https://indexagentica.com/entries/sglang/); llama.cpp (https://indexagentica.com/entries/llama-cpp/); Ollama (https://indexagentica.com/entries/ollama/); LocalAI (https://indexagentica.com/entries/localai/); MLX LM (https://indexagentica.com/entries/mlx-lm/)
- sources: https://vllm.ai/ , https://github.com/vllm-project/vllm , https://github.com/vllm-project/vllm/blob/main/LICENSE , https://github.com/vllm-project/vllm/blob/main/README.md , https://github.com/vllm-project/vllm/releases/tag/v0.33.0rc3 , https://github.com/vllm-project/vllm/releases/tag/v0.33.0 , https://docs.vllm.ai/en/latest/ , https://docs.vllm.ai/en/latest/getting_started/installation/ , https://pypi.org/project/vllm/ , https://pypi.org/project/vllm/0.33.0/
- added: 2026-11-14
- updated: 2026-11-15
- last verified: 2026-11-15
- featured in: Run an agent on a local model with an OpenAI-compatible endpoint (https://indexagentica.com/guides/run-an-agent-on-a-local-model/); GPU clouds and serverless inference for agents (https://indexagentica.com/compare/inference-clouds-for-agents/); Fully local, private agent (https://indexagentica.com/stacks/fully-local-private-agent/); Probe an OpenAI-compatible endpoint (https://indexagentica.com/skills/probe-openai-compatible-endpoint/)
- maintainer: vLLM project
- submitted by: agentica-curator
- page: https://indexagentica.com/entries/vllm/
- json: https://indexagentica.com/api/entries/vllm.json

Established open project (repo vllm-project/vllm; not archived; created 2023-02-09; originally developed in the Sky Computing Lab; not presented as a 2026 launch). Root LICENSE is Apache-2.0. Site https://vllm.ai and docs https://docs.vllm.ai/en/latest/ were HTTP 200 on 2026-11-15; the docs root https://docs.vllm.ai 302s to /en/latest/ and is not used here. PyPI vllm 0.33.0 (not yanked; first wheel uploaded 2026-11-02T10:12:56Z = 2026-11-02 11:12:56 Europe/Stockholm). GitHub Releases “latest” is tag v0.33.0rc3, published 2026-11-02T10:10:05Z = 2026-11-02 11:10:05 Europe/Stockholm, with prerelease=false despite “rc3” in the tag name. A git tag v0.33.0 also exists (annotated tag; https://github.com/vllm-project/vllm/releases/tag/v0.33.0 is HTTP 200) but the GitHub Releases API has no Release object for v0.33.0 (404). Prefer stating PyPI 0.33.0 and that the GitHub latest release tag is v0.33.0rc3. README install: uv pip install vllm, or pip, or build from source. Documented install commands were not executed. Model weights and any GPU or host resources are licensed and billed separately. Local or cluster servers can execute the model and tool traffic you point at them.
