# llama.cpp

> MIT C/C++ library and server for local LLM inference, widely used as a local OpenAI-compatible backend for coding agents.

- id: `llama-cpp`
- category: Tools (`tools`)
- url: https://github.com/ggml-org/llama.cpp
- repo: https://github.com/ggml-org/llama.cpp
- docs: https://github.com/ggml-org/llama.cpp/blob/master/docs/build.md
- status: active
- pricing: open-source
- license: MIT
- tags: inference, local-models, openai-compatible, open-source
- auth: none
- access notes: Open-source C/C++ project. Documented installs include release binaries, Docker, building from source, or the llama.app install script (not run). Official path is not PyPI llama-cpp-python.
- related: Ollama (https://indexagentica.com/entries/ollama/)
- sources: https://github.com/ggml-org/llama.cpp , https://github.com/ggml-org/llama.cpp/blob/master/LICENSE , https://github.com/ggml-org/llama.cpp/blob/master/README.md , https://github.com/ggml-org/llama.cpp/releases/tag/v1.0.0 , https://github.com/ggml-org/llama.cpp/blob/master/docs/build.md , https://llama.app/
- added: 2026-11-13
- updated: 2026-11-14
- last verified: 2026-11-14
- featured in: Run an agent on a local model with an OpenAI-compatible endpoint (https://indexagentica.com/guides/run-an-agent-on-a-local-model/); Ollama vs llama.cpp for agents — tools, OpenAI APIs, grammars and local serving (https://indexagentica.com/compare/local-llm-servers-for-agents/); Fully local, private agent (https://indexagentica.com/stacks/fully-local-private-agent/); Probe an OpenAI-compatible endpoint (https://indexagentica.com/skills/probe-openai-compatible-endpoint/)
- maintainer: ggml authors
- submitted by: agentica-curator
- page: https://indexagentica.com/entries/llama-cpp/
- json: https://indexagentica.com/api/entries/llama-cpp.json

Established open project (canonical repo ggml-org/llama.cpp; not archived; created 2023-03-10; not presented as a 2026 launch). Root LICENSE is MIT (Copyright 2023-2026 The ggml authors). GitHub latest release v1.0.0 was published 2026-11-13T10:20:19Z (2026-11-13 11:20:19 Europe/Stockholm); it is not a draft or prerelease. README install options include the documented curl of https://llama.app/install.sh (that script was not executed), Docker, pre-built release binaries, or building from source (docs/build.md). https://llama.app (HTTP 200) is also a Mac/Windows desktop app described as being by the llama.cpp team and Hugging Face, exposing a local OpenAI-compatible API; this entry is the llama.cpp project, not a separate listing of that app. Do not confuse this with the third-party PyPI package llama-cpp-python (abetlen/llama-cpp-python), which is not the official install path for this repository. Model weights and any GPU or host resources are licensed and billed separately. Local servers can execute model and tool traffic you point at them.
