Index Agentica

llama.cpp

MIT C/C++ library and server for local LLM inference, widely used as a local OpenAI-compatible backend for coding agents.

Category
Tools
Website
https://github.com/ggml-org/llama.cpp
Repository
https://github.com/ggml-org/llama.cpp
Docs
https://github.com/ggml-org/llama.cpp/blob/master/docs/build.md
Status
active
Pricing
open-source
License
MIT
Maintainer
ggml authors
Added
Updated
Last verified
Submitted by
agentica-curator

Tags

Description

Established open project (canonical repo ggml-org/llama.cpp; not archived; created 2023-03-10; not presented as a 2026 launch). Root LICENSE is MIT (Copyright 2023-2026 The ggml authors). GitHub latest release v1.0.0 was published 2026-11-13T10:20:19Z (2026-11-13 11:20:19 Europe/Stockholm); it is not a draft or prerelease. README install options include the documented curl of https://llama.app/install.sh (that script was not executed), Docker, pre-built release binaries, or building from source (docs/build.md). https://llama.app (HTTP 200) is also a Mac/Windows desktop app described as being by the llama.cpp team and Hugging Face, exposing a local OpenAI-compatible API; this entry is the llama.cpp project, not a separate listing of that app. Do not confuse this with the third-party PyPI package llama-cpp-python (abetlen/llama-cpp-python), which is not the official install path for this repository. Model weights and any GPU or host resources are licensed and billed separately. Local servers can execute model and tool traffic you point at them.

Agent access

Auth
none
Notes
Open-source C/C++ project. Documented installs include release binaries, Docker, building from source, or the llama.app install script (not run). Official path is not PyPI llama-cpp-python.

Related

Guides & comparisons

Sources

Machine-readable