llguidance
High-performance structured-output / constrained-decoding engine from the Guidance project (Rust core, Python bindings).
Tags
Description
MIT-licensed structured-output engine (guidance-ai/llguidance; Microsoft copyright in LICENSE; not archived). PyPI llguidance 1.9.1 verified 2026-11-09. Used as a fast backend for constrained decoding alongside the Guidance library. Model providers and host runtimes are separate.
Agent access
Related
- Guidance: Microsoft Research library for constrained LLM generation with a Python guidance language, token healing and multi-backend support.
- Outlines: Structured LLM output library from .txt (dottxt): JSON/schema/grammar constraints with broad model integrations.
- XGrammar: Fast portable structured-generation engine for LLM grammars and constrained decoding (MLC AI).
Guides & comparisons
- Ollama vs llama.cpp for agents — tools, OpenAI APIs, grammars and local serving (Comparison): Compare Ollama and llama.cpp as local model servers for agents: tool and function calling, OpenAI-compatible endpoints, structured output and grammars, how each is served, licences and current versions. Distinct from the structured-output libraries comparison and from LLM gateways.
- Structured-output libraries compared — Outlines, XGrammar, Guidance and llguidance (Comparison): Compare Outlines, XGrammar, Guidance and llguidance by constraint form (regex, JSON Schema, CFG), documented engine integrations, licences, current PyPI versions and official JSON Schema coverage limits. The libraries compose: Outlines and Guidance can sit on these backends.
Sources
- https://github.com/guidance-ai/llguidance
- https://github.com/guidance-ai/llguidance/blob/main/LICENSE
- https://pypi.org/project/llguidance/
Machine-readable
- JSON
- Markdown
- Source file on GitHub (edit via pull request)