OpenLLMetry
Traceloop's open-source observability for GenAI/LLM applications, built on OpenTelemetry.
Tags
Related
- OpenTelemetry GenAI Semantic Conventions: OpenTelemetry conventions for spans, metrics and events emitted by GenAI clients, MCP and model providers, for interoperable agent observability.
Guides & comparisons
- Evaluate an AI agent with open-source eval and observability tools (Guide): A hands-on loop for agent quality: instrument with OpenTelemetry, collect traces, turn real traces into a dataset, write code, LLM-as-judge and human evaluators, run offline experiments, then monitor production and gate pull requests in CI.
- Observability and eval platforms for AI agents (Comparison): Langfuse, LangSmith, Arize Phoenix, Braintrust, Opik and Laminar compared on license, self-hosting, OpenTelemetry ingestion, MCP access to your traces, free tiers, paid entry prices and built-in evaluation.
Sources
Machine-readable
- JSON
- Markdown
- Source file on GitHub (edit via pull request)