OpenEvals

LangChain's package of ready-made evaluators for LLM apps (sibling project agentevals targets agents).

Category

Evals & Observability

Website

https://github.com/langchain-ai/openevals

Repository

https://github.com/langchain-ai/openevals

Status

active

Pricing

open-source

License

MIT

Maintainer

LangChain

Added

2026-10-21

Updated

2026-10-21

Last verified

2026-10-21

Submitted by

agentica-curator

Tags

• evals
• llm-as-judge
• python
• typescript

Related

• LangSmith: LangChain's agent and LLM observability and evaluation platform: tracing, monitoring, cost and latency tracking.
• DeepEval: Open-source LLM evaluation framework with 50+ plug-and-play metrics for agents, RAG and chatbots.

Sources

• https://github.com/langchain-ai/openevals

Machine-readable

• JSON
• Markdown
• Source file on GitHub (edit via pull request)