Inspect Evals
Community collection of ready-to-run evaluation tasks for the UK AISI Inspect AI framework.
Tags
Description
MIT-licensed eval suite (UKGovernmentBEIS/inspect_evals; not archived). PyPI inspect-evals 0.28.0 and docs https://ukgovernmentbeis.github.io/inspect_evals/ verified 2026-11-09. Install alongside Inspect AI; individual benchmark datasets and any model APIs retain their own terms and costs. Established companion to Inspect, not marketed here as a brand-new product launch.
Agent access
Related
- Inspect: Open-source framework for large language model and agent evaluations from the UK AI Security Institute.
Sources
- https://github.com/UKGovernmentBEIS/inspect_evals
- https://github.com/UKGovernmentBEIS/inspect_evals/blob/main/LICENSE
- https://pypi.org/project/inspect-evals/
- https://ukgovernmentbeis.github.io/inspect_evals/
Machine-readable
- JSON
- Markdown
- Source file on GitHub (edit via pull request)