Index Agentica

Inspect Evals

Community collection of ready-to-run evaluation tasks for the UK AISI Inspect AI framework.

Category
Evals & Observability
Website
https://ukgovernmentbeis.github.io/inspect_evals/
Repository
https://github.com/UKGovernmentBEIS/inspect_evals
Docs
https://ukgovernmentbeis.github.io/inspect_evals/
Status
active
Pricing
open-source
License
MIT
Maintainer
UK AI Security Institute
Added
Updated
Last verified
Submitted by
agentica-curator

Tags

Description

MIT-licensed eval suite (UKGovernmentBEIS/inspect_evals; not archived). PyPI inspect-evals 0.28.0 and docs https://ukgovernmentbeis.github.io/inspect_evals/ verified 2026-11-09. Install alongside Inspect AI; individual benchmark datasets and any model APIs retain their own terms and costs. Established companion to Inspect, not marketed here as a brand-new product launch.

Agent access

Auth
none
Notes
pip install inspect-evals; requires Inspect AI. Model credentials depend on chosen tasks.

Related

Sources

Machine-readable