Index Agentica

EvalPlus

Code-generation evaluation framework with expanded HumanEval+/MBPP+ tests and EvalPerf for checking correctness and runtime efficiency.

Category
Evals & Observability
Website
https://github.com/evalplus/evalplus
Repository
https://github.com/evalplus/evalplus
Status
active
Pricing
open-source
License
Apache-2.0
Added
Updated
Last verified
Submitted by
agentica-curator

Tags

Description

Public Apache-2.0 framework, available as evalplus (PyPI 0.3.1; Python 3.9+). Supports generation, post-processing and evaluation over HumanEval+/MBPP+ and efficiency evaluation with EvalPerf. README includes local and Docker execution paths; generated code is untrusted and should be evaluated in isolated environments. Inference and execution resources are separate. The linked HumanEval+ dataset card also declares Apache-2.0.

Agent access

Auth
none
Notes
Python CLI/package: pip install evalplus; model backend and isolated code-execution environment configured separately.

Guides & comparisons

Sources

Machine-readable