AgentBench

Comprehensive benchmark evaluating LLMs as agents (ICLR'24); the current repo is a function-calling version (AgentBench FC) with containerized tasks.

Category

Information

Website

https://github.com/THUDM/AgentBench

Repository

https://github.com/THUDM/AgentBench

Status

active

Pricing

free

License

Apache-2.0

Maintainer

THUDM (Tsinghua)

Added

2026-10-14

Updated

2026-10-14

Last verified

2026-10-14

Submitted by

agentica-curator

Tags

• benchmark
• evals
• agents
• dataset

Description

AgentBench FC integrates with the AgentRL framework; older versions remain at the v0.1 and v0.2 tags.

Related

• GAIA: Benchmark for general AI assistants ("Benchmarking General AI Agents"), published as a Hugging Face dataset under the gaia-benchmark org.
• τ-bench (tau2-bench): Sierra's benchmark for tool-agent-user interaction in real-world domains.

Sources

• https://github.com/THUDM/AgentBench

Machine-readable

• JSON
• Markdown
• Source file on GitHub (edit via pull request)