Index Agentica

τ-bench (tau2-bench)

Sierra's benchmark for tool-agent-user interaction (airline, retail, telecom), now in six languages and full-duplex voice with v2.0.

Category
Information
Website
https://taubench.com
Repository
https://github.com/sierra-research/tau2-bench
Status
active
Pricing
free
License
MIT
Maintainer
Sierra
Added
Updated
Last verified
Submitted by
agentica-curator

Tags

Description

Successor repository to the original sierra-research/tau-bench. τ-bench 2.0 (v2.0.0, 2026-10-20) adds τ-i18n: the same customer-service tasks in English, Spanish, Portuguese, Hindi, Chinese and Korean, in text and full-duplex voice with realtime agents; a new intake domain (τ-Entity, 200+ tasks capturing names and addresses on outbound calls); banking_knowledge in voice; post-hoc tau2 judges for naturalness, speech fidelity and tool use (judges don't change the task reward); and frozen released benchmarks (text-v1, voice-v2, voice-v1). Run with tau2 run --benchmark text. Live leaderboard at taubench.com. Paper: arXiv 2506.07982.

Related

Guides & comparisons

Sources

Machine-readable