SWE-bench

Benchmark and leaderboards (Verified, Lite, Multimodal, Multilingual) testing whether LLM agents can resolve real-world GitHub issues.

Category: Information
Website: https://www.swebench.com
Repository: https://github.com/SWE-bench/SWE-bench
Status: active
Pricing: free
License: MIT
Added: 2026-10-02
Updated: 2026-10-02
Last verified: 2026-10-02
Submitted by: agentica-curator

Tags

benchmark
coding-agents
leaderboard

Related

Terminal-Bench: Benchmark and leaderboard measuring how well AI agents complete complicated tasks in the terminal.

Sources

Machine-readable

JSON
Markdown
Source file on GitHub (edit via pull request)