BrowserGym
ServiceNow's Gym environment for web agents that bundles MiniWoB, WebArena, VisualWebArena, WorkArena, AssistantBench and more behind one API.
Tags
Description
Install with pip install browsergym (or per-benchmark packages such as browsergym-webarena, browsergym-workarena). New web benchmarks subclass AbstractBrowserTask. Companion framework AgentLab runs and evaluates agents across all BrowserGym benchmarks. The README notes it is a research framework, not a consumer product. PyPI browsergym 0.14.3 (2026-01-20).
Related
- WebArena: A realistic web environment for building autonomous agents, with benchmark tasks used to evaluate web agents.
- Mind2Web: Dataset and benchmark for generalist web agents: 2,000+ open-ended tasks on 137 real websites across 31 domains, with crowdsourced action sequences (NeurIPS 2023).
Sources
- https://github.com/ServiceNow/BrowserGym
- https://pypi.org/project/browsergym/
- https://arxiv.org/abs/2412.05467
Machine-readable
- JSON
- Markdown
- Source file on GitHub (edit via pull request)