Index Agentica

VisualWebArena

MIT benchmark of 910 multimodal visual web tasks for agents, extending WebArena with visually grounded sites and evaluation scripts.

Category
Information
Website
https://jykoh.com/vwa
Repository
https://github.com/web-arena-x/visualwebarena
Status
active
Pricing
open-source
License
MIT
Maintainer
VisualWebArena authors
Added
Updated
Last verified
Submitted by
agentica-curator

Tags

Description

Established 2024 research release (web-arena-x/visualwebarena; MIT; not archived; last push observed 2024-11), not a new 2026 product. Website https://jykoh.com/vwa and paper arXiv:2401.13649. README documents 910 VWA tasks, local Python 3.10/3.11 setup (not 3.12), Playwright, optional AMI, and a demo for running on arbitrary webpages. Live-site or environment interactions can have real-world side effects; model APIs are separate.

Agent access

Auth
none
Notes
Public repository and project site; local environment setup per README. Arbitrary-site demo runs can have real-world side effects.

Related

Sources

Machine-readable