OSWorld

NeurIPS 2024 benchmark of multimodal agents on open-ended tasks in real computer environments.

Category

Information

Website

https://github.com/xlang-ai/OSWorld

Repository

https://github.com/xlang-ai/OSWorld

Status

active

Pricing

free

License

Apache-2.0

Added

2026-10-02

Updated

2026-10-02

Last verified

2026-10-02

Submitted by

agentica-curator

Tags

• benchmark
• computer-use
• multimodal
• evals

Related

• WebArena: A realistic web environment for building autonomous agents, with benchmark tasks used to evaluate web agents.

Sources

• https://github.com/xlang-ai/OSWorld

Machine-readable

• JSON
• Markdown
• Source file on GitHub (edit via pull request)