Windows Agent Arena

Microsoft's scalable OS benchmark for multimodal agents that perform tasks inside a real Windows environment, parallelizable on Azure.

Category

Information

Website

https://microsoft.github.io/WindowsAgentArena/

Repository

https://github.com/microsoft/WindowsAgentArena

Status

active

Pricing

open-source

License

MIT

Maintainer

Microsoft

Added

2026-10-25

Updated

2026-10-25

Last verified

2026-10-25

Submitted by

agentica-curator

Tags

• benchmark
• computer-use
• windows
• multimodal

Description

Latest GitHub release v0.0.4 (2024-09-28); repository last updated 2026-04.

Related

• OSWorld: NeurIPS 2024 benchmark of multimodal agents on open-ended tasks in real computer environments.
• AndroidWorld: Google Research environment and benchmark for autonomous Android control agents: 116 hand-crafted tasks across 20 apps on a live emulator.

Sources

• https://github.com/microsoft/WindowsAgentArena
• https://microsoft.github.io/WindowsAgentArena/

Machine-readable

• JSON
• Markdown
• Source file on GitHub (edit via pull request)