README 未给出完整安装与运行步骤,需转到 gui_agents/s3/README.md 查看;不同版本(S1/S2/S2.5/S3/S4)文档分散在各自子目录,选错版本会找不到对应说明;云端免配置方案需在 Simular 平台申请 API key。

Agent-S
simular-aiApache-2.0活跃维护开源计算机使用智能体,能像人一样操作图形界面完成桌面任务,靠多模态大模型、规划与记忆实现自动化操作。
Agent S: the state-of-the-art open source computer use agents
pip install gui-agentsREADME 未说明具体显存或 GPU 型号要求;仅说明支持 macOS、Windows、Linux 桌面系统。
开源计算机使用智能体框架,用自然语言下达任务,让它像人一样看屏幕点击输入完成桌面操作
开源计算机使用智能体,能像人一样操作图形界面完成桌面任务,靠多模态大模型、规划与记忆实现自动化操作。
核心能力
- 用自然语言描述任务,智能体自动看屏幕并点击、输入、滚动完成
- 跨 macOS、Windows、Linux 三个桌面平台运行
- 提供 Agent S1 到 S4 多个版本,S3 在 OSWorld 上首次超过人类水平
- S4 从任务经验中自动演化智能体使用的工具接口
- 也可通过 Simular API 在云端计算机上直接运行生产版 Sai
容易踩的坑
- v0.3.2最新正式版2025-12-16 · 2025-12-16 17:38 UTC
Full Changelog: https://github.com/simular-ai/Agent-S/compare/v0.3.1...v0.3.2
- v0.3.12025-10-04 · 2025-10-04 22:27 UTC
查看更新说明
Full Changelog: https://github.com/simular-ai/Agent-S/compare/v0.3.0...v0.3.1
- v0.3.02025-10-03 · 2025-10-03 01:31 UTC
查看更新说明
What's Changed
- Fixed
openaction for Windows desktop. by @wehos in https://github.com/simular-ai/Agent-S/pull/130 - Implement a Ctrl+C signal handler to pause for debug purposes by @tageniu in https://github.com/simular-ai/Agent-S/pull/126
- S3 🧠🤓🤯 by @alckasoc in https://github.com/simular-ai/Agent-S/pull/142
New Contributors
- @wehos made their first contribution in https://github.com/simular-ai/Agent-S/pull/130
- @tageniu made their first contribution in https://github.com/simular-ai/Agent-S/pull/126
Full Changelog: https://github.com/simular-ai/Agent-S/compare/v0.2.5...v0.3.0
- Fixed
- v0.2.52025-08-01 · 2025-08-01 16:25 UTC
查看更新说明
What's Changed
- Port not specified in the toml config file. by @mcconnellj in https://github.com/simular-ai/Agent-S/pull/97
- Update README.md to have Python syntax highlighting by @rossamurphy in https://github.com/simular-ai/Agent-S/pull/100
- Update README.md by @rossamurphy in https://github.com/simular-ai/Agent-S/pull/106
- Update requirements by @rossamurphy in https://github.com/simular-ai/Agent-S/pull/105
- docs: add links to other language versions of README by @dowithless in https://github.com/simular-ai/Agent-S/pull/102
- Bug fixes by @alckasoc in https://github.com/simular-ai/Agent-S/pull/119
- 👷🧠🤖😵🕴️ by @alckasoc in https://github.com/simular-ai/Agent-S/pull/124
- 👷🧠🤖😵🕴️ by @alckasoc in https://github.com/simular-ai/Agent-S/pull/125
New Contributors
- @mcconnellj made their first contribution in https://github.com/simular-ai/Agent-S/pull/97
- @rossamurphy made their first contribution in https://github.com/simular-ai/Agent-S/pull/100
- @dowithless made their first contribution in https://github.com/simular-ai/Agent-S/pull/102
Full Changelog: https://github.com/simular-ai/Agent-S/compare/v0.2.4...v0.2.5
- v0.2.42025-05-24 · 2025-05-24 01:02 UTC
查看更新说明
What's Changed
- fix OpenRouter add_message() by @DaWe35 in https://github.com/simular-ai/Agent-S/pull/87
- Fix AttributeError: 'Namespace' object has no attribute 'model_provider' by @DaWe35 in https://github.com/simular-ai/Agent-S/pull/85
- Add grounding model height option by @DaWe35 in https://github.com/simular-ai/Agent-S/pull/95
- Embedding Updates, Improve DAG parsing by @alckasoc in https://github.com/simular-ai/Agent-S/pull/96
New Contributors
- @DaWe35 made their first contribution in https://github.com/simular-ai/Agent-S/pull/87
Full Changelog: https://github.com/simular-ai/Agent-S/compare/v0.2.3...v0.2.4
用户点评
登录用户的真实使用记录,可按版本和硬件筛选还没有人点评。第一个说出真实体验的人最有价值。
Agent S is an open-source computer use agent framework from Simular. Give it a task in plain English. It looks at the screen and completes the task by clicking, typing, and scrolling in ordinary desktop and web apps. It runs on macOS, Windows, and Linux.
🥳 Updates
- 2026/10/20: Released Agent S4 and its paper "Evolving Agent Interfaces": an autonomous computer-use scientist that evolves the interfaces its agents work through from task experience. With Qwen3.8-27B, Agent S4 sets a new open-source state of the art on OSWorld V2 at 21.3%, 3.8 times the same model with fixed interfaces and above GPT-5.5 (13.0%) and Claude Opus 4.8 (20.6%) at a fraction of their cost. (OSWorld V2 is scored as a strict binary pass/fail with no partial credit, so 21.3% reflects benchmark difficulty, not low reliability — see the Agent S4 README for details.)
- 2026/10/01: The Simular API is live. Build your always-on computer agents in a minute. Simular Platform is an autonomous computer API for building always-on agents that fit your needs. World-leading agent infrastructure, 90% token saving. Get an API key →
- 2026/08/28: Sai tops OSWorld 2.0, beating GPT and Opus with lower costs (73%) — our production computer use agent is now state of the art on the hardest desktop benchmark!
- 2026/07/30: The Agent S3 paper "Scaling Agents for Computer Use" is accepted to TMLR 2026!
- 2025/12/15: Agent S3 is the first to surpass human-level performance on OSWorld with an impressive score of 72.60%!
- 2025/10/02: Released Agent S3 and its technical paper, setting a new SOTA of 69.9% on OSWorld (approaching 72% human performance), with strong generalizability on WindowsAgentArena and AndroidWorld! It is also simpler, faster, and more flexible.
- 2025/08/01: Agent S2.5 is released (gui-agents v0.2.5): simpler, better, and faster! New SOTA on OSWorld-Verified!
- 2025/07/07: The Agent S2 paper is accepted to COLM 2025! See you in Montreal!
- 2025/04/27: The Agent S paper won the Best Paper Award 🏆 at ICLR 2025 Agentic AI for Science Workshop!
- 2025/04/01: Released the Agent S2 paper with new SOTA results on OSWorld, WindowsAgentArena, and AndroidWorld!
- 2025/03/12: Released Agent S2 along with v0.2.0 of gui-agents, the new state-of-the-art for computer use agents (CUA), outperforming OpenAI's CUA/Operator and Anthropic's Claude 3.7 Sonnet Computer-Use!
- 2025/01/22: The Agent S paper is accepted to ICLR 2025!
- 2025/01/21: Released v0.1.2 of gui-agents library, with support for Linux and Windows!
- 2024/12/05: Released v0.1.0 of gui-agents library, allowing you to use Agent-S for Mac, OSWorld, and WindowsAgentArena with ease!
- 2024/10/10: Released the Agent S paper and codebase!
🚀 Quick Start
- No setup: run Sai, our production agent, on a cloud computer through the Simular API. See the API docs and the workflow template gallery.
- On your own computer: follow the Agent S3 README.
📚 Agent S Versions
| Version | What it is | Docs | Paper |
|---|---|---|---|
| Agent S4 | Evolves the tool interfaces a computer use agent works through, from its own task experience. Open-source state of the art on OSWorld V2 (21.3% with Qwen3.8-27B). | README | arXiv 2026 |
| Agent S3 | The agent in gui-agents today. First to surpass human performance on OSWorld (72.60%). | README | TMLR 2026 |
| Agent S2.5 | A simpler, faster Agent S2. | README | — |
| Agent S2 | A compositional generalist-specialist framework. | README | COLM 2025 |
| Agent S | The first version: uses computers like a human, through an agent-computer interface. | README | ICLR 2025 |
💬 Citations
If you find this codebase useful, please cite:
@misc{Agent-S4,
title={Evolving Agent Interfaces},
author={Saaket Agashe and Yuzhe Yang and Gonzalo Gonzalez-Pumariega and Bhuvan Chandra Koduru and Chih-Lun Lee and Jiachen Yang and Ang Li and Xin Eric Wang},
year={2026},
eprint={2610.28601},
archivePrefix={arXiv},
primaryClass={cs.AI},
url={https://arxiv.org/abs/2610.28601},
}
@misc{Agent-S3,
title={The Unreasonable Effectiveness of Scaling Agents for Computer Use},
author={Gonzalo Gonzalez-Pumariega and Vincent Tu and Chih-Lun Lee and Jiachen Yang and Ang Li and Xin Eric Wang},
year={2025},
eprint={2510.02250},
archivePrefix={arXiv},
primaryClass={cs.AI},
url={https://arxiv.org/abs/2510.02250},
}
@misc{Agent-S2,
title={Agent S2: A Compositional Generalist-Specialist Framework for Computer Use Agents},
author={Saaket Agashe and Kyle Wong and Vincent Tu and Jiachen Yang and Ang Li and Xin Eric Wang},
year={2025},
eprint={2504.00906},
archivePrefix={arXiv},
primaryClass={cs.AI},
url={https://arxiv.org/abs/2504.00906},
}
@inproceedings{Agent-S,
title={{Agent S: An Open Agentic Framework that Uses Computers Like a Human}},
author={Saaket Agashe and Jiuzhou Han and Shuyu Gan and Jiachen Yang and Ang Li and Xin Eric Wang},
booktitle={International Conference on Learning Representations (ICLR)},
year={2025},
url={https://arxiv.org/abs/2410.08164}
}