Agent-S

simular-aiApache-2.0活跃维护

开源计算机使用智能体,能像人一样操作图形界面完成桌面任务,靠多模态大模型、规划与记忆实现自动化操作。

Agent S: the state-of-the-art open source computer use agents

v0.3.2发布于 2025-12-16 17:38 UTC12,921star +23 / 7 天1,506fork同步于 2026-11-10 11:27 UTC

怎么上手

由 README 提炼,执行前请确认
pip install gui-agents
硬件要求按 README 说明

README 未说明具体显存或 GPU 型号要求;仅说明支持 macOS、Windows、Linux 桌面系统。

下载:源码 zip·GitHub Releases(安装包)本站不镜像安装包

项目说明

由 README 自动翻译提炼

开源计算机使用智能体框架,用自然语言下达任务,让它像人一样看屏幕点击输入完成桌面操作

开源计算机使用智能体,能像人一样操作图形界面完成桌面任务,靠多模态大模型、规划与记忆实现自动化操作。

核心能力

  • 用自然语言描述任务,智能体自动看屏幕并点击、输入、滚动完成
  • 跨 macOS、Windows、Linux 三个桌面平台运行
  • 提供 Agent S1 到 S4 多个版本,S3 在 OSWorld 上首次超过人类水平
  • S4 从任务经验中自动演化智能体使用的工具接口
  • 也可通过 Simular API 在云端计算机上直接运行生产版 Sai

容易踩的坑

README 未给出完整安装与运行步骤,需转到 gui_agents/s3/README.md 查看;不同版本(S1/S2/S2.5/S3/S4)文档分散在各自子目录,选错版本会找不到对应说明;云端免配置方案需在 Simular 平台申请 API key。

内容由模型根据 README 生成,可能不完整或不准确,以官方文档为准。看原文 README

最近发版

5 个版本v0.3.2
  1. v0.3.2最新正式版2025-12-16 · 2025-12-16 17:38 UTC
  2. v0.3.12025-10-04 · 2025-10-04 22:27 UTC
    查看更新说明
  3. v0.3.02025-10-03 · 2025-10-03 01:31 UTC
    查看更新说明

    What's Changed

    New Contributors

    Full Changelog: https://github.com/simular-ai/Agent-S/compare/v0.2.5...v0.3.0

  4. v0.2.52025-08-01 · 2025-08-01 16:25 UTC
    查看更新说明

    What's Changed

    New Contributors

    Full Changelog: https://github.com/simular-ai/Agent-S/compare/v0.2.4...v0.2.5

  5. v0.2.42025-05-24 · 2025-05-24 01:02 UTC
    查看更新说明

    What's Changed

    New Contributors

    Full Changelog: https://github.com/simular-ai/Agent-S/compare/v0.2.3...v0.2.4

用户点评

登录用户的真实使用记录,可按版本和硬件筛选
共 0 条

    还没有人点评。第一个说出真实体验的人最有价值。

    README 原文

    未翻译

    Agent S is an open-source computer use agent framework from Simular. Give it a task in plain English. It looks at the screen and completes the task by clicking, typing, and scrolling in ordinary desktop and web apps. It runs on macOS, Windows, and Linux.

    🥳 Updates

    • 2026/10/20: Released Agent S4 and its paper "Evolving Agent Interfaces": an autonomous computer-use scientist that evolves the interfaces its agents work through from task experience. With Qwen3.8-27B, Agent S4 sets a new open-source state of the art on OSWorld V2 at 21.3%, 3.8 times the same model with fixed interfaces and above GPT-5.5 (13.0%) and Claude Opus 4.8 (20.6%) at a fraction of their cost. (OSWorld V2 is scored as a strict binary pass/fail with no partial credit, so 21.3% reflects benchmark difficulty, not low reliability — see the Agent S4 README for details.)
    • 2026/10/01: The Simular API is live. Build your always-on computer agents in a minute. Simular Platform is an autonomous computer API for building always-on agents that fit your needs. World-leading agent infrastructure, 90% token saving. Get an API key →
    • 2026/08/28: Sai tops OSWorld 2.0, beating GPT and Opus with lower costs (73%) — our production computer use agent is now state of the art on the hardest desktop benchmark!
    • 2026/07/30: The Agent S3 paper "Scaling Agents for Computer Use" is accepted to TMLR 2026!
    • 2025/12/15: Agent S3 is the first to surpass human-level performance on OSWorld with an impressive score of 72.60%!
    • 2025/10/02: Released Agent S3 and its technical paper, setting a new SOTA of 69.9% on OSWorld (approaching 72% human performance), with strong generalizability on WindowsAgentArena and AndroidWorld! It is also simpler, faster, and more flexible.
    • 2025/08/01: Agent S2.5 is released (gui-agents v0.2.5): simpler, better, and faster! New SOTA on OSWorld-Verified!
    • 2025/07/07: The Agent S2 paper is accepted to COLM 2025! See you in Montreal!
    • 2025/04/27: The Agent S paper won the Best Paper Award 🏆 at ICLR 2025 Agentic AI for Science Workshop!
    • 2025/04/01: Released the Agent S2 paper with new SOTA results on OSWorld, WindowsAgentArena, and AndroidWorld!
    • 2025/03/12: Released Agent S2 along with v0.2.0 of gui-agents, the new state-of-the-art for computer use agents (CUA), outperforming OpenAI's CUA/Operator and Anthropic's Claude 3.7 Sonnet Computer-Use!
    • 2025/01/22: The Agent S paper is accepted to ICLR 2025!
    • 2025/01/21: Released v0.1.2 of gui-agents library, with support for Linux and Windows!
    • 2024/12/05: Released v0.1.0 of gui-agents library, allowing you to use Agent-S for Mac, OSWorld, and WindowsAgentArena with ease!
    • 2024/10/10: Released the Agent S paper and codebase!

    🚀 Quick Start

    📚 Agent S Versions

    VersionWhat it isDocsPaper
    Agent S4Evolves the tool interfaces a computer use agent works through, from its own task experience. Open-source state of the art on OSWorld V2 (21.3% with Qwen3.8-27B).READMEarXiv 2026
    Agent S3The agent in gui-agents today. First to surpass human performance on OSWorld (72.60%).READMETMLR 2026
    Agent S2.5A simpler, faster Agent S2.README—
    Agent S2A compositional generalist-specialist framework.READMECOLM 2025
    Agent SThe first version: uses computers like a human, through an agent-computer interface.READMEICLR 2025

    💬 Citations

    If you find this codebase useful, please cite:

    @misc{Agent-S4,
          title={Evolving Agent Interfaces}, 
          author={Saaket Agashe and Yuzhe Yang and Gonzalo Gonzalez-Pumariega and Bhuvan Chandra Koduru and Chih-Lun Lee and Jiachen Yang and Ang Li and Xin Eric Wang},
          year={2026},
          eprint={2610.28601},
          archivePrefix={arXiv},
          primaryClass={cs.AI},
          url={https://arxiv.org/abs/2610.28601}, 
    }
    
    @misc{Agent-S3,
          title={The Unreasonable Effectiveness of Scaling Agents for Computer Use}, 
          author={Gonzalo Gonzalez-Pumariega and Vincent Tu and Chih-Lun Lee and Jiachen Yang and Ang Li and Xin Eric Wang},
          year={2025},
          eprint={2510.02250},
          archivePrefix={arXiv},
          primaryClass={cs.AI},
          url={https://arxiv.org/abs/2510.02250}, 
    }
    
    @misc{Agent-S2,
          title={Agent S2: A Compositional Generalist-Specialist Framework for Computer Use Agents}, 
          author={Saaket Agashe and Kyle Wong and Vincent Tu and Jiachen Yang and Ang Li and Xin Eric Wang},
          year={2025},
          eprint={2504.00906},
          archivePrefix={arXiv},
          primaryClass={cs.AI},
          url={https://arxiv.org/abs/2504.00906}, 
    }
    
    @inproceedings{Agent-S,
        title={{Agent S: An Open Agentic Framework that Uses Computers Like a Human}},
        author={Saaket Agashe and Jiuzhou Han and Shuyu Gan and Jiachen Yang and Ang Li and Xin Eric Wang},
        booktitle={International Conference on Learning Representations (ICLR)},
        year={2025},
        url={https://arxiv.org/abs/2410.08164}
    }
    

    Star History

    Star History Chart