登录

acu

trycua长期未更新

收集 Computer Use 类 AI Agent 的研究论文、项目、框架和工具，帮开发者快速找到让 AI 操作电脑和浏览器的资源。

A curated list of resources about AI agents for Computer Use, including research papers, projects, frameworks, and tools.

暂无版本1,809star146fork同步于 2026-11-07 07:31 UTC
电脑操作AgentGUI Agent资源合集AI Agent浏览器自动化
对比 GitHub 官网aiai-researchawesomecomputercomputer-use

怎么上手

README 里没有找到可直接复制的安装命令
原文

README 里没有找到可直接复制的安装命令，请到 README 或官方文档查看安装方式。

硬件要求按 README 说明

README 未说明

支持 Apple Silicon
下载：源码 zip·GitHub Releases（安装包）本站不镜像安装包

项目说明

由 README 自动翻译提炼
没人工点评？写下你的经验

一份关于 Computer Use AI Agent 的资源清单，汇总论文、框架、项目与工具，帮你快速摸清这个方向

收集 Computer Use 类 AI Agent 的研究论文、项目、框架和工具，帮开发者快速找到让 AI 操作电脑和浏览器的资源。

核心能力

  • 按 Surveys、Frameworks & Models、UI Grounding、Dataset、Benchmark、Safety 分类整理论文
  • 收录开源与商业项目，并细分框架模型、环境沙箱与自动化
  • 汇总 Anthropic、OpenAI 等厂商关于 computer use 的官方文章
  • 每条资源附 arXiv 或代码仓库链接，便于直接跳转查阅
  • 覆盖 PC、Web 与移动端 GUI Agent 的研究与实现

容易踩的坑

这是资源清单仓库而非可运行工具，没有安装步骤；条目多为外部链接，需自行访问 arXiv 或对应代码仓库；清单持续更新，部分项目链接可能失效

内容由模型根据 README 生成，可能不完整或不准确，以官方文档为准。看原文 README

最近发版

0 个版本
全部 release

暂无 release 数据（可能没有发版，或尚未同步）。

用户点评

登录用户的真实使用记录，可按版本和硬件筛选
共 0 条

    还没有人点评。第一个说出真实体验的人最有价值。

    README 原文

    未翻译
    在 GitHub 打开

    X Community

    ACU - Awesome Agents for Computer Use

    An AI Agent for Computer Use is an autonomous program that can reason about tasks, plan sequences of actions, and act within the domain of a computer or mobile device in the form of clicks, keystrokes, other computer events, command-line operations and internal/external API calls. These agents combine perception, decision-making, and control capabilities to interact with digital interfaces and accomplish user-specified goals independently.

    A curated list of resources about AI agents for Computer Use, including research papers, projects, frameworks, and tools.

    Table of Contents

    Articles

    Papers

    Surveys

    Frameworks & Models

    UI Grounding

    Dataset

    Benchmark

    Safety

    Projects

    Open Source

    Frameworks & Models

    • AutoGen

      • Framework for building AI agent systems.
      • It simplifies the creation of event-driven, distributed, scalable, and resilient agentic applications.

    • Auto-GPT

      • Autonomous GPT-4 agent
      • Task automation focus

    • Browser Use

      • Make websites accessible for AI agents with vision + HTML extraction
      • Supports multi-tab management and custom actions with LangChain integration

    • Claude Computer Use Demo

      • MacOS implementation
      • Claude integration

    • Claude Minecraft Use

      • Game automation
      • Specialized use case

    • Computer Use OOTB

      • Ready-to-use implementation
      • Comprehensive toolset

    • Cua

      • Computer Use Interface & Agent

    • Cybergod

      • Advanced computer control

    • Grunty

      • Computer control agent
      • Task automation focus

    • Inferable

      • Distributed agent builder platform
      • Build tools with existing code

    • LaVague

      • AI web agent framework
      • Modular architecture

    • Mac Computer Use

      • MacOS-specific tools
      • Anthropic integration

    • NatBot

      • Browser automation
      • GPT-4 Vision integration

    • Notte Browser Using Agent

      • Full-stack web AI agents framework (agents, automations, cloud browser sessions)
      • Notte turns websites into structured, navigable maps described in natural language

    • OpenAdapt

      • AI-First Process Automation
      • Multimodal model integration

    • OpenInterface

      • Open-source UI interaction framework
      • Cross-platform support

    • OpenInterpreter

      • General-purpose computer control framework
      • Python-based, extensible architecture

    • Open Source Computer Use by E2B

      • Open-source implementation of computer control capabilities
      • Secure sandboxed environment for AI agents

    • Self-Operating Computer (Nov. 2023)

      • The first Computer Use framework created
      • Computer control framework
      • Vision-based automation

    • Skyvern

      • AI web agent framework
      • Automate browser-based workflows with LLMs using vision and HTML extraction

    • Surfkit

      • Device operation toolkit
      • Extensible agent framework

    • WebMarker

      • Web page annotation tool
      • Vision-language model support

    • Upsonic

      • Reliable agent framework that support MCP
      • Integrated Browser Use and Computer Use

    UI Grounding

    • AskUI/PTA-1

      • A small vision language model for computer & phone automation, based on Florence-2.
      • With only 270M parameters it outperforms much larger models in GUI text and element localization.

    • Microsoft/OmniParser

      • A general screen parsing tool, which interprets/converts UI screenshot to structured format, to improve existing LLM based UI agent

    Environment & Sandbox

    Automation

    • nut.js

      • Native UI automation
      • JavaScript/TypeScript implementation

    • PyAutoGUI

      • Cross-platform GUI automation
      • Python-based control library

    Commercial

    Frameworks & Models

    • Anthropic Claude Computer Use

      • Commercial computer control capability
      • Integrated with Claude 3.5 models

    • Multion

      • AI agents that can fully complete tasks in any web environment.

    • Runner H

      • Advanced AI agent for real-world applications.
      • Scores 67% on WebVoyager

    Contributing

    We welcome and encourage contributions from the community! Here's how you can help:

    • Add new resources: Found a relevant paper, project, or tool? Submit a PR to add it
    • Fix errors: Help us correct any mistakes in existing entries
    • Improve organization: Suggest better ways to structure the information
    • Update content: Keep entries up-to-date with latest developments

    To contribute:

    1. Fork the repository
    2. Create a new branch for your changes
    3. Submit a pull request with a clear description of your additions/changes
    4. Post in the X Community to let everyone know about the new resource

    For an example of how to format your contribution, please refer to this PR.

    Thank you for helping spread knowledge about AI agents for computer use!

    相关项目

    同分类里 star 最高的项目
    对比全部 →
    browser-use
    browser-use·Python

    开源的 Python 库，让大模型直接操控浏览器完成点击、填表、抓取等网页任务，省去手写 Playwright 脚本的麻烦。

    浏览器自动化+4电脑 / 浏览器 Agent
    120518+28813k0.13.142026-11-10 09:29 UTC
    browser
    lightpanda-io·Zig

    用 Zig 从零编写的无头浏览器，专为 AI 和自动化场景设计，兼容 CDP 协议，可替代 Playwright、Puppeteer 驱动网页抓取与 Agent 任务。

    无头浏览器+4电脑 / 浏览器 Agent
    41756+2362.1k1.0.32026-11-10 11:18 UTC
    UI-TARS-desktop
    bytedance·TypeScript

    字节开源的多模态 AI Agent 桌面栈，把前沿模型和 Agent 基础设施连起来，让 Agent 能像人一样操作 GUI、浏览器和电脑完成任务。

    多模态Agent+4电脑 / 浏览器 Agent
    39586+214.0kv0.3.12026-10-09 01:29 UTC
    Jobs_Applier_AI_Agent
    feder-cr·Python

    自动投递简历的求职机器人，能按简历匹配度筛选岗位并批量提交申请，睡觉时也能持续找工作。

    求职自动化+4电脑 / 浏览器 Agent
    32444+454.8kusage-counter2026-11-10 02:38 UTC