open-cuak

Aident-AIApache-2.0长期未更新

用视觉语言模型驱动远程浏览器和远程桌面,规模化执行可靠的自动化任务,替代传统 RPA 脚本。

Reliable Automation Agents at Scale

v0.0.1-alpha发布于 2025-02-26 02:15 UTC392star31fork同步于 2026-11-07 07:34 UTC

怎么上手

由 README 提炼,执行前请确认
brew install Aident-AI/homebrew-tap/open-cuak
open-cuak start
硬件要求按 README 说明

README 未说明显存或 GPU 要求;支持 Mac 和 Linux,Windows 需用 WSL2

下载:源码 zip·GitHub Releases(安装包)本站不镜像安装包

项目说明

由 README 自动翻译提炼

开源本地运行的计算机使用自动化代理平台,可规模化管理和调度浏览器自动化任务

用视觉语言模型驱动远程浏览器和远程桌面,规模化执行可靠的自动化任务,替代传统 RPA 脚本。

核心能力

  • 本地运行 Operator 式自动化工作流,数据不出本机
  • 基于视觉的自动化,兼容 Claude、Gemini、LLaVA 等模型
  • 通过浏览器扩展把任意浏览器变成代理搭档
  • 提供独立远程浏览器隔离风险,不共享本机浏览器
  • Cookie 管理免去重复手动登录

容易踩的坑

启动时需下载镜像,首次可能耗时较久;需在 ⚙️ Configurations 页面自行配置 OpenAI 或其他模型 API key 才能对话;本地生产版默认端口为 11970,开发模式为 3000

内容由模型根据 README 生成,可能不完整或不准确,以官方文档为准。看原文 README

最近发版

1 个版本v0.0.1-alpha
  1. v0.0.1-alphapre-release最新正式版2025-02-26 · 2025-02-26 02:15 UTC

    init

用户点评

登录用户的真实使用记录,可按版本和硬件筛选
共 0 条

    还没有人点评。第一个说出真实体验的人最有价值。

    README 原文

    未翻译

    Open CUA (Computer Use Agent) Kit, or Open-CUAK (pronounced "quack" 🦆🗣️), is THE platform for teaching, hiring and managing automation agents at scale — starting with browsers.

    🎯 Why Open-CUAK?

    In the real world, for real businesses, working with real people, reliability is everything. When automation becomes reliable, it becomes scalable. And when it becomes scalable, it becomes profitable.

    That’s why Open-CUAK is designed to run and manage thousands of automation agents, ensuring each one is reliable.

    This project is still in its very early days, but our team is working very hard to make it a reality, soon. This is just the beginning of a new era in work, a new way to a world of abundant productivity.

    And when productivity becomes truly abundant, we want to make sure it is equally distributed.

    That's why we are making it open-sourced, today.

    Read more in our launch blog.


    Quick Start

    👉 Start Local Production Build

    1. (optional) Make sure you have brew for package management

      works on Mac and Linux. For Windows, use WSL2 for now.

      /bin/bash -c "$(curl -fsSL https://raw.githubusercontent.com/Homebrew/install/HEAD/install.sh)"
      
      # (optional) on Linux, if `brew` command is not available in terminal, use this to register `brew`
      test -d ~/.linuxbrew && eval "$(~/.linuxbrew/bin/brew shellenv)"
      test -d /home/linuxbrew/.linuxbrew && eval "$(/home/linuxbrew/.linuxbrew/bin/brew shellenv)"
      echo "eval \"\$($(brew --prefix)/bin/brew shellenv)\"" >> ~/.bashrc
      
      # (optional) verify the successful installation of `brew`
      brew doctor
      
    2. Install Open-CUAK package

      brew install Aident-AI/homebrew-tap/open-cuak
      
      # or use this to update to the latest version
      brew update && brew upgrade Aident-AI/homebrew-tap/open-cuak
      
    3. Start Open-CUAK services

      downloading images can take a while (Sorry! We will optimize this soon.)

      open-cuak start
      
    4. Ta-da! It is now ready locally at http://localhost:11970.

      Don't forget to go to the ⚙️ Configurations page to set your OpenAI or other major model API key to chat with Aiden!

    Demos

    1. Agent Demo #1: Canva Use Agent

      An automation agent uses Canva to create a poster for President's Day. When it encounters issues, such as whether to use Pro templates (require a Canva paid plan), it proactively asks the user for additional instructions.

      https://github.com/user-attachments/assets/f283189b-bc90-4875-8bd5-75b2a6a4bf9f

    2. Agent Demo #2: Expedia Flight Search

      An agent uses built-in remote-browser running locally to search for flight tickets on Expedia.

      https://github.com/user-attachments/assets/e2dd7276-fff7-4ed1-a042-3c1a6bbecef8

    3. Feature Demo: Account Management

      Account Management lets agents use your account and tools on your behalf.

      https://github.com/user-attachments/assets/1de1069d-053f-408f-b07b-61b399bfcc1f

    Core Features

    ✅ Run Operator-like automation workflows locally, ensuring full privacy
    ✅ Use vision-based automation with more flexibility and reliability, just like a human
    ✅ Turn any browser into an Operator-companion, with a browser extension
    ✅ Utilize a dedicated remote browser to mitigate risks associated, without sharing your own
    ✅ Use any vision-compatible model, whether frontier or open-source (Claude, Gemini, LLaVA, etc.)
    ✅ Bypass frustrating bot detection, unlocking more automation possibilities
    ✅ Cookie management for easy login, without the need for manual re-login
    🔜 Teach agents new workflows reliably, with SOP-based training
    🔜 Centralize all account access in one place, managing everything agents have access to
    ⏳ Monitor and manage a large number of tasks, with built-in observability tools
    ⏳ Deploy and scale hundreds of agents to execute real-world tasks, in parallel
    ⏳ Open source an RL-trained CUA model to run automations, for free
    

    Development Setup

    ⚡ Start Development Servers

    1. Install dependencies.

      # on mac
      brew install node
      
      # on linux
      sudo apt install nodejs npm
      
      npm install -g pnpm
      
      # at repo root
      # on mac
      npm run init:mac
      
      # on linux
      npm run init:linux
      
    2. Start the dev servers.

      # at repo root
      npm run dev
      
      
    3. Now, it is ready locally at http://localhost:3000.

    ▶️ Build and Run Production Build from Local

    1. Run local production build (with docker).

      # at repo root
      npm run docker:start