MobileAgent

X-PLUGMIT活跃维护

基于多模态大模型的 GUI 智能体家族,能看懂手机和电脑界面并自动点击操作,帮你完成跨 App 的自动化任务。

Mobile-Agent: The Powerful GUI Agent Family

暂无版本9,373star +1 / 7 天942fork同步于 2026-11-10 11:30 UTC

怎么上手

由 README 提炼,执行前请确认
README 未给出统一安装命令,各子项目(如 Mobile-Agent-v3.5、Mobile-Agent-v3)需进入对应目录按其 README 安装
硬件要求按 README 说明

README 未说明具体显存要求;模型权重提供 2B/4B/8B/32B/235B 多种规模,可按规模自行评估;也可通过阿里云百炼或 ModelScope 在线 API 免本地部署使用。

下载:源码 zip·GitHub Releases(安装包)本站不镜像安装包

项目说明

由 README 自动翻译提炼

阿里通义实验室开源的多平台 GUI 智能体家族,让模型自动操作手机、电脑和浏览器

基于多模态大模型的 GUI 智能体家族,能看懂手机和电脑界面并自动点击操作,帮你完成跨 App 的自动化任务。

核心能力

  • 提供 GUI-Owl 多模态跨平台 GUI VLM,具备感知、定位与端到端操作能力
  • Mobile-Agent-v3 多智能体框架支持规划、进度管理、反思与记忆
  • GUI-Owl-1.5 覆盖 2B 到 235B 多种规模,分 Instruct 与 Thinking 版本
  • 支持桌面、移动端、浏览器自动化,并支持工具与 MCP 调用
  • 提供 OSWorld、AndroidWorld 及真机移动场景的评测代码

容易踩的坑

模型权重需从 HuggingFace 或 ModelScope 单独下载,仓库本身不含权重;各版本分散在不同子目录,需先确认要用哪个版本再按其说明安装;本地部署需自行准备手机或桌面运行环境,也可改用无影云手机/云桌面或在线 API 规避

内容由模型根据 README 生成,可能不完整或不准确,以官方文档为准。看原文 README

最近发版

0 个版本

暂无 release 数据(可能没有发版,或尚未同步)。

用户点评

登录用户的真实使用记录,可按版本和硬件筛选
共 0 条

    还没有人点评。第一个说出真实体验的人最有价值。

    README 原文

    未翻译

    👏 Welcome to try Mobile-Agent-v3.5 via our Modelscope online demo or Bailian online demo!

    ❗️We provide the Mobile-Agent-v3.5 API on Bailian for quick experience. View the documentation.

    📢News

    • [2026.5.12] 🔥🔥🔥 ToolCUA is released! An end-to-end Computer Use Agent for optimal GUI-Tool path orchestration, featuring a 2-stage training pipeline (trajectory-aware tool synthesis → Online Agentic RL) to master when to use GUI actions, invoke tools, and switch between them. See HuggingFace for the paper and model weights. Github.
    • [2026.4.06] UI-S1 has been accepted by The 64th Annual Meeting of the Association for Computational Linguistics (ACL 2026) as main conference.
    • [2026.3.31]🔥🔥 The Mobile-Agent-v3.5 is now available on Alibaba Cloud Wuying Cloud Phone (无影云手机) - a cloud-based Android environment for seamless Mobile Use experience. Learn More: Alibaba Cloud Wuying Cloud Phone | Documentation.
    • [2026.3.19]🔥🔥 The GUI-Owl-1.5 series models are now available for online inference. Please refer to the Alibaba Cloud Bailian, and Modelscope API-Inference.
    • [2026.2.14]🔥 GUI-Owl-1.5 is released, a new family of native multi-platform GUI agent foundation models (2B/4B/8B/32B/235B; Instruct & Thinking). The next-generation native GUI agent model family built on Qwen3-VL, supporting desktop/mobile/browser automation and achieving SOTA results on 20+ GUI benchmarks, with strong performance on end-to-end tasks, grounding, tool/MCP calling, and long-horizon memory. Model weights are available on HuggingFace. Technical report is avaliable on Link. See the GUI-Owl 1.5 README for details.
    • [2025.11.25] The GUI-Owl series models are now available for online inference, thanks to Alibaba Cloud Bailian for providing computing power support. Please refer to the Link.
    • [2025.10.30] We released OSWorld-MCP, which is a benchmark for evaluating Model Context Protocol (MCP) tool invocation capabilities in real-world scenarios. See the Link.
    • [2025.9.24] We've released the demo on ModelScope that's based on Wuying Cloud Desktop and Phone. No need to deploy models locally or prepare devices, just input your instruction to experience Mobile-Agent-v3! ModelScope Demo Link and Bailian Demo Link. For a limited-time free Mobile-Agent-v3 API, please check the documentation. The new version based on Qwen-3-VL is coming soon.
    • [2025.9.19] GUI-Critic-R1 has been accepted by The Thirty-ninth Annual Conference on Neural Information Processing Systems (NeurIPS 2025).
    • [2025.9.16] We have released our latest work, UI-S1: Advancing GUI Automation via Semi-online Reinforcement Learning. The paper, code, dataset and model are now open-sourced.
    • [2025.9.16] We've open-sourced the code of GUI-Owl and Mobile-Agent-v3 on OSWorld, AndroidWorld, and real-world mobile scenarios. See the OSWorld Code. The OSWorld RL-tuned checkpoint of GUI-Owl is also released. See the AndroidWorld Code and Real-world Scenarios Code.
    • [2025.8.20]All new GUI-Owl and Mobile-Agent-v3 are released! Technical report can be found here. And model checkpoint will be released on GUI-Owl-7B and GUI-Owl-32B.
      • GUI-Owl is a multi-modal cross-platform GUI VLM with GUI perception, grounding, and end-to-end operation capabilities.
      • Mobile-Agent-v3 is a cross-platform multi-agent framework based on GUI-Owl. It provides capabilities such as planning, progress management, reflection, and memory.
    • [2025.8.14]Mobile-Agent-v3 won the best demo award at the The 24rd China National Conference on Computational Linguistics (CCL 2025).
    • [2025.3.17] PC-Agent has been accepted by the ICLR 2025 Workshop.
    • [2024.9.26] Mobile-Agent-v2 has been accepted by The Thirty-eighth Annual Conference on Neural Information Processing Systems (NeurIPS 2024).
    • [2024.7.29] Mobile-Agent won the best demo award at the The 23rd China National Conference on Computational Linguistics (CCL 2024).
    • [2024.3.10] Mobile-Agent has been accepted by the ICLR 2024 Workshop.

    📊Results

    👀Features

    📝Series of Work

    📺Demo

    💻PC + 🌐Web

    📱Phone

    ⭐Star History

    Star History Chart

    📑Citation

    If you find Mobile-Agent useful for your research and applications, please cite using this BibTeX:

    @article{xu2026mobile,
      title={Mobile-Agent-v3. 5: Multi-platform Fundamental GUI Agents},
      author={Xu, Haiyang and Zhang, Xi and Liu, Haowei and Wang, Junyang and Zhu, Zhaozai and Zhou, Shengjie and Hu, Xuhao and Gao, Feiyu and Cao, Junjie and Wang, Zihua and others},
      journal={arXiv preprint arXiv:2602.16855},
      year={2026}
    }
    
    @article{ye2025mobile,
      title={Mobile-Agent-v3: Foundamental Agents for GUI Automation},
      author={Ye, Jiabo and Zhang, Xi and Xu, Haiyang and Liu, Haowei and Wang, Junyang and Zhu, Zhaoqing and Zheng, Ziwei and Gao, Feiyu and Cao, Junjie and Lu, Zhengxi and others},
      journal={arXiv preprint arXiv:2508.15144},
      year={2025}
    }
    
    @article{lu2025ui,
      title={UI-S1: Advancing GUI Automation via Semi-online Reinforcement Learning},
      author={Lu, Zhengxi and Ye, Jiabo and Tang, Fei and Shen, Yongliang and Xu, Haiyang and Zheng, Ziwei and Lu, Weiming and Yan, Ming and Huang, Fei and Xiao, Jun and others},
      journal={arXiv preprint arXiv:2509.11543},
      year={2025}
    }
    
    @article{wanyan2025look,
      title={Look Before You Leap: A GUI-Critic-R1 Model for Pre-Operative Error Diagnosis in GUI Automation},
      author={Wanyan, Yuyang and Zhang, Xi and Xu, Haiyang and Liu, Haowei and Wang, Junyang and Ye, Jiabo and Kou, Yutong and Yan, Ming and Huang, Fei and Yang, Xiaoshan and others},
      journal={arXiv preprint arXiv:2506.04614},
      year={2025}
    }
    
    @article{liu2025pc,
      title={PC-Agent: A Hierarchical Multi-Agent Collaboration Framework for Complex Task Automation on PC},
      author={Liu, Haowei and Zhang, Xi and Xu, Haiyang and Wanyan, Yuyang and Wang, Junyang and Yan, Ming and Zhang, Ji and Yuan, Chunfeng and Xu, Changsheng and Hu, Weiming and Huang, Fei},
      journal={arXiv preprint arXiv:2502.14282},
      year={2025}
    }
    
    @article{wang2025mobile,
      title={Mobile-Agent-E: Self-Evolving Mobile Assistant for Complex Tasks},
      author={Wang, Zhenhailong and Xu, Haiyang and Wang, Junyang and Zhang, Xi and Yan, Ming and Zhang, Ji and Huang, Fei and Ji, Heng},
      journal={arXiv preprint arXiv:2501.11733},
      year={2025}
    }
    
    @article{wang2024mobile2,
      title={Mobile-Agent-v2: Mobile Device Operation Assistant with Effective Navigation via Multi-Agent Collaboration},
      author={Wang, Junyang and Xu, Haiyang and Jia, Haitao and Zhang, Xi and Yan, Ming and Shen, Weizhou and Zhang, Ji and Huang, Fei and Sang, Jitao},
      journal={arXiv preprint arXiv:2406.01014},
      year={2024}
    }
    
    @article{wang2024mobile,
      title={Mobile-Agent: Autonomous Multi-Modal Mobile Device Agent with Visual Perception},
      author={Wang, Junyang and Xu, Haiyang and Ye, Jiabo and Yan, Ming and Shen, Weizhou and Zhang, Ji and Huang, Fei and Sang, Jitao},
      journal={arXiv preprint arXiv:2401.16158},
      year={2024}
    }