InternNav

InternRoboticsMIT更新放缓

面向机器人导航的开源平台,用多模态大模型和视觉语言动作模型构建通用导航基础模型,解决跨场景视觉导航与空间智能问题。

InternRobotics' open platform for building generalized navigation foundation models.

0.3.1发布于 2026-02-11 02:56 UTC1,168star146fork同步于 2026-11-07 07:31 UTC

怎么上手

由 README 提炼,执行前请确认
请参考官方文档 https://internrobotics.github.io/user_guide/internnav/quick_start/index.html 完成安装
硬件要求按 README 说明

README未说明具体显存与GPU型号要求;训练与评测依赖Habitat、Isaac Sim等仿真平台,真实部署代码面向Unitree Go2。

支持 Apple Silicon
下载:源码 zip·GitHub Releases(安装包)本站不镜像安装包

项目说明

由 README 自动翻译提炼

基于PyTorch、Habitat与Isaac Sim的具身导航开源工具箱,覆盖VLN与视觉导航的训练评估全流程

面向机器人导航的开源平台,用多模态大模型和视觉语言动作模型构建通用导航基础模型,解决跨场景视觉导航与空间智能问题。

核心能力

  • 模块化定制VLN-CE、点/图/轨迹目标视觉导航与连续轨迹输出
  • 兼容Habitat与Isaac Sim两大主流仿真平台做训练与评测
  • 内置6个数据集与基准、10+主流基线模型
  • 提供InternData-N1数据集,含3k+场景与830k VLN数据
  • 支持双系统导航基础模型InternVLA-N1及真实世界部署代码

容易踩的坑

模型权重需从Hugging Face的InternRobotics仓库单独下载;部分基线(如NavDP系列)需按NavDP仓库说明单独安装基线库;StreamVLN模型标注为coming soon,暂不可用。

内容由模型根据 README 生成,可能不完整或不准确,以官方文档为准。看原文 README

最近发版

5 个版本0.3.1
  1. 0.3.1InternNav v0.3.1 Release最新正式版2026-02-11 · 2026-02-11 02:56 UTC

    Changelog of v0.3.1 (2026/02/09)

    Highlights

    • Update dataset conversion for InternData-N1 VLN-PE v0.5 format (#288)
    • Support vis_debug option for Habitat evaluation (#265)

    New Features

    • Support vis_debug option for Habitat evaluation (#265)

    Improvements

    • Update submodule path from src to third_party (#266)

    Bug Fixes

    • Fix VLLN path handling (#228)
    • Fix dataset conversion for InternData-N1 VLN-PE v0.5 format (#288)

    Full Changelog: https://github.com/InternRobotics/InternNav/compare/release/v0.3.0...release/v0.3.1

  2. 0.3.0InternNav v0.3.0 Release2026-01-07 · 2026-01-07 05:29 UTC
    查看更新说明

    Changelog of v0.3.0 (2026/01/05)

    Highlights

    • Support training of InternVLA-N1 and evaluation on RxR (#184)
    • Support training and evaluation for the VL-LN benchmark (#193, #198)
    • Add a new flash without collision controller (#189)

    New Features

    • Add training code for InternVLA-N1 (#184)
    • Support evaluation on the RxR dataset (#184)
    • Add training code for the VL-LN benchmark baseline (#198)
    • Support evaluation on VL-LN benchmark (#193)
    • Add a Flash-without-Collisoin controller (#189)

    Improvements

    • Decouple System 2 and Dual-System evaluation functions in the Habitat evaluator for better readability (#184)
    • Update InternVLA-N1 agent in VLN-PE to align with the updated InternVLA-N1 policy interface (#184)
    • Enhance the Habitat evaluation pipeline to handle NaN values in results (#217)
    • Update the README to include community tutorials (#217)

    Bug Fixes

    • Fix the version of diffusers in the requirements (#184)
    • Fix the result JSON saving path in VLN-PE (#217)
    • Fix a bug in RxR evaluation result collection (#217)
    • Removed legacy code in scripts/demo (#217)

    Contributors

    @kellyiss @DuangZhu @0309hws @kew6688

    Full Changelog: https://github.com/InternRobotics/InternNav/compare/release/v0.2.0...release/v0.3.0

  3. 0.2.0InternNav v0.2.0 Release2025-12-08 · 2025-12-08 08:59 UTC
    查看更新说明

    Changelog of v0.2.0 (2025/12/4)

    Highlights

    • Support distributed evaluation for VLN-PE, reducing full benchmark runtime to ~1.6 hours using 16 GPUs (≈13× speedup over single-GPU eval) (#168)
    • Enhance Habitat evaluation flow with DistributedEvaluator and HabitatEnv integrated into the InternNav framework (#168)
    • Support install flags for dependency isolation: [habitat], [isaac], [model] (#135)

    New Features

    • Support distributed evaluation for VLN-PE (#168)
    • Support a unified evaluation script eval.py, with new Habitat evaluation configs in scripts/eval/configs (#168)
    • Support install flags for dependency isolation (#168)

    Improvements

    • Add HabitatEnv with episode pool management (#168)
    • Update InternUtopiaEnv for distributed execution and episode pool management (#168)
    • Enhance episode_loader in VLN-PE with new distributed mode compatibility (#168)
    • Update data_collector to support progress checkpointing and incremental result aggregation in distributed evaluation. (#168)

    Bug Fixes

    • Fix logger disabled after Isaac Sim initialization during evaluator bootstrap (#168)
    • Fix dataloader bug where revise_one_data() was incorrectly applied to all datasets (#168)
    • Fix visualization images dimension mismatch during InternVLA-N1 evaluation (#168)
    • Fix distributed evaluation crash in rdp policy (#168)
    • Fix GitHub CI tests (#168)

    Contributors

    A total of 3 developers contributed to this release. @kew6688, @Gariscat, @yuqiang-yang

    Full changelog: https://github.com/InternRobotics/InternNav/compare/release/v0.1.0...release/v0.2.0

  4. 0.1.1release for v0.1.12025-09-16 · 2025-09-16 08:37 UTC
    查看更新说明
    • fix existing issues
    • update from issues
    • new docker image
    • iros challenge submit script fixed
  5. 0.1.0release for v0.1.02025-09-08 · 2025-09-08 03:32 UTC
    查看更新说明

    Welcome to the InternNav IROS Challenge Release. This version provides a stable codebase for challenge participants, along with baseline models and the released InternVLA-N1 benchmarks.

用户点评

登录用户的真实使用记录,可按版本和硬件筛选
共 0 条

    还没有人点评。第一个说出真实体验的人最有价值。

    README 原文

    未翻译

    demo

    HomePage Technical Report — InternVLA-N1 DualVLN Paper — arXiv doc GitHub star chart GitHub Issues Discord

    🏠 Introduction

    InternNav is an All-in-one open-source toolbox for embodied navigation based on PyTorch, Habitat and Isaac Sim.

    Highlights

    • Modular Support of the Entire Navigation System

    We support modular customization and study of the entire navigation system, including vision-language navigation with discrete action space (VLN-CE), visual navigation (VN) given point/image/trajectory goals, and the whole VLN system with continuous trajectory outputs.

    • Compatibility with Mainstream Simulation Platforms

    The toolbox is compatible with different training and evaluation requirements, supporting different environments for the usage of mainstream simulation platforms such as Habitat and Isaac Sim.

    • Comprehensive Datasets, Models and Benchmarks

    The toolbox supports the most comprehensive 6 datasets & benchmarks and 10+ popular baselines, including both mainstream and our established brand new ones.

    • State of the Art

    The toolbox supports the most advanced high-quality navigation dataset, InternData-N1, which includes 3k+ scenes and 830k VLN data covering diverse embodiments and scenes, and the first dual-system navigation foundation model with leading performance on all the benchmarks and zero-shot generalization capability in the real world, InternVLA-N1.

    🔥 News

    TimeUpdate
    2026/01InternNav v0.3.0 released.
    2025/12We introduce Interactive Instance Goal Navigation (IIGN) and release VL-LN Bench to enable InternVLA-N1 to solve this task, with large-scale dialog-trajectory collection plus training and evaluation support. See our website for details.
    2025/12Training code for InternVLA-N1 and the corresponding usage doc is now available. This release provides two model configurations: InternVLA-N1 (Dual System) with NavDP* and InternVLA-N1 (Dual System) DualVLN . For model architecture and training details, please refer to the DualVLN paper.
    2025/11InternNav v0.2.0 released — added distributed evaluation support for VLN-PE.
    2025/10Add a inference-only demo of InternVLA-N1.
    2025/10InternVLA-N1 technical report is released. Please check our homepage.
    2025/09Real-world deployment code of InternVLA-N1 released. Upload 3D printing files for Unitree Go2.
    2025/07Hosting the 🏆 IROS 2025 Grand Challenge (see updates at official website)
    2025/07InternNav v0.1.1 released

    📋 Table of Contents

    📚 Getting Started

    Please refer to the documentation for quick start with InternNav, from installation to training or evaluating supported models.

    📦 Overview

    🧪 Supported Benchmarks

    🤗 Model Zoo & Downloads

    📊 Benchmark Results

    VLN-CE Benchmarks

    📍 R2R Dataset

    ModelObservationNE ↓OS ↑SR ↑SPL ↑
    InternVLA-N1-wo-dagger (S2) + ShortestPathFollower-4.8960.655.452.1
    InternVLA-N1-wo-dagger (Dual System) with NavDP*RGB-D4.8363.358.254.0
    InternVLA-N1 (S2) + ShortestPathFollower-4.2568.360.955.2
    InternVLA-N1 (Dual System) with NavDP*RGB-D4.2270.464.158.1
    InternVLA-N1 (Dual System) DualVLN RGB4.0570.764.358.5

    📍 RxR Dataset

    ModelObservationNE ↓SR ↑SPL ↑nDTW ↑
    InternVLA-N1 (S2) + ShortestPathFollower-5.7163.555.046.8
    InternVLA-N1 (Dual System) with NavDP*RGB-D4.7059.750.669.7
    InternVLA-N1 (Dual System) DualVLN RGB4.5861.451.870.0
    VLN-PE Benchmarks

    📍 Flash Controller on R2R Unseen

    ModelNE ↓OS ↑SR ↑SPL ↑
    Seq2Seq8.2743.015.79.7
    CMA7.5245.024.418.2
    RDP6.9842.524.917.5
    InternVLA-N1 (System 2) + iPlanner4.9155.5347.0741.09
    InternVLA-N1 (System 2) + NavDP4.2267.3358.7250.98
    InternVLA-N1 (Dual System) DualVLN 3.9069.9363.6256.49

    📍 Physical Controller on R2R Unseen

    ModelNE ↓OS ↑SR ↑SPL ↑
    Seq2Seq7.8828.115.110.7
    CMA7.2631.422.118.6
    RDP6.7236.925.217.7
    InternVLA-N1 (Dual System) DualVLN 4.6655.951.642.49
    Visual Navigation Benchmarks

    📍 ClutteredEnv Dataset

    ModelSR ↑SPL ↑
    iPlanner84.883.6
    ViPlanner72.472.3
    NavDP <InternVLA-N1 (System 1)>89.887.7

    📍 InternScenes Dataset

    ModelSR ↑SPL ↑
    iPlanner48.846.7
    ViPlanner54.352.5
    NavDP <InternVLA-N1 (System 1)>65.760.7

    🔧 Customization

    Please refer to the tutorial for advanced usage of InternNav, including customization of datasets, models and experimental settings.

    👥 Contribute

    If you would like to contribute to InternNav, please check out our contribution guide. For example, raising issues, fixing bugs in the framework, and adapting or adding new policies and data to the framework.

    Note: We welcome the feedback of the model's zero-shot performance when deploying in your own environment. Please show us your results and offer us your future demands regarding the model's capability. We will select the most valuable ones and collaborate with users together to solve them in the next few months :)

    🚀 Community Deployment & Best Practices

    We are excited to see InternNav being deployed and extended by the community across different robots and real-world scenarios. Below are selected community-driven deployment guides and solution write-ups, which may serve as practical references for advanced users.

    🔗 Citation

    If you find our InternVLA-N1 (Dual System) model helpful, please cite our ICLR paper and previous technical report:

    @inproceedings{
      wei2026ground,
      title={Ground Slow, Move Fast: A Dual-System Foundation Model for Generalizable Vision-Language Navigation},
      author={Meng Wei and Chenyang Wan and Jiaqi Peng and Xiqian Yu and Yuqiang Yang and Delin Feng and Wenzhe Cai and Chenming Zhu and Tai Wang and Jiangmiao Pang and Xihui Liu},
      booktitle={The Fourteenth International Conference on Learning Representations},
      year={2026},
      url={https://openreview.net/forum?id=GK4rznYwhn}
    }
    @misc{internvla-n1,
        title = {{InternVLA-N1: An} Open Dual-System Navigation Foundation Model with Learned Latent Plans},
        author = {InternNav Team},
        year = {2025},
        booktitle={arXiv},
    }
    

    If you use this InternNav codebase to develop your method, please cite our codebase:

    @misc{internnav2025,
        title = {{InternNav: InternRobotics'} open platform for building generalized navigation foundation models},
        author = {InternNav Contributors},
        howpublished={\url{https://github.com/InternRobotics/InternNav}},
        year = {2025}
    }
    
    
    @inproceedings{vlnpe,
      title={Rethinking the Embodied Gap in Vision-and-Language Navigation: A Holistic Study of Physical and Visual Disparities},
      author={Wang, Liuyi and Xia, Xinyuan and Zhao, Hui and Wang, Hanqing and Wang, Tai and Chen, Yilun and Liu, Chengju and Chen, Qijun and Pang, Jiangmiao},
      booktitle={Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV)},
      year={2025}
    }
    @inproceedings{streamvln,
        title = {StreamVLN: Streaming Vision-and-Language Navigation via SlowFast Context Modeling},
        author = {Wei, Meng and Wan, Chenyang and Yu, Xiqian and Wang, Tai and Yang, Yuqiang and Mao, Xiaohan and Zhu, Chenming and Cai, Wenzhe and Wang, Hanqing and Chen, Yilun and Liu, Xihui and Pang, Jiangmiao},
        booktitle={2026 IEEE International Conference on Robotics and Automation (ICRA)},
        year = {2026}
    }
    @inproceedings{navdp,
        title = {NavDP: Learning Sim-to-Real Navigation Diffusion Policy with Privileged Information Guidance},
        author = {Wenzhe Cai, Jiaqi Peng, Yuqiang Yang, Yujian Zhang, Meng Wei, Hanqing Wang, Yilun Chen, Tai Wang and Jiangmiao Pang},
        booktitle={2026 IEEE International Conference on Robotics and Automation (ICRA)},
        year = {2026},
    }
    

    📄 License

    InternNav's codes are MIT licensed. The open-sourced InternData-N1 data are under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License . Other datasets like VLN-CE inherit their own distribution licenses.

    👏 Acknowledgement

    • InternUtopia (Previously GRUtopia): The closed-loop evaluation and GRScenes-100 data in this framework relies on the InternUtopia framework.
    • Diffusion Policy: Diffusion policy implementation.
    • LongCLIP: Long-text CLIP model.
    • VLN-CE: Vision-and-Language Navigation in Continuous Environments based on Habitat.
    • Qwen2.5-VL: The pretrained vision-language foundation model.
    • LeRobot: The data format used in this project largely follows the conventions of LeRobot.