M2DGR

SJTU-ViSYSMIT活跃维护

面向地面机器人的多模态多场景数据集,包含双目相机、激光雷达、IMU 等传感器数据,用于 SLAM 与定位算法的评测和训练。

M2DGR: a Multi-modal and Multi-scenario Dataset for Ground Robots(RA-L2021 & ICRA2022)

暂无版本1,225star +3 / 7 天131fork同步于 2026-11-10 17:51 UTC

怎么上手

由 README 提炼,执行前请确认
git clone https://github.com/SJTU-ViSYS/M2DGR.git
硬件要求按 README 说明

README未说明运行硬件要求;数据采集平台含32线激光雷达、双GNSS接收机与双IMU等传感器

支持 Apple Silicon
下载:源码 zip·GitHub Releases(安装包)本站不镜像安装包

项目说明

由 README 自动翻译提炼

面向地面机器人的多模态多场景SLAM数据集,含36条室内外序列与标定工具

面向地面机器人的多模态多场景数据集,包含双目相机、激光雷达、IMU 等传感器数据,用于 SLAM 与定位算法的评测和训练。

核心能力

  • 提供六鱼眼、红外、事件相机与32线激光雷达等多传感器同步数据
  • 覆盖电梯、全黑等易使现有定位方案失效的挑战场景
  • 提供真值轨迹,来自动捕、激光3D跟踪仪与RTK接收机
  • 附带图像提取、评测、标定与RINEX文件获取工具包
  • 已有多套SOTA SLAM系统的配置文件可供参考

容易踩的坑

数据集约1TB,需从外部链接单独下载,不在仓库内;使用前需按README中的配置文件和工具包自行完成图像提取与标定;评测依赖ROS环境及各SLAM系统的独立安装

内容由模型根据 README 生成,可能不完整或不准确,以官方文档为准。看原文 README

最近发版

0 个版本

暂无 release 数据(可能没有发版,或尚未同步)。

用户点评

登录用户的真实使用记录,可按版本和硬件筛选
共 0 条

    还没有人点评。第一个说出真实体验的人最有价值。

    README 原文

    未翻译

    [RA-L & ICRA2022]M2DGR: a Multi-modal and Multi-scenario SLAM Dataset for Ground Robots

    💎 First Author: Jie Yin 殷杰   📝 [Paper]   ➡️ [Dataset Extension]   ⭐️[Presentation Video]   🔥[News]

    Author Paper Preprint Dataset License Video News

    stars forks open issues issue resolution

    🎯 Notice

    We strongly recommend that the newly proposed SLAM algorithm be tested on our M2DGR / M2DGR-plus /M3DGR/ Ground-Challenge benchmark, because our data has following features:

    1. Rich sensory information including vision, lidar, IMU, GNSS,event, thermal-infrared images and so on
    2. Various scenarios in real-world environments including lifts, streets, rooms, halls and so on.
    3. Our dataset brings great challenge to existing cutting-edge SLAM algorithms including LIO-SAM and ORB-SLAM3. If your proposed algorihm outperforms these SOTA systems on our benchmark, your paper will be much more convincing and valuable.
    4. 🔥 Extensive excellent open-source projects have been built or evaluated on M2DGR/M2DGR-plus so far, for examples, Ground-Fusion, LVI-SAM-Easyused, SI-LIO, MM-LINS, Log-LIO, LIGO, Swarm-SLAM, VoxelMap++, GRIL-Cali, LINK3d, i-Octree, LIO-EKF, Fast-LIO ROS2, HC-LIO, LIO-RF, PIN-SLAM, LOG-LIO2, Section-LIO, I2EKF-LO, Liloc, BMBL, Light-LOAM, faster_lio_localization, Fast-LIVO2, D-Li-Init and so on!

    Table of Contents

    1. 🚩 News & Updates
    2. Introduction
    3. License
    4. Sensor Setup
    5. ⭐️ Dataset Sequences
    6. 📁 Repository Layout
    7. 📝 Configuration Files
    8. Development Toolkits
    9. Star History
    10. Acknowledgement

    [!TIP] Check the table of contents above for a quick overview. And check the below news for lateset updates, especially the list of projects based on M2DGR.

    News & Updates

    • 🔥2026/06/14: We are excited to release a preview version of Ultra-Fusion system,which unifies WIO, VIO, LIO, and LVIO in one configurable optimization framework, with optional wheel/GNSS fusion and online calibration.

    • 2026/03/22: We are excited to see that M2DGR continues to inspire a growing body of follow-up works. To facilitate tracking the latest developments, we provide a time-sorted list of papers citing M2DGR: Latest Works Citing M2DGR.

    • 🔥2025/06/16: Introducing our new paper on IROS2025:"Towards Robust Sensor-Fusion Ground SLAM: A Comprehensive Benchmark and A Resilient Framework" is accepted to IROS2025!. code: Ground-Fusion++, dataset: M3DGR!

    • 🏆 2025/01/08 M2DGR is awarded ESI HIGHLY CITED PAPER (TOP 1%)!

    • 2024/10/11: Introducing M2DGR-benchmark, benchmarking newest SOTA LiDAR-visual SLAM alrogithms on both M2DGR and M2DGR-plus!

    • 2024/07/15: Introducing a list of LiDAR-Visual SLAM systems at awesome-LiDAR-Visual-SLAM, wheel-based SLAM systems at awesome-wheel-slam, and Isaac Sim resources at awesome-isaac-sim (keep updating)

    • ⭐️2024/03/05: A quantity of cutting-edge SLAM systems have been tested on M2DGR by lovely users. Here are the configuration files for ORB-SLAM2, ORB-SLAM3, VINS-Mono,DM-VIO, A-LOAM, Lego-LOAM, LIO-SAM, LVI-SAM, LINS, FastLIO2,Fast-LIVO, Faster-LIO and hdl_graph_slam. Welcome to test! If you have more configuration files, please contact me and I will post it on this website ~

    • 🚀 2024/02/22: New paper has been accepted by ICRA2024! The dataset is M2DGR-plus and Ground-Challenge. And the algorithm code is Ground-Fusion. The preprint paper is here.

    • ⭐️2022/06/20: Thanks Jialin Liu (Fudan University) for his work to test LVI-SAM on M2DGR. Check out Here for a [modified LVI-SAM version] for M2DGR.

    • ⭐️2022/02/18: We have upload a brand new SLAM dataset with GNSS, vision and IMU information. Here is our link SJTU-GVI. Different from M2DGR, new data is captured on a real car and it records GNSS raw measurements with a Ublox ZED-F9P device to facilitate GNSS-SLAM. Give us a star and folk the project if you like it.

    • 📄 2022/02/01: The paper has been accepted by both RA-L and ICRA 2022. The paper is provided in Arxiv version and IEEE RA-L version.

    [!NOTE] If you build your open-source project based on M2DGR or test a cutting-edge SLAM system on M2DGR, please write a issue to remind me of updating your contributions.

    INTRODUCTION

    ABSTRACT:

    We introduce M2DGR: a novel large-scale dataset collected by a ground robot with a full sensor-suite including six fish-eye and one sky-pointing RGB cameras, an infrared camera, an event camera, a Visual-Inertial Sensor (VI-sensor), an inertial measurement unit (IMU), a LiDAR, a consumer-grade Global Navigation Satellite System (GNSS) receiver and a GNSS-IMU navigation system with real-time kinematic (RTK) signals. All those sensors were well-calibrated and synchronized, and their data were recorded simultaneously. The ground truth trajectories were obtained by the motion capture device, a laser 3D tracker, and an RTK receiver. The dataset comprises 36 sequences (about 1TB) captured in diverse scenarios including both indoor and outdoor environments. We evaluate state-of-the-art SLAM algorithms on M2DGR. Results show that existing solutions perform poorly in some scenarios. For the benefit of the research community, we make the dataset and tools public.

    Keywords:Dataset, Multi-model, Multi-scenario,Ground Robot

    MAIN CONTRIBUTIONS:

    • We collected long-term challenging sequences for ground robots both indoors and outdoors with a complete sensor suite, which includes six surround-view fish-eye cameras, a sky-pointing fish-eye camera, a perspective color camera, an event camera, an infrared camera, a 32-beam LIDAR, two GNSS receivers, and two IMUs. To our knowledge, this is the first SLAM dataset focusing on ground robot navigation with such rich sensory information.
    • We recorded trajectories in a few challenging scenarios like lifts, complete darkness, which can easily fail existing localization solutions. These situations are commonly faced in ground robot applications, while they are seldom discussed in previous datasets.
    • We launched a comprehensive benchmark for ground robot navigation. On this benchmark, we evaluated existing state-of-the-art SLAM algorithms of various designs and analyzed their characteristics and defects individually.

    VIDEO

    ICRA2022 Presentation

    For Chinese users, try bilibili

    LICENSE

    This work is licensed under MIT license. International License and is provided for academic purpose. If you are interested in our project for commercial purposes, please contact us on [email protected] for further communication.

    If you face any problem when using this dataset, feel free to propose an issue. And if you find our dataset helpful in your research, simply give this project a star. If you use M2DGR in an academic work, please cite:

    @article{yin2021m2dgr,
      title={M2dgr: A multi-sensor and multi-scenario slam dataset for ground robots},
      author={Yin, Jie and Li, Ang and Li, Tao and Yu, Wenxian and Zou, Danping},
      journal={IEEE Robotics and Automation Letters},
      volume={7},
      number={2},
      pages={2266--2273},
      year={2021},
      publisher={IEEE}
    }
    @article{yin2024ground,
      title={Ground-Fusion: A Low-cost Ground SLAM System Robust to Corner Cases},
      author={Yin, Jie and Li, Ang and Xi, Wei and Yu, Wenxian and Zou, Danping},
      journal={arXiv preprint arXiv:2402.14308},
      year={2024}
    }
    

    SENSOR SETUP

    Acquisition Platform

    Physical drawings and schematics of the ground robot is given below. The unit of the figures is centimeter.

    Sensor parameters

    All the sensors and track devices and their most important parameters are listed as below:

    • LIDAR Velodyne VLP-32C, 360 Horizontal Field of View (FOV),-30 to +10 vertical FOV,10Hz,Max Range 200 m,Range Resolution 3 cm, Horizontal Angular Resolution 0.2°.

    • RGB Camera FLIR Pointgrey CM3-U3-13Y3C-CS,fish-eye lens,1280*1024,190 HFOV,190 V-FOV, 15 Hz

    • GNSS Ublox M8T, GPS/BeiDou, 1Hz

    • Infrared Camera,PLUG 617,640*512,90.2 H-FOV,70.6 V-FOV,25Hz;

    • V-I Sensor,Realsense d435i,RGB/Depth 640*480,69H-FOV,42.5V-FOV,15Hz;IMU 6-axix, 200Hz

    • Event Camera Inivation DVXplorer, 640*480,15Hz;

    • IMU,Handsfree A9,9-axis,150Hz;

    • GNSS-IMU Xsens Mti 680G. GNSS-RTK,localization precision 2cm,100Hz;IMU 9-axis,100 Hz;

    • Laser Scanner Leica MS60, localization 1mm+1.5ppm

    • Motion-capture System Vicon Vero 2.2, localization accuracy 1mm, 50 Hz;

    The rostopics of our rosbag sequences are listed as follows:

    • LIDAR: /velodyne_points

    • RGB Camera: /camera/left/image_raw/compressed ,
      /camera/right/image_raw/compressed ,
      /camera/third/image_raw/compressed ,
      /camera/fourth/image_raw/compressed ,
      /camera/fifth/image_raw/compressed ,
      /camera/sixth/image_raw/compressed ,
      /camera/head/image_raw/compressed

    • GNSS Ublox M8T:
      /ublox/aidalm ,
      /ublox/aideph ,
      /ublox/fix ,
      /ublox/fix_velocity ,
      /ublox/monhw ,
      /ublox/navclock ,
      /ublox/navpvt ,
      /ublox/navsat ,
      /ublox/navstatus ,
      /ublox/rxmraw

    • Infrared Camera:/thermal_image_raw

    • V-I Sensor:
      /camera/color/image_raw/compressed ,
      /camera/imu

    • Event Camera:
      /dvs/events,
      /dvs_rendering/compressed

    • IMU: /handsfree/imu

    DATASET SEQUENCES

    We make public ALL THE SEQUENCES with their GT now.

    OneDrive folder: Browse all rosbags | GT (GitHub): Download GT

    Individual download links below point to specific .bag files.

    [!NOTE] Download update (Oct 2025): Rosbags are being migrated to a new OneDrive account (~1.2 TB, actively uploading). Browse all sequences on OneDrive, or use per-sequence links below. Ground truth is available on GitHub now. Sequences marked Uploading will get direct download links as uploads finish (typically within 1–2 weeks). This dataset is actively maintained — links are updated continuously.

    An overview of M2DGR is given in the table below:

    ScenarioStreetCircleGateWalkHallDoorLiftRoomRoomdarkTOTAL
    Number102315243636
    Size/GB590.750.665.921.5117.446.0112.145.3171.11220.6
    Duration/s79584787822911226588122427586613688
    Dist/m7727.72618.03248.40263.17845.15200.14266.27144.13395.6610708.67
    Ground TruthRTK/INSRTK/INSRTK/INSRTK/INSLeicaLeicaLeicaMocapMocap---

    Outdoors

    Sequence NameCollection DateTotal SizeDurationFeaturesRosbagGT
    gate_012021-07-3116.4g172sdark,around gateRosbagGT
    gate_022021-07-3127.3g327sdark,loop backRosbagGT
    gate_032021-08-0421.9g283sdayRosbagGT
    Sequence NameCollection DateTotal SizeDurationFeaturesRosbagGT
    Circle_012021-08-0323.3g234sCircleRosbagGT
    Circle_022021-08-0727.3g244sCircleRosbagGT
    Sequence NameCollection DateTotal SizeDurationFeaturesRosbagGT
    street_012021-08-0675.8g1028sstreet and buildings,night,zigzag,long-termRosbagGT
    street_022021-08-0383.2g1227sday,long-termRosbagGT
    street_032021-08-0621.3g354snight,back and fourth,full speedRosbagGT
    street_042021-08-0348.7g858snight,around lawn,loop backRosbagGT
    street_052021-08-0427.4g469snight,staight lineRosbagGT
    street_062021-08-0435.0g494snight,one turnRosbagGT
    street_072021-08-0677.2g929sdawn,zigzag,sharp turnsRosbagGT
    street_082021-08-0631.2g491snight,loop back,zigzagRosbagGT
    street_092021-08-0783.2g907sday,zigzagRosbagGT
    street_0102021-08-0786.2g910sday,zigzagRosbagGT
    walk_012021-08-0421.5g291sday,back and fourthRosbagGT

    Indoors

    Sequence NameCollection DateTotal SizeDurationFeaturesRosbagGT
    lift_012021-08-0418.4g225sliftRosbagGT
    lift_022021-08-0443.6g488sliftRosbagGT
    lift_032021-08-1522.3g252sliftRosbagGT
    lift_042021-08-1527.8g299sliftRosbagGT
    Sequence NameCollection DateTotal SizeDurationFeaturesRosbagGT
    hall_012021-08-0129.1g351srandon walkRosbagGT
    hall_022021-08-0815.0g128srandon walkRosbagGT
    hall_032021-08-0820.5g164srandon walkRosbagGT
    hall_042021-08-1517.7g181srandon walkRosbagGT
    hall_052021-08-1535.1g402scircleRosbagGT
    Sequence NameCollection DateTotal SizeDurationFeaturesRosbagGT
    room_012021-07-3014.0g72sroom,brightRosbagGT
    room_022021-07-3015.2g75sroom,brightRosbagGT
    room_032021-07-3026.1g128sroom,brightRosbagGT
    room_dark_012021-07-3020.2g111sroom,darkRosbagGT
    room_dark_022021-07-3030.3g165sroom,darkRosbagGT
    room_dark_032021-07-3022.7g116sroom,darkRosbagGT
    room_dark_042021-08-1529.3g143sroom,darkRosbagGT
    room_dark_052021-08-1533.0g159sroom,darkRosbagGT
    room_dark_062021-08-1535.6g172sroom,darkRosbagGT

    Alternative indoors and outdoors

    Sequence NameCollection DateTotal SizeDurationFeaturesRosbagGT
    door_012021-08-0435.5g461soutdoor to indoor to outdoor,long-termRosbagGT
    door_022021-08-0410.5g127soutdoor to indoor,short-termRosbagGT

    Repository Layout

    PathDescription
    GT/Ground-truth trajectories (TUM format) for all 36 sequences
    config/Example SLAM launch and parameter files for M2DGR sensors
    calib/Sensor calibration results
    docs/Paper PDF, figures (docs/images/), and presentation thumbnail

    CONFIGURATION FILES

    Example launch/parameter files shipped with this repo: config/module_sam.launch, config/my_params_camera.yaml, config/my_params_lidar.yaml.

    For convenience of evaluation, we also link configuration files of some well-known SLAM systems as below:

    A-LOAM, LeGO-LOAM, LINS, LIO-SAM, VINS-MONO, ORB-Pinhole, ORB-Fisheye, ORB-Thermal, and CUBMAPSLAM.

    Furthermore, a quantity of cutting-edge SLAM systems have been tested on M2DGR by lovely users. Here are the configuration files for ORB-SLAM2, ORB-SLAM3, VINS-Mono,DM-VIO, A-LOAM, Lego-LOAM, LIO-SAM, LVI-SAM, LINS, FastLIO2, Fast-LIVO, Faster-LIO and hdl_graph_slam. Welcome to test! If you have more configuration files, please contact me and I will post it on this website ~

    Development Toolkits

    Extracting Images

    • For rosbag users, first make image view
    roscd image_view
    rosmake image_view
    sudo apt-get install mjpegtools
    

    open a terminal,type roscore.And then open another,type

    rosrun image_transport republish compressed in:=/camera/color/image_raw raw out:=/camera/color/image_raw respawn="true"
    

    Evaluation

    We use open-source tool evo for evalutation. To install evo,type

    pip install evo --upgrade --no-binary evo
    

    To evaluate monocular visual SLAM,type

    evo_ape tum street_07.txt your_result.txt -vaps
    

    To evaluate LIDAR SLAM,type

    evo_ape tum street_07.txt your_result.txt -vap
    

    To test GNSS based methods,type

    evo_ape tum street_07.txt your_result.txt -vp
    

    Calibration

    Calibration results for this dataset are provided in calib/calibration_results.txt.

    For camera intrinsics,visit Ocamcalib for omnidirectional model. visit Vins-Fusion for pinhole and MEI model. use Opencv for Kannala Brandt model

    For IMU intrinsics,visit Imu_utils

    For extrinsics between cameras and IMU,visit Kalibr For extrinsics between Lidar and IMU,visit Lidar_IMU_Calib For extrinsics between cameras and Lidar, visit Autoware

    Getting RINEX files

    For GNSS based methods like RTKLIB, we usually need to get data in the format of RINEX. To make use of GNSS raw measurements, we use Link toolkit.

    ROS drivers for UVC cameras

    We write a ROS driver for UVC cameras to record our thermal-infrared image. UVC ROS driver

    Star History

    Star History Chart

    ACKNOWLEGEMENT

    This work is supported by NSFC(62073214). Authors from SJTU hereby express our appreciation.