Human3R

fanegg更新放缓

统一模型,从单目视频中同时重建动态人体与三维场景,输出带时间维度的4D结果,可用于人体姿态估计与场景理解。

[ICLR 2026] An unified model for 4D human-scene reconstruction

暂无版本562star45fork同步于 2026-11-07 07:30 UTC

怎么上手

由 README 提炼,执行前请确认
git clone https://github.com/fanegg/Human3R.git && cd Human3R
conda create -n human3r python=3.11 cmake && conda activate human3r
pip install -r requirements.txt
硬件要求按 README 说明

README 未明确给出显存要求;安装命令使用 pytorch-cuda=12.4,需按本机 CUDA 版本调整,示例以 CUDA_VISIBLE_DEVICES=0 单卡运行,训练宣称单 GPU 一天完成。

下载:源码 zip·GitHub Releases(安装包)本站不镜像安装包

项目说明

由 README 自动翻译提炼

单模型单阶段完成4D人体与场景重建,一天单卡即可训练

统一模型,从单目视频中同时重建动态人体与三维场景,输出带时间维度的4D结果,可用于人体姿态估计与场景理解。

核心能力

  • 用统一模型单阶段推理重建4D人体与场景
  • 支持输入视频或图片文件夹并输出可视化结果
  • 集成TTT3R与RoPE CUDA核加速推理
  • 提供SMPLX人体模型与预训练权重下载脚本
  • 附带评估、模型卡与训练文档

容易踩的坑

需先运行 scripts/fetch_smplx.sh 下载 SMPLX 模型,该脚本会要求注册登录;还需用 huggingface-cli 单独下载 human3r_896L.pth 权重;RoPE 的 CUDA 核需进入 src/croco/models/curope/ 手动编译,且 demo 默认在 8080 端口启动 viser 可视化。

内容由模型根据 README 生成,可能不完整或不准确,以官方文档为准。看原文 README

最近发版

0 个版本

暂无 release 数据(可能没有发版,或尚未同步)。

用户点评

登录用户的真实使用记录,可按版本和硬件筛选
共 0 条

    还没有人点评。第一个说出真实体验的人最有价值。

    README 原文

    未翻译

    arXiv Home Page X Bluesky

    Yue Chen, Xingyu Chen*, Yuxuan Xue, Anpei Chen, Yuliang Xiu†, Gerard Pons-Moll

    https://github.com/user-attachments/assets/47fc7ecf-5235-471c-84b9-ccfeca6d56ea

    Getting Started

    Installation

    1. Clone Human3R.
    git clone https://github.com/fanegg/Human3R.git
    cd Human3R
    
    1. Create the environment.
    conda create -n human3r python=3.11 cmake
    conda activate human3r
    conda install pytorch torchvision pytorch-cuda=12.4 -c pytorch -c nvidia  # use the correct version of cuda for your system
    pip install -r requirements.txt
    # issues with pytorch dataloader, see https://github.com/pytorch/pytorch/issues/99625
    conda install 'llvm-openmp<16'
    # for training logging
    conda install -y gcc_linux-64 gxx_linux-64
    pip install git+https://github.com/nerfstudio-project/gsplat.git
    # for evaluation
    pip install evo
    pip install open3d
    
    1. Compile the cuda kernels for RoPE (as in CroCo v2).
    cd src/croco/models/curope/
    python setup.py build_ext --inplace
    cd ../../../../
    

    Download

    Run the following commands to download all models and checkpoints into the src/ directory. The first command will prompt you to register and log in to access each version of SMPL.

    # SMPLX family models
    bash scripts/fetch_smplx.sh
    
    # Human3R checkpoints
    huggingface-cli download faneggg/human3r human3r_896L.pth --local-dir ./src
    

    Inference Demo

    To run the inference demo, you can use the following command:

    # input can be a folder or a video
    # the following script will run inference with Human3R and visualize the output with viser on port 8080
    CUDA_VISIBLE_DEVICES=0 python demo.py --model_path MODEL_PATH --size 512 \
        --seq_path SEQ_PATH --output_dir OUT_DIR --subsample 1 --use_ttt3r \
        --vis_threshold 2 --downsample_factor 1 --reset_interval 100
    
    # Example:
    # To save the results, append `--save --output_dir tmp` to the command.
    CUDA_VISIBLE_DEVICES=0 python demo.py --model_path src/human3r_896L.pth \
        --size 512 --seq_path examples/GoodMornin1.mp4 \
        --subsample 1 --use_ttt3r --vis_threshold 2 \
        --downsample_factor 1 --reset_interval 100
    
    

    Evaluation

    Please refer to the eval.md for more details.

    Model Cards

    Please refer to the inference.md for using different backbones.

    Training

    Please refer to the train.md for more details.

    Acknowledgements

    Our code is based on the following awesome repositories:

    We thank the authors for releasing their code!

    Citation

    If you find our work useful, please cite:

    @article{chen2025human3r,
        title={Human3R: Everyone Everywhere All at Once},
        author={Chen, Yue and Chen, Xingyu and Xue, Yuxuan and Chen, Anpei and Xiu, Yuliang and Gerard, Pons-Moll},
        journal={arXiv preprint arXiv:2510.06219},
        year={2025}
        }