MLSLabsGaussianSplattingRenderer-UE

English | 中文

MLSLabsRenderer-Pro (3D Gaussian Splatting UE5 Plugin)

Official Website: mls4dlive

High-performance 3D Gaussian Splatting and 4D volumetric video Plugin for Unreal Engine 5.

Real-time visualization, Sequencer-driven playback, and a custom non-Niagara rendering pipeline for millions of Gaussians.

Downloads • Tutorial Video • Tutorial Documentation • Docs • Installation • Join Discord • Contributors

Application Cases • Introduction • Features • Project Structure • Roadmap • Lite version • Release Notes • License

---

3DGS & 4DGS Application Cases

• 4DGS Redefines VR Filmmaking

---

Introduction

MLSLabsRenderer-Pro is a high-performance Unreal Engine 5 (UE5) plugin developed by MaLanShan Audio & Video Laboratory. It is engineered for real-time visualization, management, and scalable hybrid rendering of 3D Gaussian Splatting (3DGS) and dynamic Volumetric Video (4DGS).

By utilizing a custom rendering pipeline rather than traditional particle systems, the plugin ensures high frame rates even with millions of Gaussians, effectively bypassing the performance bottlenecks typical of Niagara.

---

Project Structure

📦 MLSLabsGaussianSplattingRenderer-UE
├─ 📁 docs/                  # Plugin guides (EN / CN)
├─ 📁 Media/                 # Documentation images and videos
├─ 📁 Plugins/               # MLSLabsRenderer plugin source
├─ 📁 TestData/              #Test Data
    ├─ 📁 ply/               #ply Data
	    ├─ data_download_link.md               # Test data download link
├─ LICENSE
├─ README.md                 # Main overview file
└─ README_CN.md              # 中文概述

Repository layout

The Plugins folder contains the MLSLabsRenderer plugin source code. The docs folder contains detailed plugin guides.

Quick Links:

• Plugin Guide (EN)
• 插件指南 (中文)

Features

• High-Performance Static 3DGS: High-quality rendering of standard .ply models supporting up to 5M+ Gaussians at 50 FPS+(tested on NVIDIA RTX 4070 Ti).

• Dynamic 4DGS Playback: Real-time volumetric video sequence playback, supporting 100,000+ Gaussians at 100+ FPS (tested on an NVIDIA RTX 4070 Ti).
• Sequencer Integration: Full support for UE Sequencer, with keyframe control over volumetric video playback.
• High-Compression Static 3DGS: Supports the .sog format for high-compression 3DGS.
• Android Support: Renders Gaussians on Android devices, with 250,000+ Gaussians at 60+ FPS (tested on a REDMI K80).
• VR Headset Support: Runs directly on a VR headset, with 250,000+ Gaussians at 30+ FPS (tested on a Pico 4 Ultra Enterprise). PC streaming playback is also supported.

---

Docs

1. Requirements

• Operating System: Windows 10 or 11 (64-bit)
• Unreal Engine: 5.5.x
• Graphics API: DirectX 12 or Vulkan.
• Graphics Card: Requires DirectX 12 (Feature Level 12_2) support with the following series or newer:
  • NVIDIA: GeForce RTX 20 Series and above.
  • AMD: Radeon RX 6000 Series and above.
  • Mobile (Android): Mali-G68/G71/G72/G76/G77/G78/G7xx series, or Adreno 5xx/6xx/7xx series.
• Minimum Hardware: NVIDIA GeForce RTX 2060 / AMD Radeon RX 6600 or equivalent.
• Recommended Hardware: NVIDIA GeForce RTX 4070 Ti or equivalent.

2. Installation

1. Copy the Plugins/MLSLabsRenderer folder into your project's Plugins/ directory.
2. Project packaging: To package the project successfully, copy the MLSLabsRenderer folder into the UE5.5 engine installation directory (for example, Epic Games\UE_5.5\Engine\Plugins\Marketplace).
3. Enable MLSLabsRenderer in the Unreal Editor Plugin Browser.

3. Tutorial Documentation

Quick Links:

• Tutorial Doc (EN)
• Tutorial Doc (Chinese)

4. Blueprint API

Quick Links:

• Blueprint API (EN)
• Blueprint API (Chinese)

---

Roadmap (Pro Version)

The upcoming Professional version will provide a significant performance improvement and enterprise features:

• Advanced Lighting: Support for point lights and directional lights, including self-shadowing.

---

Release Notes

Pro_V2.1.0.0

1. Rendering pipeline upgrade. Full support for Windows, Linux, and Android, with multiple GPU vendors: NVIDIA, AMD, and mobile GPUs.
2. A packaged Android APK can be installed and run directly on a Pico standalone headset. VR mode is supported (the default, command line r.MLSLabs.MixedReality 0) and MR mode (command line r.MLSLabs.MixedReality 1). VR streaming is also supported.
3. Installing the plugin is enough. LibTorch and other third-party libraries no longer need to be downloaded.
4. ply/sog files and ply sequences are supported on every platform.
5. Both Development and Shipping packaging are supported.

Pro_V2.0.0.0_preview

1. Adopted Vulkan Gaussian Splatting rendering, supporting all features from Windows v1.0. The LibTorch dependency is now eliminated—it only requires graphics drivers with Vulkan 1.3 support.

Pro_V1.0.2.10_beta

1. Supports .sog format Gaussian Splatting files..
2. Copy imported PLY data and use relative paths for references to ensure seamless packaging and distribution.
3. Update and calculate the bounding box after loading Gaussian data to ensure the coordinate gizmo displays correctly in the Editor.
4. ensure package, copy ply and sog files successfully for ue5.7.

Lite_V1.0.0.10_beta

1. Fixed an issue where colors appeared abnormal on Scaled Gaussian Splatting nodes.
2. Resolved the "access denied" error when deleting libraries (e.g., cublas64_12.dll) during the packaging process.
3. Fixed incorrect rotation of Gaussian characters when Pitch, Yaw, and Roll operations occur simultaneously.
4. Added support for rendering on non-primary GPUs (ID > 0) for multi-card systems.
5. Copy imported PLY data and use relative paths for references to ensure seamless packaging and distribution.
6. Update and calculate the bounding box after loading Gaussian data to ensure the coordinate gizmo displays correctly in the Editor.

Pro_V1.0.1.10_beta

1. Performance Boost: 120 FPS+ for 4DGS and 60 FPS+ for 5M+ Gaussians static scenes.
2. VR & Binocular Rendering: Native support for high-fidelity VR content.
3. Fixed an issue where colors appeared abnormal on Scaled Gaussian Splatting nodes.
4. Resolved the "access denied" error when deleting libraries (e.g., cublas64_12.dll) during the packaging process.
5. Added logo watermarking; note that paid removal of watermarks is not yet supported.
6. Fixed incorrect rotation of Gaussian characters when Pitch, Yaw, and Roll operations occur simultaneously.
7. Added support for rendering on non-primary GPUs (ID > 0) for multi-card systems.

Lite_V1.0.0.9_beta

1. Fixed blending artifacts caused by depth buffer resolution mismatch between Editor and Play modes.
2. Supports outputting logs to the Unreal Engine log file.

Lite_V1.0.0.8_beta

1. Support PLY files with sh_degree=0.
2. Fix significant frame rate drop and memory exhaustion when entering preview mode for newly added cameras.

Lite_V1.0.0.7_beta

1. Decouple the LibTorch library and prompt users to download it manually upon the first time using the plugin.
2. support ue 5.5,5.6,5.7.

Lite_V1.0.0.6_beta

1. fixed Repeatedly dragging to update the Gaussian Actor's transform causes the engine to crash.

Lite_V1.0.0.5_beta

1. Standard PLY Support (Static): Supports importing standard .ply format static Gaussian Splatting scenes with high-efficiency rendering.
2. Volumetric Video (4DGS): Supports importing standard .ply sequence frames for volumetric video (4DGS) with high-efficiency rendering.
3. Quick Focus: Press the F key to quickly focus on and frame the Gaussian Actor in the viewport.
4. Sequencer Integration: Volumetric Video Actors support keyframe animation and timeline control within the Unreal Engine Sequencer.
5. DirectX 12: Full support for DX12 (DirectX 12) for modern rendering performance.
6. Shipping Support: Supports application packaging and distribution for Shipping builds.

Contributors