视觉语言模型

Fully Open Framework for Democratized Multimodal Training

InternRobotics' open platform for building generalized navigation foundation models.

NEO Series: Native Vision-Language Models from First Principles

RAG Time: A 5-week Learning Journey to Mastering RAG

UniWorld: High-Resolution Semantic Encoders for Unified Visual Understanding and Generation

[CVPR 2024] Alpha-CLIP: A CLIP Model Focusing on Wherever You Want

Official Repository of "LLM × DATA" Survey Paper

An open-weight 11B model series for long-form and real-time video understanding

[CVPR 2026🔥] 🧑‍🎨 OmniLottie, an open-sourced multi-modal instructed vector animation generator that produces Lottie JSONs.

A curated list of awesome prompt/adapter learning methods for vision-language models like CLIP.

An all-in-one VLA engineering platform for embodied AI — from data to real-robot deployment.

[ICLR 2026] The offical Implementation of "Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Model"

Paddle Multimodal Integration and eXploration, supporting mainstream multi-modal tasks, including end-to-end large-scale multi-modal pretrain models and diffusion model toolbox. Equipped with high performance and flexibility.

OmniVinci is an omni-modal LLM for joint understanding of vision, audio, and language.

MiMo-VL

Project Page For "Seg-Zero: Reasoning-Chain Guided Segmentation via Cognitive Reinforcement"

RAI is a vendor agnostic agentic framework for Physical AI robotics, utilizing ROS 2 tools to perform complex actions, defined scenarios, free interface execution, log summaries, voice interaction and more.

🎉 PILOT: A Pre-trained Model-Based Continual Learning Toolbox

Evaluating text-to-image/video/3D models with VQAScore

LLaVA-Mini is a unified large multimodal model (LMM) that can support the understanding of images, high-resolution images, and videos in an efficient manner.

Cambrian-S: Towards Spatial Supersensing in Video

Use the reMarkable2 as an interface to vision-LLMs (ChatGPT, Claude, Gemini). Ghost in the machine!

A hub for various industry-specific schemas to be used with VLMs.

Awesome Multimodal Modeling [Covers MLLM, UMM, and NMM]

🌐 Vision-Language-Action Models for Autonomous Driving: Past, Present, and Future

Scaling in Games: Continued Pre-Training for Embodied Agents in Diverse Virtual Worlds. Weights on Hugging Face.

VLA-0: Building State-of-the-Art VLAs with Zero Modification

[Awesome-Spatial-VLMs] This repository is the official, community-maintained resource for the survey paper: Spatial Intelligence in Vision-Language Models: A Comprehensive Survey;

[CVPR 2025, Spotlight] SimLingo (CarLLava): Vision-Only Closed-Loop Autonomous Driving with Language-Action Alignment

Official repository for VisionZip (CVPR 2025)

🖨️ Self-hosted scanned document processor with AI-powered naming. Receives scans via FTP, SFTP, SCP, SMB or a watched folder, reads them with a local Ollama vision model, gives each file a dated, descriptive name, and delivers it to WebDAV (Nextcloud, ownCloud), an SMB share, or a local folder.

InternVLA-M1: A Spatially Guided Vision-Language-Action Framework for Generalist Robot Policy

[ECCV 2026] Generation Models Know Space: Unleashing Implicit 3D Priors for Scene Understanding

[CVPR 2025 Highlight] Official code for "Olympus: A Universal Task Router for Computer Vision Tasks"

[ECCV 2026] Official repo of "Chain-of-Visual-Thought: Teaching VLMs to See and Think Better with Continuous Visual Tokens"

Official repository for "VideoPrism: A Foundational Visual Encoder for Video Understanding" (ICML 2024)

LightRFT: Light, Efficient, Omni-modal & Reward-model Driven Reinforcement Fine-Tuning Framework

[NeurIPS 2025] NAUTILUS: A Large Multimodal Model for Underwater Scene Understanding

EVE Series: Encoder-Free Vision-Language Models from BAAI

[ICLR 2026 Oral (top 1.2%)] Official implementation of DepthLM

EvoCUA: Evolving Computer Use Agent

[ICLR 2026] VisionReasoner: Unified Reasoning-Integrated Visual Perception via Reinforcement Learning

R1-VL: Learning to Reason with Multimodal Large Language Models via Step-wise Group Relative Policy Optimization

[CVPR 2024] Official PyTorch Code for "PromptKD: Unsupervised Prompt Distillation for Vision-Language Models"

2D to 3D CAD Conversion Using VLM

Reverse-engineered Doubao (豆包) API → OpenAI-compatible REST service. Free multimodal chat, image/video/music generation, and file hosting for AI agents.

Boot your PC straight into an LLM. Rust, UEFI-resident, no operating system underneath.

[CVPR 2026] Machine Mental Imagery: Empower Multimodal Reasoning with Latent Visual Tokens

Seamlessly integrate state-of-the-art transformer models into robotics stacks

CLI for Physical AI Specialization