MiniCPM-V 是面壁智能开源的多模态视觉语言模型，能在手机、PC 等本地设备上完成看图、听音和对话交互，无需依赖云端。
面向大语言模型的高吞吐、低显存推理与服务引擎，通过 PagedAttention 等优化显著提升并发吞吐并降低显存占用，适合部署在线推理服务。
一站式大模型训练框架，支持 600+ 纯文本大模型和 300+ 多模态大模型的 CPT、SFT、DPO、GRPO 等训练，可用 LoRA 等 PEFT 方式或全参数微调。
一套系统的大语言模型入门课程，用学习路线图和可直接运行的 Colab 笔记本，带你从零掌握 LLM 的原理与实战。
…-GPU runs actually use it. - Checkpointing: Added gptqmodel.reshard() for per-layer safetensors sharding with one global shard, byte-for-byte tensor copies, preserved met
…0) launch tables to every tuned Triton pipeline — GPTQ GEMV/GEMM/dequant, ParoQuant GEMM, AWQ GEMM/GEMV, GGUF Triton, and bitsandbytes 4-bit — enforced by a hardware-free
…(previously ~9s and 6767 modules). Vectorized the GPTQ/QQQ MSE shrink-grid and AWQ clip-grid evaluation; grid workspace budgets moved from environment variables to a new
…VX512-BF16 int4 qzero group scaled cpu kernel for GPTQ/AWQ group sizes 16/32/64/128/256/512 and prioritized it ahead of ATen when supported. Added packed/low-precision CP
…y @ZX-ModelCloud in https://github.com/ModelCloud/GPTQModel/pull/3085 Fix Qwen3.5-MoE multimodal calibration routing by @ZX-ModelCloud in https://github.com/ModelCloud/GP
…huggingface/optimum/pull/2384 Fully deprecate AutoGPTQ for GPT-QModel by @ZX-ModelCloud in https://github.com/huggingface/optimum/pull/2385 Transformers v5 pre release su