统一管理 GPU 集群，调度 vLLM、SGLang 等推理引擎做高性能模型服务，还能按需开出可 SSH 登录的 GPU 实例。
Mooncake 是支撑 Kimi 大模型服务的推理平台，通过 KVCache 分离式架构和 RDMA 高速传输，把预填充与解码拆开部署，提升长上下文场景下的吞吐和资源利用率。
基于飞桨的 NLP 与大模型开发库，提供丰富模型库，覆盖 BERT、ERNIE、LLaMA 等，支持分布式训练、压缩和文档智能等任务。
Final case CAD for the 2-GPU and 4-GPU builds, plus the Computer 2 kit assembly manual. - 2-GPU case (2x 5090 and 2x RTX PRO 6000 builds): [full-case STEP assembly](https
GPUStack v2.3.0 🚀 Model Catalog Updates LLM: DeepSeek-V4.1-Flash-1017, MiMo-V2.6-Pro-MOPD, GLM-5.3-Flash, Qwen3.8-27B, GLM-5.3, Muse-Glimmer-30B, Kimi-K3. ✨ New Features
OpenTelemetry GPU Collector 1.0.0 Features - Skips write disk metrics for read-only Linux block devices; reporting resumes when devices become writable. Missing or invali
OpenTelemetry GPU Collector 0.0.8 Features - Add environment variable OTEL GPU FS TYPES EXCLUDE to exclude specified filesystem types from system metrics, defaulting to s
…very 30 seconds only while the menu is open. - 🎮 GPU & VRAM Monitoring - Added real-time GPU utilization ( NVIDIA via nvidia-smi , or AMD via sysfs ) to the system monit