国产 NPU

17 条

昇腾等国产加速卡的软件栈。

#仓库Stars
1PaddlePaddle/Paddle
PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice (『飞桨』核心框架,深度学习&机器学习高性能单机、分布式训练和跨平台部署)
24k
2gpustack/gpustack
A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.
6.0k
3mindspore-ai/mindspore
MindSpore is a new open source deep learning training/inference framework that could be used for mobile, edge and cloud scenarios.
4.7k
4vllm-project/vllm-ascend
Community maintained hardware plugin for vLLM on Huawei Ascend
3.1k
5data-infra/cube-studio
cubestudio开源云原生一站式机器学习/深度学习/大模型AI平台/MaaS/mlops/人工智能平台/训推平台,算法全链路流程,多租户,算力租赁平台,token中转,拖拉拽任务流pipeline编排,多机多卡分布式训练,超参搜索,推理服务,VGPU虚拟化,云边端协同,边缘计算,自动化标注平台,deepseek等大模型sft微调/奖励模型/强化学习训练,vllm/ollama/mindie大模型多机推理,私有知识库llmops智能体,AI模型市场,支持国产异构算力调度,昇腾/寒武纪/海光/摩尔/沐曦等,支持ib/roce/RDMA,信创支持
2.6k
6ROCm/FastFlowLM
Run LLMs on AMD Ryzen™ AI NPUs in minutes; purpose-built and deeply optimized for the AMD NPUs.
2.0k
7nndeploy/nndeploy
一款简单易用和高性能的AI部署框架 | An Easy-to-Use and High-Performance AI Deployment Framework
1.9k
8microsoft/ai-dev-gallery
An open-source project for Windows developers to learn how to add AI with local models and APIs to Windows apps.
1.5k
9datawhalechina/torch-rechub
A Lighting Pytorch Framework for Recommendation Models, Easy-to-use and Easy-to-extend.
1.2k
10Xilinx/XRT
Run Time for AIE and FPGA based platforms
694
11LSH9832/edgeyolo
an edge-real-time anchor-free object detector with decent performance
531
12oneclickvirt/oneclickvirt
Universal Virtualization Management Platform 可扩展的通用虚拟化管理平台,支持 Proxmox VE / LXD (GPU) / Incus (GPU) / Docker / Podman / Containerd / Qemu / Kubevirt
382
13ModelEngine-Group/unified-cache-management
Persist and reuse KV Cache to speedup your LLM.
355
14AXERA-TECH/ax-samples
Samples code for world class Artificial Intelligence SoCs for computer vision applications.
304
151195343015/nwputhesis
西北工业大学本科毕业设计/硕士博士学位论文 LaTeX 模板 (2026)
303
16Pelochus/ezrknpu
Easy installation and usage of Rockchip's NPUs found in RK3588 and similar SoCs
255
17PSAL-POSTECH/ONNXim
ONNXim is a fast cycle-level simulator that can model multi-core NPUs for DNN inference
221