分布式训练
19 条张量并行、流水并行、ZeRO、通信优化。
| # | 仓库 | 分类 | Stars | 最近推送 |
|---|---|---|---|---|
| 1 | mudler/LocalAI LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required. | 分布式训练 | 50k | 2026-11-10 01:47 UTC |
| 2 | milvus-io/milvus Milvus is a high-performance, cloud-native vector database built for scalable vector ANN search | 向量数据库 | 47k | 2026-11-10 04:06 UTC |
| 3 | deepspeedai/DeepSpeed DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective. | 分布式训练 | 43k | 2026-11-10 01:13 UTC |
| 4 | hpcaitech/ColossalAI Making large AI models cheaper, faster and more accessible | 分布式训练 | 41k | 2026-11-10 04:53 UTC |
| 5 | dgraph-io/dgraph high-performance graph database for real-time use cases | 分布式训练 | 22k | 2026-11-05 23:30 UTC |
| 6 | horovod/horovod Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet. | 分布式训练 | 15k | 2026-09-17 09:15 UTC |
| 7 | Orchestra-Research/AI-Research-SKILLs Comprehensive open-source library of AI research and engineering skills for any AI model. Package the skills and your claude code/codex/gemini agent will be an AI research agent with full horsepower. Maintained by Orchestra Research. | 分布式训练 | 14k | 2026-10-11 02:56 UTC |
| 8 | vesoft-inc/nebula A distributed, fast open-source graph database featuring horizontal scalability and high availability | 分布式训练 | 12k | 2026-09-08 06:42 UTC |
| 9 | huggingface/accelerate 🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (including fp8), and easy-to-configure FSDP and DeepSpeed support | 分布式训练 | 9.9k | 2026-11-09 20:43 UTC |
| 10 | deepspeedai/DeepSpeedExamples Example models using DeepSpeed | 分布式训练 | 6.8k | 2026-11-09 23:48 UTC |
| 11 | higgsfield-ai/higgsfield Fault-tolerant, highly scalable GPU orchestration, and a machine learning framework designed for training models with billions to trillions of parameters | 分布式训练 | 6.3k | 2026-10-26 23:17 UTC |
| 12 | Eventual-Inc/Daft High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale | 分布式训练 | 5.8k | 2026-11-09 05:24 UTC |
| 13 | crate/crate CrateDB is a distributed and scalable SQL database for storing and analyzing massive amounts of data in near real-time, even with complex queries. It is PostgreSQL-compatible, and based on Lucene. | 分布式训练 | 4.5k | 2026-11-09 21:56 UTC |
| 14 | meshbird/meshbird Distributed private networking | 分布式训练 | 3.5k | 2026-03-04 03:03 UTC |
| 15 | kubeflow/trainer Distributed AI Model Training and LLM Fine-Tuning on Kubernetes | 分布式训练 | 2.3k | 2026-11-09 23:35 UTC |
| 16 | ArcadeData/arcadedb ArcadeDB Multi-Model Database, one DBMS that supports SQL, Cypher, Gremlin, HTTP/JSON, MongoDB and Redis. ArcadeDB is a conceptual fork of OrientDB, the first Multi-Model DBMS. ArcadeDB supports Vector Embeddings. | 分布式训练 | 1.2k | 2026-11-10 05:11 UTC |
| 17 | bacalhau-project/bacalhau Community-driven, simple, yet powerful framework for fast, cost-effective distributed Compute over Data. | 分析 / BI | 876 | 2026-11-08 08:21 UTC |
| 18 | WeAreFarmGeek/diplomat A HTTP Ruby API for Consul | API 开发与调试 | 371 | 2026-03-08 00:35 UTC |
| 19 | autonomous-ai/autonomous-grid Your AI intranet: network the computers you already own for inference and training. | 分布式训练 | 276 | 2026-11-10 06:03 UTC |