分布式训练

19 条

张量并行、流水并行、ZeRO、通信优化。

#仓库Stars
1mudler/LocalAI
LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.
50k
2milvus-io/milvus
Milvus is a high-performance, cloud-native vector database built for scalable vector ANN search
47k
3deepspeedai/DeepSpeed
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
43k
4hpcaitech/ColossalAI
Making large AI models cheaper, faster and more accessible
41k
5dgraph-io/dgraph
high-performance graph database for real-time use cases
22k
6horovod/horovod
Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.
15k
7Orchestra-Research/AI-Research-SKILLs
Comprehensive open-source library of AI research and engineering skills for any AI model. Package the skills and your claude code/codex/gemini agent will be an AI research agent with full horsepower. Maintained by Orchestra Research.
14k
8vesoft-inc/nebula
A distributed, fast open-source graph database featuring horizontal scalability and high availability
12k
9huggingface/accelerate
🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (including fp8), and easy-to-configure FSDP and DeepSpeed support
9.9k
10deepspeedai/DeepSpeedExamples
Example models using DeepSpeed
6.8k
11higgsfield-ai/higgsfield
Fault-tolerant, highly scalable GPU orchestration, and a machine learning framework designed for training models with billions to trillions of parameters
6.3k
12Eventual-Inc/Daft
High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale
5.8k
13crate/crate
CrateDB is a distributed and scalable SQL database for storing and analyzing massive amounts of data in near real-time, even with complex queries. It is PostgreSQL-compatible, and based on Lucene.
4.5k
14meshbird/meshbird
Distributed private networking
3.5k
15kubeflow/trainer
Distributed AI Model Training and LLM Fine-Tuning on Kubernetes
2.3k
16ArcadeData/arcadedb
ArcadeDB Multi-Model Database, one DBMS that supports SQL, Cypher, Gremlin, HTTP/JSON, MongoDB and Redis. ArcadeDB is a conceptual fork of OrientDB, the first Multi-Model DBMS. ArcadeDB supports Vector Embeddings.
1.2k
17bacalhau-project/bacalhau
Community-driven, simple, yet powerful framework for fast, cost-effective distributed Compute over Data.
876
18WeAreFarmGeek/diplomat
A HTTP Ruby API for Consul
371
19autonomous-ai/autonomous-grid
Your AI intranet: network the computers you already own for inference and training.
276