各示例需按对应子目录内的说明单独安装依赖;推理示例依赖 DeepSpeed-MII 等额外组件,需另行安装;README 未给出统一安装命令,直接运行根目录无入口
git clone https://github.com/deepspeedai/DeepSpeedExamples.gitREADME 未说明
DeepSpeed 官方示例仓库,提供训练、推理、压缩与基准测试的可运行样例
DeepSpeed 官方示例集,提供各类模型接入 DeepSpeed 分布式训练的现成代码,方便照着改自己的训练脚本。
核心能力
- 按应用、训练、推理、压缩、基准测试分目录组织示例
- 提供 DeepSpeed-MII 与 FastGen 的推理上手说明
- 包含 HuggingFace 模型接入 DeepSpeed 推理的示例
- 收录使用 DeepSpeed 库的全部基准测试脚本
容易踩的坑
暂无 release 数据(可能没有发版,或尚未同步)。
用户点评
登录用户的真实使用记录,可按版本和硬件筛选还没有人点评。第一个说出真实体验的人最有价值。
DeepSpeed Examples
This repository contains various examples including training, inference, compression, benchmarks, and applications that use DeepSpeed.
1. Applications
This folder contains end-to-end applications that use DeepSpeed to train and use cutting-edge models.
2. Training
There are several training and finetuning examples so please see the individual folders for specific instructions.
3. Inference
- The DeepSpeed-MII inference README explains how to get started with running model inference with DeepSpeed-MII and DeepSpeed-FastGen.
- The DeepSpeed Huggingface inference README explains how to get started with running DeepSpeed Huggingface inference examples.
4. Compression
Model compression examples.
5. Benchmarks
All benchmarks that use the DeepSpeed library are maintained in this folder.
Build Pipeline Status
| Description | Status |
|---|---|
| Integrations |
Contributing
This project welcomes contributions and suggestions. Most contributions require you to agree to a Contributor License Agreement (CLA) declaring that you have the right to, and actually do, grant us the rights to use your contribution. For details, visit https://cla.opensource.microsoft.com.
When you submit a pull request, a CLA bot will automatically determine whether you need to provide a CLA and decorate the PR appropriately (e.g., status check, comment). Simply follow the instructions provided by the bot. You will only need to do this once across all repos using our CLA.
This project has adopted the Microsoft Open Source Code of Conduct. For more information see the Code of Conduct FAQ or contact [email protected] with any additional questions or comments.