项目已并入 Flashlight,后续开发在 Flashlight 的 ASR 应用中;复现结果必须使用 Flashlight <= 0.3.2,构建 recipes 需用 Flashlight 0.3 分支并带 ASR 应用;Flashlight 或 ArrayFire 装在非标准路径时需额外传 -Dflashlight_DIR 与 -DArrayFire_DIR
wav2letter
flashlight活跃维护Facebook AI 开源的端到端语音识别训练工具包,用 C++ 实现,可基于 wav2letter 架构训练声学模型,省去传统 ASR 繁琐的特征工程流程。
Facebook AI Research's Automatic Speech Recognition Toolkit
mkdir build && cd build
cmake .. && make -j8README 未说明显存、CPU 或 GPU 型号要求
Facebook 开源的端到端语音识别工具包,提供可复现论文的 recipes 与预训练模型
Facebook AI 开源的端到端语音识别训练工具包,用 C++ 实现,可基于 wav2letter 架构训练声学模型,省去传统 ASR 繁琐的特征工程流程。
核心能力
- 提供多篇 ASR 论文的可复现 recipes 与预训练模型
- 覆盖流式卷积、半监督、自训练、无词典等方向
- 训练与评测的数据准备脚本集中在 data 目录
- 基于 Flashlight 与 ArrayFire 的 C++ 实现
容易踩的坑
- v0.2v0.2 (pre Flashlight-consolidation)最新正式版2020-12-28 · 2020-12-28 17:17 UTC
This is an old release and is the final release before the wav2letter was consolidated into Flashlight. See the ASR application in Flashlight for the new wav2letter source.
- v0.1Initial Release2018-12-21 · 2018-12-21 21:58 UTC
查看更新说明
See the docs for more details.
Thanks to our contributors:
Vineel Pratap, Awni Hannun, Qiantong Xu, Jacob Kahn, Jeff Cai, Gabriel Synnaeve, Vitaliy Liptchinsky, Ronan Collobert, Ann Lee, Tatiana Likhomanenko and Jay Mahadeokar
用户点评
登录用户的真实使用记录,可按版本和硬件筛选还没有人点评。第一个说出真实体验的人最有价值。
wav2letter++
Important Note:
wav2letter has been moved and consolidated into Flashlight in the ASR application.
Future wav2letter development will occur in Flashlight.
To build the old, pre-consolidation version of wav2letter, checkout the wav2letter v0.2 release, which depends on the old Flashlight v0.2 release. The wav2letter-lua project can be found on the wav2letter-lua branch, accordingly.
For more information on wav2letter++, see or cite this arXiv paper.
Recipes
This repository includes recipes to reproduce the following research papers as well as pre-trained models. All results reproduction must use Flashlight <= 0.3.2 for exact reproducability. Papers contained here include:
- Pratap et al. (2020): Scaling Online Speech Recognition Using ConvNets
- Synnaeve et al. (2020): End-to-end ASR: from Supervised to Semi-Supervised Learning with Modern Architectures
- Kahn et al. (2020): Self-Training for End-to-End Speech Recognition
- Likhomanenko et al. (2019): Who Needs Words? Lexicon-free Speech Recognition
- Hannun et al. (2019): Sequence-to-Sequence Speech Recognition with Time-Depth Separable Convolutions
Data preparation for training and evaluation can be found in data directory.
Building the Recipes
First, install Flashlight (using the 0.3 branch is required) with the ASR application.
mkdir build && cd build
cmake .. && make -j8
If Flashlight or ArrayFire are installed in nonstandard paths via a custom CMAKE_INSTALL_PREFIX, they can be found by passing
-Dflashlight_DIR=[PREFIX]/usr/share/flashlight/cmake/ -DArrayFire_DIR=[PREFIX]/usr/share/ArrayFire/cmake
when running cmake.
Join the wav2letter community
- Facebook page: https://www.facebook.com/groups/717232008481207/
- Google group: https://groups.google.com/forum/#!forum/wav2letter-users
- Contact: [email protected], [email protected], [email protected], [email protected], [email protected], [email protected], [email protected], [email protected], [email protected]
License
wav2letter++ is MIT-licensed, as found in the LICENSE file.