用 PyTorch 逐行复现 60 多篇深度学习经典论文,代码旁配注释讲解,涵盖 Transformer、优化器、GAN、强化学习等,适合边读论文边对照实现学习。
基于飞桨的 NLP 与大模型开发库,提供丰富模型库,覆盖 BERT、ERNIE、LLaMA 等,支持分布式训练、压缩和文档智能等任务。
基于 CTranslate2 重实现的 Whisper 语音转文字推理引擎,通过量化与高效推理大幅提速并降低显存占用,适合本地部署转录。
在 Android 手机上本地跑 NLLB 模型的实时翻译 App,支持蓝牙耳机对话翻译,全程离线不联网也能用。
…/<repo ") look for a local file. Changed - TFLite INT8 export quantizes once instead of twice. onnx2tf -oiqt builds the integer model twice — float32 I/O, then int8 I/O —
int8 .focrq weights for franken ocr's second model, Baidu Unlimited-OCR-2 (MIT). Recipe unlimited-ocr-2-ffn-int8-attn-bf16-lmhead-bf16-v1 , converted from HF baidu/Unlimi
v2.7 makes the INT8 LM Head patch apply to vLLM 0.27.x and documents what the optimizations measure there. The default build path, dependency set, and performance profile
…rget. Recipe unlimited-ocr-wasm-experts-int4-attn-int8-lmhead-int8-v1 (MoE experts int4 g16/g32 with importance-weighted clip search + AWQ down proj fold over 13-page cal
…tConfig Int4WeightOnlyConfig IntxWeightOnlyConfig Int8DynamicActivationIntxWeightConfig Int8WeightOnlyConfig Int8DynamicActivationInt8WeightConfig and will continue to ad
…ectral correlation 0.999 against fp32 kokoro-v1.0.int8.onnx 114 MB spectral correlation 0.916 against fp32 kokoro-v1.1-zh.onnx 326 MB Chinese and English, full precision