用 C/C++ 实现的大模型推理引擎,能在普通 CPU 和消费级显卡上跑 LLaMA 等模型,支持量化以降低显存占用。
OpenAI Whisper 语音识别模型的 C/C++ 移植版,无需 Python 和 GPU 依赖,在普通 CPU 上就能跑语音转文字。
无需分词器的多语言语音合成模型,支持创意音色设计和逼真声音克隆,可直接从文本生成自然语音。
…s://llama.app Attestations: - <https://github.com/ggml-org/llama.cpp/attestations/66042335 macOS/iOS: - [macOS Apple Silicon (arm64)](https://github.com/ggml-org/llama.cp
…oncurrent stream state out of common.cuh ( 32001) ggml cuda graph, ggml cuda concurrent event and ggml cuda stream context are only used by ggml-cuda.cu, but keeping them
<details open ggml-zdnn: accept non-zdnn tensors, invalidate compute tensors after every op ( 31824) Signed-off-by: Aaron Teo <[email protected] </details Website: - <ht
<details open ggml-backend: don't upload inputs that are not read ( 31419) stop uploading inputs nothing reads Address nitpicks </details Website: - <https://llama.app At
…s://llama.app Attestations: - <https://github.com/ggml-org/llama.cpp/attestations/65005103 macOS/iOS: - [macOS Apple Silicon (arm64)](https://github.com/ggml-org/llama.cp
… view limit for buffers with few tensors ( 31447) ggml-backend-meta : minimum number of compute views per buffer Assisted-by: Claude Opus 5.5 tests : revert the deepseek4