模型需先用 lemonade pull 或 Model Manager 下载后才能运行;不同后端有各自的硬件与系统限制,可先用 lemonade backends 查看本机可用后端;云厂商路由(Cloud Offload)目前为实验性功能。
lemonade
lemonade-sdkApache-2.0活跃维护在本地 GPU 和 NPU 上直接跑优化后的大模型,帮用户发现并启动本地 AI 应用,省去自己折腾推理环境的麻烦。
Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk
lemonade run Gemma-4-E2B-it-GGUFREADME 未给出具体显存要求。支持 CPU(x86_64、ARM64)、NVIDIA Turing 及更新 GPU(CUDA)、AMD GPU(ROCm、Vulkan)、Apple Silicon GPU(Metal),并对 AMD Ryzen AI、Radeon、Strix Halo 做了优化。
本地 AI 服务器,用 OpenAI、Anthropic、Ollama 兼容接口在自己 GPU 和 NPU 上跑优化后的模型
在本地 GPU 和 NPU 上直接跑优化后的大模型,帮用户发现并启动本地 AI 应用,省去自己折腾推理环境的麻烦。
核心能力
- 用标准 OpenAI、Anthropic、Ollama API 接入数百款应用
- 内置 Model Manager 浏览并下载 GGUF、FLM、ONNX 模型
- 支持 chat、图像生成、语音生成与转录多模态
- 按硬件自动选择 llamacpp 的 cuda、rocm、vulkan、metal 等后端
- 提供可嵌入二进制,打包进自己的应用并自动适配用户 PC
容易踩的坑
- pr-3930PR 3930 release candidate (ffd40a2)pre-release2026-11-08 · 2026-11-08 20:09 UTC
查看更新说明
Release candidate of PR 3930 (Lemonade Nexus) from branch commit
ffd40a2, built by CI run 42558423737, with the Nexus SDK at lemonade-nexus229726d.This is a pre-release for testing the PR. It is not a Lemonade release.
New in this build:
- The device advertises its LAN addresses fastest link first and one per subnet, so peers try a 25 Gbit link before a 1 Gbit link and both before Wi-Fi.
- Together with Nexus server release v2026.11.09, two devices on one LAN whose sessions sit on different Tier 1 servers now see each other's LAN addresses and connect directly instead of through a relay.
From the previous builds: host-grouped chat model picker with Loaded/Downloaded marks, a mesh peer's load request keeps a loaded model, "Chat runs on" in the account menu, the server info dialog, the mesh port keeps its certificate across restarts, and Enable Mesh accepts the device's current account after a deletion or key replacement.
- candidate-v2026.46.1v2026.46.1 (release candidate)pre-release2026-11-05 · 2026-11-05 02:33 UTC
查看更新说明
Headline
⚠️ These notes are AI generated and will be revised by a human ⚠️
- Benchmark results can be submitted directly from
lemonade benchand shared via claim link at https://bench.lemonade-server.ai. - Zero-shot classification is available via
POST /v1/classifywith alabelsparameter, and as azero_shotcondition type in router policies. - TheNoise image generation gains a CUDA backend for Linux x86_64 alongside existing ROCm support.
- New container backends for AMD Strix Halo (gfx1151) — including
ds4:rocm,rocmfpx:rocm,gufo:rocm, andllamacpp:halobox— bring GPU-accelerated inference to the platform. POST /v1/systemoneforwards typed questions to a decision model, with support for router-classified choices and SystemOne zero-shot classification.
Breaking Changes
⚠️ These notes are AI generated and will be revised by a human ⚠️
- The
/modelsAPI response no longer includesimage_defaultsoraudio_defaults; their values are now underrecipe_options, so external clients reading the old fields will find them absent. - The
/modelsresponse includes auser_configurableboolean flag on backend descriptor options; consumers that assumed all listed options are editable may show technical knobs likesoft_pixel_cap,pcm_sample_rate, andpcm_channelsto users. - FLM v1.0.11 (bumped from v1.0.7) returns
max_tokensexactly as requested rather thanmax_tokens+1, so chat completions that relied on the extra token will now stop one token early. - FLM v1.0.11 streams token usage counts only when
stream_options.include_usageis set; without it the server's/api/v1/statsendpoint records no token counts or throughput for FLM streams. - FLM v1.0.11 returns 400 for previously-accepted invalid fields including invalid
tool_choice, forced tool calls on small Qwen3 models (up to 1.7B), conversation history on *-flash models, and requests with no messages or prompt.
Lemonade Server
Operating System Downloads Windows lemonade.msi Ubuntu 24.04+ Launchpad PPA Debian 13 (x86_64) lemonade-server_2026.46.1-debian13_amd64.deb Debian 13 (ARM64) lemonade-server_2026.46.1-debian13_arm64.deb Fedora 43 (x86_64) lemonade-server-2026.46.1-fc43.x86_64.rpm Fedora 43 (ARM64) lemonade-server-2026.46.1-fc43.aarch64.rpm Fedora 44 (x86_64) lemonade-server-2026.46.1-fc44.x86_64.rpm Fedora 44 (ARM64) lemonade-server-2026.46.1-fc44.aarch64.rpm macOS Lemonade-2026.46.1-Darwin.pkg Other platforms? See our Installation Options for Docker, Snap, Arch, Debian, and more.
Embe
- Benchmark results can be submitted directly from
- v2026.45.3最新正式版2026-11-04 · 2026-11-04 16:54 UTC
Headline
- The Lemonade desktop app and web ui are completely redesigned with built-in tools, an all-new model manager, a visual router policy editor, Chinese localization, mobile web ui, an LLM telemetry viewer, and much more.
- Watch a deep dive of the new GUI here: https://youtu.be/mg2PqmRujMo
- The HTTP server is rebuilt on a route-class architecture with consistent errors and generated API docs.
- New models: K2-Horizon family (0.9B to MoVA-36B-A4B) and Flint.
Breaking Changes
- GET requests to POST-only paths (
slots/{id},jobs/{id}/pause,jobs/{id}/interrupt,jobs/{id}/resume,models/register) return 405 instead of 404. - A request without a
modelfield returns the same error, "Missing model field in request", on every model route (chat/completions,completions,embeddings,responses,rerank). - Form-encoded requests with invalid field types (for example, a non-numeric
temperatureon transcription) return 400 instead of 500.
Lemonade Server
Operating System Downloads Windows lemonade.msi Ubuntu 24.04+ Launchpad PPA Debian 13 (x86_64) lemonade-server_2026.45.3-debian13_amd64.deb Debian 13 (ARM64) lemonade-server_2026.45.3-debian13_arm64.deb Fedora 43 (x86_64) lemonade-server-2026.45.3-fc43.x86_64.rpm Fedora 43 (ARM64) lemonade-server-2026.45.3-fc43.aarch64.rpm Fedora 44 (x86_64) lemonade-server-2026.45.3-fc44.x86_64.rpm Fedora 44 (ARM64) lemonade-server-2026.45.3-fc44.aarch64.rpm macOS Lemonade-2026.45.3-Darwin.pkg Other platforms? See our Installation Options for Docker, Snap, Arch, Debian, and more.
Embeddable Lemonade
Portable binaries for bundling into your own installer. Run
lemond ./as a subprocess.Platform Download Ubuntu x64 lemonade-embeddable-2026.45.3-ubuntu-x64.tar.gz Ubuntu arm64 lemonade-embeddable-2026.45.3-ubuntu-arm64.tar.gz Windows x64 lemonade-embeddable-2026.45.3-windows-x64.zip macOS arm64 lemonade-embeddable-2026.45.3-macos-arm64.tar.gz
What's Changed
Thanks @bitgamma, @fl0rianr, @github-actions, @iswaryaalex, @jeremyfowers, @lucbruni-amd, @meghsat, @mike230
- candidate-v2026.46.0v2026.46.0 (release candidate)pre-release2026-11-04 · 2026-11-04 16:50 UTC
查看更新说明
Headline
⚠️ These notes are AI generated and will be revised by a human ⚠️
- AMD Strix Halo gets dedicated container backends for llama.cpp, ds4, gufo, rocmfpx, and halogen models.
- SystemOne decision models accept typed questions via POST /v1/systemone, with a new router classifier type.
- Zero-shot classification arrives at POST /v1/classify with a
labelsparameter and zero-shot classifier condition. - TheNoise image generation gains a CUDA backend for Linux x86_64 alongside existing ROCm support.
Breaking Changes
⚠️ These notes are AI generated and will be revised by a human ⚠️
- The /models response no longer includes
image_defaultsoraudio_defaultskeys; their values moved underrecipe_options, so external clients reading the old fields will find them absent. - The /models response now includes a
user_configurableboolean flag on backend descriptor options; consumers that assumed all listed options are editable may show technical knobs likesoft_pixel_cap,pcm_sample_rate, andpcm_channelsto users.
Lemonade Server
Operating System Downloads Windows lemonade.msi Ubuntu 24.04+ Launchpad PPA Debian 13 (x86_64) lemonade-server_2026.46.0-debian13_amd64.deb Debian 13 (ARM64) lemonade-server_2026.46.0-debian13_arm64.deb Fedora 43 (x86_64) lemonade-server-2026.46.0-fc43.x86_64.rpm Fedora 43 (ARM64) lemonade-server-2026.46.0-fc43.aarch64.rpm Fedora 44 (x86_64) lemonade-server-2026.46.0-fc44.x86_64.rpm Fedora 44 (ARM64) lemonade-server-2026.46.0-fc44.aarch64.rpm macOS Lemonade-2026.46.0-Darwin.pkg Other platforms? See our Installation Options for Docker, Snap, Arch, Debian, and more.
Embeddable Lemonade
Portable binaries for bundling into your own installer. Run
lemond ./as a subprocess.Platform Download Ubuntu x64 lemonade-embeddable-2026.46.0-ubuntu-x64.tar.gz Ubuntu arm64 lemonade-embeddable-2026.46.0-ubuntu-arm64.tar.gz Windows x64 lemonade-embeddable-2026.46.0-windows-x64.zip macOS arm64 [lemonade-embeddable-2026.46.0-macos-arm64.tar.gz](https://github.com/lemonade-sdk/lemonade/releases/download/cand - candidate-v2026.45.3v2026.45.3 (release candidate)pre-release2026-10-29 · 2026-10-29 20:42 UTC
查看更新说明
Headline
⚠️ These notes are AI generated and will be revised by a human ⚠️
- The Lemonade app is redesigned with six workspaces, a visual router policy editor, and multi-provider model search.
- Five K2-Horizon and Flint-GGUF models added to the model registry.
- Models that previously failed to load on 128 GB Strix Halo systems now start reliably with improved shared-memory management.
- Model and backend update progress is visible directly in the app with server-owned sync jobs.
Breaking Changes
⚠️ These notes are AI generated and will be revised by a human ⚠️
- The resolved_ctx_size field on /v1/models/{model}/options may now be null when automatic context sizing cannot produce a valid context — clients must handle null instead of assuming an integer.
- GET requests to POST-only paths (slots/{id}, jobs/{id}/pause, jobs/{id}/interrupt, jobs/{id}/resume, models/register) return 405 instead of 404 — clients relying on 404 for these paths will need to check for 405.
- A request missing the model field now raises a consistent "Missing model field in request" error across all model routes (chat/completions, completions, embeddings, responses, rerank) — previous inconsistent error messages may no longer appear.
- Form-encoded requests with invalid field types (such as a non-numeric temperature on transcription) now return 400 instead of 500 — clients catching 500 for this condition should handle 400.
- Streaming responses carry a cancel token that stops the server from sending data after a TCP disconnect.
Lemonade Server
Operating System Downloads Windows lemonade.msi Ubuntu 24.04+ Launchpad PPA Debian 13 (x86_64) lemonade-server_2026.45.3-debian13_amd64.deb Debian 13 (ARM64) lemonade-server_2026.45.3-debian13_arm64.deb Fedora 43 (x86_64) lemonade-server-2026.45.3-fc43.x86_64.rpm Fedora 43 (ARM64) lemonade-server-2026.45.3-fc43.aarch64.rpm Fedora 44 (x86_64) lemonade-server-2026.45.3-fc44.x86_64.rpm Fedora 44 (ARM64) lemonade-server-2026.45.3-fc44.aarch64.rpm macOS Lemonade-2026.45.3-Darwin.pkg Other platforms? See our Installation Options for Docker, Snap, Arch, Debian, and more.
Embeddable Lemonade
Portable binaries for bundling into your own installer. Run
lemond ./as a subprocess.Platform Download Ubuntu x64 lemonade-embeddable-2026.45.3-ubuntu-x64.tar.gz Ubuntu arm64 [lemonade-embeddable-2026.4
用户点评
登录用户的真实使用记录,可按版本和硬件筛选还没有人点评。第一个说出真实体验的人最有价值。
🍋 Lemonade: Refreshingly fast local AI
Lemonade is the local AI server that gives you the same capabilities as cloud APIs, except 100% free and private. Use the latest models for chat, coding, speech, and image generation on your own NPU and GPU.
Lemonade comes in two flavors:
- Lemonade Server installs a service you can connect to hundreds of great apps using standard OpenAI, Anthropic, and Ollama APIs.
- Embeddable Lemonade is a portable binary you can package into your own application to give it multi-modal local AI that auto-optimizes for your user’s PC.
This project is built by the community for every PC, with optimizations by AMD engineers to get the most from Ryzen AI, Radeon, and Strix Halo PCs.
Getting Started
- Install: Windows · Linux · macOS · Docker · Source
- Get Models: Browse and download with the Model Manager
- Generate: Try models with the built-in interfaces for chat, image gen, speech gen, and more
- Mobile: Take your lemonade to go: iOS · Android · Source
- Connect: Use Lemonade with your favorite apps:
Supported Platforms
| Platform | Build |
|---|---|
Using the CLI
To run and chat with Gemma:
lemonade run Gemma-4-E2B-it-GGUF
To code with Lemonade models:
lemonade launch claude
Multi-modality:
# image gen
lemonade run SDXL-Turbo
# speech gen
lemonade run kokoro-v1
# transcription
lemonade run Whisper-Large-v3-Turbo
To see available models and download them:
lemonade list
lemonade pull Gemma-4-E2B-it-GGUF
To manage model aliases for environment-independent naming and active-standby failover:
lemonade alias add production-llm Gemma-4-E2B-it-GGUF
lemonade alias list
# Instant active-standby failover to a different model target
lemonade alias add production-llm Qwen3-0.6B-GGUF
lemonade alias remove production-llm
To see the backends available on your PC:
lemonade backends
For hybrid setups, Lemonade can also route to any OpenAI-compatible cloud provider (Fireworks, OpenAI, OpenRouter, Together, …) alongside local models — see Cloud Offload. (Experimental.)
Model Library
Lemonade supports a wide variety of LLMs (GGUF, FLM, and ONNX), whisper, stable diffusion, etc. models across CPU, GPU, and NPU.
Use lemonade pull or the built-in Model Manager to download models. Custom GGUF/ONNX models can be pulled from Hugging Face or ModelScope, with their source retained for future updates.
Browse the included model catalog →
Supported Configurations
Lemonade supports multiple inference engines for LLM, speech, TTS, and image generation, and each has its own backend and hardware requirements.
† experimental backend, ‡ guest backend. See Backend Tiers and Formats.
To check exactly which recipes/backends are supported on your own machine, run:
lemonade backends
Project Roadmap
Lemonade's roadmap is defined by a set of working groups. Visit the landing page here to learn each group's goal and roadmap.
Integrate Embeddable Lemonade in Your Application
Embeddable Lemonade is a binary version of Lemonade that you can bundle into your own app to give it a portable, auto-optimizing, multi-modal local AI stack. This lets users focus on your app, with zero Lemonade installers, branding, or telemetry.
Check out the Embeddable Lemonade guide.
Connect Lemonade Server to Your Application
You can use any OpenAI-compatible client library by configuring it to use http://localhost:13305/v1 as the base URL. A table containing official and popular OpenAI clients on different languages is shown below.
Feel free to pick and choose your preferred language.
| Python | C++ | Java | C# | Node.js | Go | Ruby | Rust | PHP |
|---|---|---|---|---|---|---|---|---|
| openai-python | openai-cpp | openai-java | openai-dotnet | openai-node | go-openai | ruby-openai | async-openai | openai-php |
Python Client Example
from openai import OpenAI
# Initialize the client to use Lemonade Server
client = OpenAI(
base_url="http://localhost:13305/api/v1",
api_key="lemonade" # required but unused
)
# Create a chat completion
completion = client.chat.completions.create(
model="Gemma-4-E2B-it-GGUF", # or any other available model
messages=[
{"role": "user", "content": "What is the capital of France?"}
]
)
# Print the response
print(completion.choices[0].message.content)
Click to learn more about the available APIs and how to embed Lemonade in your own application.
FAQ
To read our frequently asked questions, see our FAQ Guide
Contributing
Lemonade is built by the local AI community! If you would like to contribute to this project, please check out our contribution guide.
Maintainers
This is a community project with many maintainers, please see the maintainers list here to see their subject areas. You can reach us by filing an issue or joining our Discord. This project is sponsored by AMD.
Code Signing Policy
Free code signing provided by SignPath.io, certificate by SignPath Foundation.
- Committers and reviewers: Maintainers of this repo
- Approvers: Owners
Privacy policy: This program will not transfer any information to other networked systems unless specifically requested by the user or the person installing or operating it. When the user requests a model download or registry lookup, Lemonade may contact Hugging Face Hub (see their privacy policy) or ModelScope, according to the model source selected by the user or packager.
License and Attribution
This project is:
- Built with C++ (server) and React (app) with ❤️ for the open source community,
- Standing on the shoulders of great tools from:
- Licensed under the Apache 2.0 License.
- Portions of the project are licensed as described in LICENSE.