lemonade

lemonade-sdkApache-2.0活跃维护

在本地 GPU 和 NPU 上直接跑优化后的大模型,帮用户发现并启动本地 AI 应用,省去自己折腾推理环境的麻烦。

Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk

v2026.45.3发布于 2026-11-04 16:54 UTC6,170star +28 / 7 天560fork同步于 2026-11-10 11:34 UTC

怎么上手

由 README 提炼,执行前请确认
lemonade run Gemma-4-E2B-it-GGUF
硬件要求按 README 说明

README 未给出具体显存要求。支持 CPU(x86_64、ARM64)、NVIDIA Turing 及更新 GPU(CUDA)、AMD GPU(ROCm、Vulkan)、Apple Silicon GPU(Metal),并对 AMD Ryzen AI、Radeon、Strix Halo 做了优化。

支持 Apple Silicon需要 CUDA支持 ROCm / AMD
下载:源码 zip·GitHub Releases(安装包)本站不镜像安装包

项目说明

由 README 自动翻译提炼

本地 AI 服务器,用 OpenAI、Anthropic、Ollama 兼容接口在自己 GPU 和 NPU 上跑优化后的模型

在本地 GPU 和 NPU 上直接跑优化后的大模型,帮用户发现并启动本地 AI 应用,省去自己折腾推理环境的麻烦。

核心能力

  • 用标准 OpenAI、Anthropic、Ollama API 接入数百款应用
  • 内置 Model Manager 浏览并下载 GGUF、FLM、ONNX 模型
  • 支持 chat、图像生成、语音生成与转录多模态
  • 按硬件自动选择 llamacpp 的 cuda、rocm、vulkan、metal 等后端
  • 提供可嵌入二进制,打包进自己的应用并自动适配用户 PC

容易踩的坑

模型需先用 lemonade pull 或 Model Manager 下载后才能运行;不同后端有各自的硬件与系统限制,可先用 lemonade backends 查看本机可用后端;云厂商路由(Cloud Offload)目前为实验性功能。

内容由模型根据 README 生成,可能不完整或不准确,以官方文档为准。看原文 README

最近发版

5 个版本v2026.45.3
  1. pr-3930PR 3930 release candidate (ffd40a2)pre-release2026-11-08 · 2026-11-08 20:09 UTC
    查看更新说明

    Release candidate of PR 3930 (Lemonade Nexus) from branch commit ffd40a2, built by CI run 42558423737, with the Nexus SDK at lemonade-nexus 229726d.

    This is a pre-release for testing the PR. It is not a Lemonade release.

    New in this build:

    • The device advertises its LAN addresses fastest link first and one per subnet, so peers try a 25 Gbit link before a 1 Gbit link and both before Wi-Fi.
    • Together with Nexus server release v2026.11.09, two devices on one LAN whose sessions sit on different Tier 1 servers now see each other's LAN addresses and connect directly instead of through a relay.

    From the previous builds: host-grouped chat model picker with Loaded/Downloaded marks, a mesh peer's load request keeps a loaded model, "Chat runs on" in the account menu, the server info dialog, the mesh port keeps its certificate across restarts, and Enable Mesh accepts the device's current account after a deletion or key replacement.

  2. candidate-v2026.46.1v2026.46.1 (release candidate)pre-release2026-11-05 · 2026-11-05 02:33 UTC
    查看更新说明

    Headline

    ⚠️ These notes are AI generated and will be revised by a human ⚠️

    • Benchmark results can be submitted directly from lemonade bench and shared via claim link at https://bench.lemonade-server.ai.
    • Zero-shot classification is available via POST /v1/classify with a labels parameter, and as a zero_shot condition type in router policies.
    • TheNoise image generation gains a CUDA backend for Linux x86_64 alongside existing ROCm support.
    • New container backends for AMD Strix Halo (gfx1151) — including ds4:rocm, rocmfpx:rocm, gufo:rocm, and llamacpp:halobox — bring GPU-accelerated inference to the platform.
    • POST /v1/systemone forwards typed questions to a decision model, with support for router-classified choices and SystemOne zero-shot classification.

    Breaking Changes

    ⚠️ These notes are AI generated and will be revised by a human ⚠️

    • The /models API response no longer includes image_defaults or audio_defaults; their values are now under recipe_options, so external clients reading the old fields will find them absent.
    • The /models response includes a user_configurable boolean flag on backend descriptor options; consumers that assumed all listed options are editable may show technical knobs like soft_pixel_cap, pcm_sample_rate, and pcm_channels to users.
    • FLM v1.0.11 (bumped from v1.0.7) returns max_tokens exactly as requested rather than max_tokens+1, so chat completions that relied on the extra token will now stop one token early.
    • FLM v1.0.11 streams token usage counts only when stream_options.include_usage is set; without it the server's /api/v1/stats endpoint records no token counts or throughput for FLM streams.
    • FLM v1.0.11 returns 400 for previously-accepted invalid fields including invalid tool_choice, forced tool calls on small Qwen3 models (up to 1.7B), conversation history on *-flash models, and requests with no messages or prompt.

    Lemonade Server

    Operating SystemDownloads
    Windowslemonade.msi
    Ubuntu 24.04+Launchpad PPA
    Debian 13 (x86_64)lemonade-server_2026.46.1-debian13_amd64.deb
    Debian 13 (ARM64)lemonade-server_2026.46.1-debian13_arm64.deb
    Fedora 43 (x86_64)lemonade-server-2026.46.1-fc43.x86_64.rpm
    Fedora 43 (ARM64)lemonade-server-2026.46.1-fc43.aarch64.rpm
    Fedora 44 (x86_64)lemonade-server-2026.46.1-fc44.x86_64.rpm
    Fedora 44 (ARM64)lemonade-server-2026.46.1-fc44.aarch64.rpm
    macOSLemonade-2026.46.1-Darwin.pkg

    Other platforms? See our Installation Options for Docker, Snap, Arch, Debian, and more.

    Embe

  3. v2026.45.3最新正式版2026-11-04 · 2026-11-04 16:54 UTC

    Headline

    • The Lemonade desktop app and web ui are completely redesigned with built-in tools, an all-new model manager, a visual router policy editor, Chinese localization, mobile web ui, an LLM telemetry viewer, and much more.
    • Watch a deep dive of the new GUI here: https://youtu.be/mg2PqmRujMo
    • The HTTP server is rebuilt on a route-class architecture with consistent errors and generated API docs.
    • New models: K2-Horizon family (0.9B to MoVA-36B-A4B) and Flint.

    Breaking Changes

    • GET requests to POST-only paths (slots/{id}, jobs/{id}/pause, jobs/{id}/interrupt, jobs/{id}/resume, models/register) return 405 instead of 404.
    • A request without a model field returns the same error, "Missing model field in request", on every model route (chat/completions, completions, embeddings, responses, rerank).
    • Form-encoded requests with invalid field types (for example, a non-numeric temperature on transcription) return 400 instead of 500.

    Lemonade Server

    Operating SystemDownloads
    Windowslemonade.msi
    Ubuntu 24.04+Launchpad PPA
    Debian 13 (x86_64)lemonade-server_2026.45.3-debian13_amd64.deb
    Debian 13 (ARM64)lemonade-server_2026.45.3-debian13_arm64.deb
    Fedora 43 (x86_64)lemonade-server-2026.45.3-fc43.x86_64.rpm
    Fedora 43 (ARM64)lemonade-server-2026.45.3-fc43.aarch64.rpm
    Fedora 44 (x86_64)lemonade-server-2026.45.3-fc44.x86_64.rpm
    Fedora 44 (ARM64)lemonade-server-2026.45.3-fc44.aarch64.rpm
    macOSLemonade-2026.45.3-Darwin.pkg

    Other platforms? See our Installation Options for Docker, Snap, Arch, Debian, and more.

    Embeddable Lemonade

    Portable binaries for bundling into your own installer. Run lemond ./ as a subprocess.

    PlatformDownload
    Ubuntu x64lemonade-embeddable-2026.45.3-ubuntu-x64.tar.gz
    Ubuntu arm64lemonade-embeddable-2026.45.3-ubuntu-arm64.tar.gz
    Windows x64lemonade-embeddable-2026.45.3-windows-x64.zip
    macOS arm64lemonade-embeddable-2026.45.3-macos-arm64.tar.gz

    What's Changed

    Thanks @bitgamma, @fl0rianr, @github-actions, @iswaryaalex, @jeremyfowers, @lucbruni-amd, @meghsat, @mike230

  4. candidate-v2026.46.0v2026.46.0 (release candidate)pre-release2026-11-04 · 2026-11-04 16:50 UTC
    查看更新说明

    Headline

    ⚠️ These notes are AI generated and will be revised by a human ⚠️

    • AMD Strix Halo gets dedicated container backends for llama.cpp, ds4, gufo, rocmfpx, and halogen models.
    • SystemOne decision models accept typed questions via POST /v1/systemone, with a new router classifier type.
    • Zero-shot classification arrives at POST /v1/classify with a labels parameter and zero-shot classifier condition.
    • TheNoise image generation gains a CUDA backend for Linux x86_64 alongside existing ROCm support.

    Breaking Changes

    ⚠️ These notes are AI generated and will be revised by a human ⚠️

    • The /models response no longer includes image_defaults or audio_defaults keys; their values moved under recipe_options, so external clients reading the old fields will find them absent.
    • The /models response now includes a user_configurable boolean flag on backend descriptor options; consumers that assumed all listed options are editable may show technical knobs like soft_pixel_cap, pcm_sample_rate, and pcm_channels to users.

    Lemonade Server

    Operating SystemDownloads
    Windowslemonade.msi
    Ubuntu 24.04+Launchpad PPA
    Debian 13 (x86_64)lemonade-server_2026.46.0-debian13_amd64.deb
    Debian 13 (ARM64)lemonade-server_2026.46.0-debian13_arm64.deb
    Fedora 43 (x86_64)lemonade-server-2026.46.0-fc43.x86_64.rpm
    Fedora 43 (ARM64)lemonade-server-2026.46.0-fc43.aarch64.rpm
    Fedora 44 (x86_64)lemonade-server-2026.46.0-fc44.x86_64.rpm
    Fedora 44 (ARM64)lemonade-server-2026.46.0-fc44.aarch64.rpm
    macOSLemonade-2026.46.0-Darwin.pkg

    Other platforms? See our Installation Options for Docker, Snap, Arch, Debian, and more.

    Embeddable Lemonade

    Portable binaries for bundling into your own installer. Run lemond ./ as a subprocess.

    PlatformDownload
    Ubuntu x64lemonade-embeddable-2026.46.0-ubuntu-x64.tar.gz
    Ubuntu arm64lemonade-embeddable-2026.46.0-ubuntu-arm64.tar.gz
    Windows x64lemonade-embeddable-2026.46.0-windows-x64.zip
    macOS arm64[lemonade-embeddable-2026.46.0-macos-arm64.tar.gz](https://github.com/lemonade-sdk/lemonade/releases/download/cand
  5. candidate-v2026.45.3v2026.45.3 (release candidate)pre-release2026-10-29 · 2026-10-29 20:42 UTC
    查看更新说明

    Headline

    ⚠️ These notes are AI generated and will be revised by a human ⚠️

    • The Lemonade app is redesigned with six workspaces, a visual router policy editor, and multi-provider model search.
    • Five K2-Horizon and Flint-GGUF models added to the model registry.
    • Models that previously failed to load on 128 GB Strix Halo systems now start reliably with improved shared-memory management.
    • Model and backend update progress is visible directly in the app with server-owned sync jobs.

    Breaking Changes

    ⚠️ These notes are AI generated and will be revised by a human ⚠️

    • The resolved_ctx_size field on /v1/models/{model}/options may now be null when automatic context sizing cannot produce a valid context — clients must handle null instead of assuming an integer.
    • GET requests to POST-only paths (slots/{id}, jobs/{id}/pause, jobs/{id}/interrupt, jobs/{id}/resume, models/register) return 405 instead of 404 — clients relying on 404 for these paths will need to check for 405.
    • A request missing the model field now raises a consistent "Missing model field in request" error across all model routes (chat/completions, completions, embeddings, responses, rerank) — previous inconsistent error messages may no longer appear.
    • Form-encoded requests with invalid field types (such as a non-numeric temperature on transcription) now return 400 instead of 500 — clients catching 500 for this condition should handle 400.
    • Streaming responses carry a cancel token that stops the server from sending data after a TCP disconnect.

    Lemonade Server

    Operating SystemDownloads
    Windowslemonade.msi
    Ubuntu 24.04+Launchpad PPA
    Debian 13 (x86_64)lemonade-server_2026.45.3-debian13_amd64.deb
    Debian 13 (ARM64)lemonade-server_2026.45.3-debian13_arm64.deb
    Fedora 43 (x86_64)lemonade-server-2026.45.3-fc43.x86_64.rpm
    Fedora 43 (ARM64)lemonade-server-2026.45.3-fc43.aarch64.rpm
    Fedora 44 (x86_64)lemonade-server-2026.45.3-fc44.x86_64.rpm
    Fedora 44 (ARM64)lemonade-server-2026.45.3-fc44.aarch64.rpm
    macOSLemonade-2026.45.3-Darwin.pkg

    Other platforms? See our Installation Options for Docker, Snap, Arch, Debian, and more.

    Embeddable Lemonade

    Portable binaries for bundling into your own installer. Run lemond ./ as a subprocess.

    PlatformDownload
    Ubuntu x64lemonade-embeddable-2026.45.3-ubuntu-x64.tar.gz
    Ubuntu arm64[lemonade-embeddable-2026.4

用户点评

登录用户的真实使用记录,可按版本和硬件筛选
共 0 条

    还没有人点评。第一个说出真实体验的人最有价值。

    README 原文

    未翻译

    🍋 Lemonade: Refreshingly fast local AI

    Lemonade is the local AI server that gives you the same capabilities as cloud APIs, except 100% free and private. Use the latest models for chat, coding, speech, and image generation on your own NPU and GPU.

    Lemonade comes in two flavors:

    • Lemonade Server installs a service you can connect to hundreds of great apps using standard OpenAI, Anthropic, and Ollama APIs.
    • Embeddable Lemonade is a portable binary you can package into your own application to give it multi-modal local AI that auto-optimizes for your user’s PC.

    This project is built by the community for every PC, with optimizations by AMD engineers to get the most from Ryzen AI, Radeon, and Strix Halo PCs.

    Getting Started

    1. Install: Windows · Linux · macOS · Docker · Source
    2. Get Models: Browse and download with the Model Manager
    3. Generate: Try models with the built-in interfaces for chat, image gen, speech gen, and more
    4. Mobile: Take your lemonade to go: iOS · Android · Source
    5. Connect: Use Lemonade with your favorite apps:

    Supported Platforms

    PlatformBuild
    Arch LinuxArch package
    Debian Trixie+Build .deb
    DockerBuild Container Image
    Fedora 43+Build .rpm
    macOSBuild .pkg
    SnapBuild Snap
    Ubuntu 24.04+Build Launchpad PPA
    Windows 11Build .msi

    Using the CLI

    To run and chat with Gemma:

    lemonade run Gemma-4-E2B-it-GGUF
    

    To code with Lemonade models:

    lemonade launch claude
    

    Multi-modality:

    # image gen
    lemonade run SDXL-Turbo
    
    # speech gen
    lemonade run kokoro-v1
    
    # transcription
    lemonade run Whisper-Large-v3-Turbo
    

    To see available models and download them:

    lemonade list
    
    lemonade pull Gemma-4-E2B-it-GGUF
    

    To manage model aliases for environment-independent naming and active-standby failover:

    lemonade alias add production-llm Gemma-4-E2B-it-GGUF
    lemonade alias list
    
    # Instant active-standby failover to a different model target
    lemonade alias add production-llm Qwen3-0.6B-GGUF
    lemonade alias remove production-llm
    

    To see the backends available on your PC:

    lemonade backends
    

    For hybrid setups, Lemonade can also route to any OpenAI-compatible cloud provider (Fireworks, OpenAI, OpenRouter, Together, …) alongside local models — see Cloud Offload. (Experimental.)

    Model Library

    Lemonade supports a wide variety of LLMs (GGUF, FLM, and ONNX), whisper, stable diffusion, etc. models across CPU, GPU, and NPU.

    Use lemonade pull or the built-in Model Manager to download models. Custom GGUF/ONNX models can be pulled from Hugging Face or ModelScope, with their source retained for future updates.

    Browse the included model catalog →

    Supported Configurations

    Lemonade supports multiple inference engines for LLM, speech, TTS, and image generation, and each has its own backend and hardware requirements.

    † experimental backend, ‡ guest backend. See Backend Tiers and Formats.

    To check exactly which recipes/backends are supported on your own machine, run:

    lemonade backends
    

    Project Roadmap

    Lemonade's roadmap is defined by a set of working groups. Visit the landing page here to learn each group's goal and roadmap.

    Integrate Embeddable Lemonade in Your Application

    Embeddable Lemonade is a binary version of Lemonade that you can bundle into your own app to give it a portable, auto-optimizing, multi-modal local AI stack. This lets users focus on your app, with zero Lemonade installers, branding, or telemetry.

    Check out the Embeddable Lemonade guide.

    Connect Lemonade Server to Your Application

    You can use any OpenAI-compatible client library by configuring it to use http://localhost:13305/v1 as the base URL. A table containing official and popular OpenAI clients on different languages is shown below.

    Feel free to pick and choose your preferred language.

    PythonC++JavaC#Node.jsGoRubyRustPHP
    openai-pythonopenai-cppopenai-javaopenai-dotnetopenai-nodego-openairuby-openaiasync-openaiopenai-php

    Python Client Example

    from openai import OpenAI
    
    # Initialize the client to use Lemonade Server
    client = OpenAI(
        base_url="http://localhost:13305/api/v1",
        api_key="lemonade"  # required but unused
    )
    
    # Create a chat completion
    completion = client.chat.completions.create(
        model="Gemma-4-E2B-it-GGUF",  # or any other available model
        messages=[
            {"role": "user", "content": "What is the capital of France?"}
        ]
    )
    
    # Print the response
    print(completion.choices[0].message.content)
    

    Click to learn more about the available APIs and how to embed Lemonade in your own application.

    FAQ

    To read our frequently asked questions, see our FAQ Guide

    Contributing

    Lemonade is built by the local AI community! If you would like to contribute to this project, please check out our contribution guide.

    Maintainers

    This is a community project with many maintainers, please see the maintainers list here to see their subject areas. You can reach us by filing an issue or joining our Discord. This project is sponsored by AMD.

    Code Signing Policy

    Free code signing provided by SignPath.io, certificate by SignPath Foundation.

    Privacy policy: This program will not transfer any information to other networked systems unless specifically requested by the user or the person installing or operating it. When the user requests a model download or registry lookup, Lemonade may contact Hugging Face Hub (see their privacy policy) or ModelScope, according to the model source selected by the user or packager.

    License and Attribution

    This project is: