Skip to content

Releases: lemonade-sdk/lemonade

v11.5.1

Choose a tag to compare

@github-actions github-actions released this 29 Jul 23:40
fc4f243

Headline

  • lemonade bench adds an image-generation benchmark mode with capability-aware scenario and model filtering, response capture, and a new --timeout flag.
  • The Router Builder gains a Test Prompt tab, backed by a new POST /routing/validate endpoint, that runs a routing policy against a sample prompt and shows the decision, a step-by-step trace, and a decision-tree view.
  • Ten MiniCPM text and vision GGUF models from ModelScope join the built-in llama.cpp catalog.
  • Tool-calling requests to llama.cpp with large JSON schema bounds are now accepted, working around a grammar limit that previously rejected valid tool calls.

Breaking Changes

  • llama.cpp non-streaming responses now return the requested or registered model id in the model field instead of the local .gguf absolute path.
  • Registered and imported collections (user.*/extra.*) now list under their canonical prefixed id on /v1/models, Ollama /api/tags, and MCP lemonade_list_models.
  • auto backend selection now prefers Vulkan on AMD systems across all engines, matching the llamacpp behavior.

Lemonade Server

Operating System Downloads
Windows lemonade.msi
Ubuntu 24.04+ Launchpad PPA
Debian 13 (x86_64) lemonade-server_11.5.1-debian13_amd64.deb
Debian 13 (ARM64) lemonade-server_11.5.1-debian13_arm64.deb
Fedora 43 (x86_64) lemonade-server-11.5.1-fc43.x86_64.rpm
Fedora 43 (ARM64) lemonade-server-11.5.1-fc43.aarch64.rpm
Fedora 44 (x86_64) lemonade-server-11.5.1-fc44.x86_64.rpm
Fedora 44 (ARM64) lemonade-server-11.5.1-fc44.aarch64.rpm
macOS Lemonade-11.5.1-Darwin.pkg

Other platforms? See our Installation Options for Docker, Snap, Arch, Debian, and more.

Embeddable Lemonade

Portable binaries for bundling into your own installer. Run lemond ./ as a subprocess.

Platform Download
Ubuntu x64 lemonade-embeddable-11.5.1-ubuntu-x64.tar.gz
Ubuntu arm64 lemonade-embeddable-11.5.1-ubuntu-arm64.tar.gz
Windows x64 lemonade-embeddable-11.5.1-windows-x64.zip
macOS arm64 lemonade-embeddable-11.5.1-macos-arm64.tar.gz

What's Changed

Thanks @QuMuzafferEge, @QuTosh, @SlawomirNowaczyk, @ZMXJJ, @abn, @ckuethe, @coolduderules, @fl0rianr, @jeremyfowers, @kenvandine, @ramkrishna2910, @sujikathir, @superm1 for your awesome contributions to this release!

Click to expand changelog
  • Update trellis checksums to the pinned v0.4.3 assets by @ramkrishna2910 in #2778
  • web: community links in navbar hamburger + homepage hero by @jeremyfowers in #2784
  • Bench imagegen by @ckuethe in #2683
  • Add libgomp runtime dependency to deb/rpm packages by @kenvandine in #2794
  • Fix: Repeated model update reports after pull by @fl0rianr in #2715
  • [Router] Fix DirectoryWatcher missing policy delete+rewrite on Windows by @SlawomirNowaczyk in #2798
  • Fix llama.cpp model field echoing local .gguf path by @SlawomirNowaczyk in #2796
  • Add JSON schema checking to pre-commit by @superm1 in #2802
  • fix(cli): parse configuration values as JSON arrays and objects by @abn in #2816
  • Fix JSON pre-commit validation with permissive schema by @superm1 with @Copilot in #2810
  • fix(http): add libcurl protocol fallback for macOS libcurl compatibility by @abn in #2806
  • fix(custom_args): treat negative numbers as values, not flags by @coolduderules in #2773
  • Issue 2651: Router Prompt Debugger (Ege Qutwo) by @QuMuzafferEge in #2726
  • Add conformance tests (phase 1: deterministic) by @QuTosh in #2761
  • Fix: list router/collection ids with their user./extra. prefix in GET /v1/models by @SlawomirNowaczyk in #2797
  • Add ModelScope registry search blog post by @ramkrishna2910 in #2828
  • Add MiniCPM GGUF models to catalog by @ZMXJJ in #2825
  • fix(server): preserve WebSocket auth state and support desktop client origins by @abn in #2790
  • Fix Whisper realtime test isolation and stale session work by @fl0rianr in #2821
  • docs(telemetry): improve telemetry and arize phoenix setup guide by @abn in #2817
  • fix(llamacpp): sanitize oversized tool schema limits by @sujikathir in #2807
  • fix(ci): job-isolated process cleanups and fast installer teardowns by @abn in #2643
  • Apply a canonical backend preference order to all descriptors by @jeremyfowers in #2835
  • wg: Add an Enterprise Grade working group and archive Omni Models by @jeremyfowers in #2812
  • Bump project version from 11.5.0 to 11.5.1 by @jeremyfowers in #2849
  • Update flm NPU version to v0.9.46 by @jeremyfowers in #2847
  • fix(installer): handle slow tarball listings by @sujikathir in #2830

New Contributors

Full Changelog: v11.5.0...v11.5.1


Windows installers are signed. Free code signing provided by SignPath.io, certificate by SignPath Foundation. See our Code Signing Policy.

v11.5.0

Choose a tag to compare

@github-actions github-actions released this 22 Jul 20:25

Headline

  • The Lemonade Router is complete: name a collection.router model and requests are steered by rule, classifier, semantic-similarity, or LLM-as-router policies, with per-candidate decision traces, a GUI for authoring and editing routers, and a POST /v1/classify text-classification endpoint backed by a new onnxruntime backend.
  • ModelScope is now searchable alongside Hugging Face in the Model Manager, with source-aware model discovery, download, and registration.
  • A server-side job engine lets clients post multi-step recipes and manage them through /jobs endpoints, with pause, interrupt, resume, and delete lifecycle control.
  • lemond can act as an MCP client host, connecting to external stdio MCP servers and discovering their tools through admin-gated /internal/mcp/* endpoints.
  • The lemonade CLI now supports HTTPS/TLS connections to secure remote endpoints, honoring http(s):// schemes in LEMONADE_HOST.

Breaking Changes

  • The server no longer sends Access-Control-Allow-Origin: * by default: non-loopback browser origins are now rejected with 403 unless listed in LEMONADE_ALLOWED_ORIGINS, and the WebSocket same-origin fallback has been removed. Remote or LAN browser clients must set LEMONADE_ALLOWED_ORIGINS.

Lemonade Server

Operating System Downloads
Windows lemonade.msi
Ubuntu 24.04+ Launchpad PPA
Debian 13 (x86_64) lemonade-server_11.5.0-debian13_amd64.deb
Debian 13 (ARM64) lemonade-server_11.5.0-debian13_arm64.deb
Fedora 43 (x86_64) lemonade-server-11.5.0-fc43.x86_64.rpm
Fedora 43 (ARM64) lemonade-server-11.5.0-fc43.aarch64.rpm
Fedora 44 (x86_64) lemonade-server-11.5.0-fc44.x86_64.rpm
Fedora 44 (ARM64) lemonade-server-11.5.0-fc44.aarch64.rpm
macOS Lemonade-11.5.0-Darwin.pkg

Other platforms? See our Installation Options for Docker, Snap, Arch, Debian, and more.

Embeddable Lemonade

Portable binaries for bundling into your own installer. Run lemond ./ as a subprocess.

Platform Download
Ubuntu x64 lemonade-embeddable-11.5.0-ubuntu-x64.tar.gz
Ubuntu arm64 lemonade-embeddable-11.5.0-ubuntu-arm64.tar.gz
Windows x64 lemonade-embeddable-11.5.0-windows-x64.zip
macOS arm64 lemonade-embeddable-11.5.0-macos-arm64.tar.gz

What's Changed

Thanks @OussamaBATOUCHE, @QuManu, @SlawomirNowaczyk, @abn, @ckopanos, @ekkoitac, @fl0rianr, @jon-hotaisle, @kenvandine, @kyuubyN, @meghsat, @midu16, @pwilkin, @radhaksri, @ramkrishna2910, @superm1, @therealjuanmartinez for your awesome contributions to this release!

Click to expand changelog
  • Update version to prepare for release by @superm1 in #2702
  • fix(security): pin SHA-256 checksums for contributor-hosted backend assets by @superm1 in #2710
  • fix(ci): always run macOS C++ unit tests regardless of signing by @superm1 in #2712
  • docs (fix): typo in readme by @jon-hotaisle in #2701
  • feat(router): onnxruntime classification backend + /v1/classify (capability for #2592; policy wiring in #2384) by @ramkrishna2910 in #2626
  • Fix: re-pulling a collection.router model fails with "unknown key 'source'" by @SlawomirNowaczyk in #2703
  • feat: add Modelscope search by @fl0rianr in #2716
  • fix(websocket): allow Windows Tauri WebView2 origin for upgrades by @superm1 in #2721
  • fix: quote /MANIFESTINPUT path and detect RX 7600 as gfx110X by @kyuubyN in #2678
  • Add server-side MCP client host foundation by @fl0rianr in #2605
  • fix(docker): Add libreadline8 to Dockerfile dependencies by @ckopanos in #2733
  • fix(security): apply HTTP trust policies to POST request paths by @fl0rianr in #2741
  • feat: job engine by @pwilkin in #2718
  • Keep sd-cpp validation images out of auto-update PRs by @fl0rianr in #2502
  • feat(server): support PNA CORS, custom allowed origins, and custom headers by @abn in #2660
  • feat(cli): add native HTTPS/TLS and URL scheme parsing support by @abn in #2373
  • feat(trellis): per-request UV atlas method, bump trellis to v0.4.3 by @pwilkin in #2667
  • fix(docker): include build-essential in runtime stage for vLLM Triton… by @midu16 in #2749
  • Wire collection.router classifiers to Router::classify + validate model capability at parse time by @QuManu in #2727
  • [Router] llm router classifier + routing.router desugaring (#2405) by @OussamaBATOUCHE in #2698
  • Support gfx950, using the same path as gfx942 by @SlawomirNowaczyk in #2687
  • feat(telemetry): honor incoming W3C traceparent (opt-in) by @radhaksri in #2734
  • [Router] [UI] Author collection.router in the custom-collection panel (#2406) by @meghsat in #2693
  • Router end-to-end demo, integration test, and docs (#2388) by @ramkrishna2910 in #2732
  • fix(router): isolate routing helpers from standard model LRU slots by @fl0rianr in #2729
  • Update version to 11.5.0 by @ramkrishna2910 in #2772
  • fix: detect Arch ggml HIP plugin paths by @ekkoitac in #2760
  • api: expose is_busy and is_streaming flags in /health response by @therealjuanmartinez in #2720
  • Fix arm64 PPA packages missing bundled web UI by @kenvandine in #2770
  • fix: resolve CORS blockage on MCP Gateway Endpoint by @abn in #2771

New Contributors

Full Changelog: v11.0.0...v11.5.0


Windows installers are signed. Free code signing provided by SignPath.io, certificate by SignPath Foundation. See our Code Signing Policy.

Router Milestone Contributors

The Lemonade Router shipped across v11.0.0 and v11.5.0 (17 PRs). PR authors: @eddierichter-amd, @SlawomirNowaczyk, @ramkrishna2910, @OussamaBATOUCHE, @QuManu, @meghsat, @fl0rianr, @coolduderules. Reviewers: @fl0rianr, @SlawomirNowaczyk, @eddierichter-amd, @ramkrishna2910, @meghsat, @superm1, @bong-water-water-bong.

v11.0.0

Choose a tag to compare

@github-actions github-actions released this 15 Jul 17:16

Headline

  • A new 3D-generation modality ports the Trellis.2 image-to-3D pipeline, exposing a POST /v1/3d/generations endpoint and a GUI 3D panel with an in-app model viewer.
  • Text-to-speech arrives with the OpenMOSS backend, including voice-cloning and voice-design models and a dedicated TTS panel in the GUI.
  • Naming a collection.router model on /chat/completions, /completions, or /responses now runs its routing engine and reports the selected route via an x_lemonade_route body field and x-lemonade-route header.
  • ModelScope is now supported as a second remote model registry alongside Hugging Face, with source selection across the CLI, API, and desktop app.
  • The FastFlowLM NPU backend now auto-installs on Linux instead of requiring a manual system-package install, with a new prefer_system config flag.

Breaking Changes

  • The Docker runtime image now runs lemond as unprivileged UID 10001 and stores caches under /opt/lemonade/.cache instead of /root/.cache; chown or recreate existing root-owned named volumes.
  • Re-registering a Hugging Face user model under a name already used by a different checkpoint now returns an error instead of silently overwriting the existing user.* model; choose a different name.

Lemonade Server

Operating System Downloads
Windows lemonade.msi
Ubuntu 24.04+ Launchpad PPA
Debian 13 (x86_64) lemonade-server_11.0.0-debian13_amd64.deb
Debian 13 (ARM64) lemonade-server_11.0.0-debian13_arm64.deb
Fedora 43 (x86_64) lemonade-server-11.0.0-fc43.x86_64.rpm
Fedora 43 (ARM64) lemonade-server-11.0.0-fc43.aarch64.rpm
Fedora 44 (x86_64) lemonade-server-11.0.0-fc44.x86_64.rpm
Fedora 44 (ARM64) lemonade-server-11.0.0-fc44.aarch64.rpm
macOS Lemonade-11.0.0-Darwin.pkg

Other platforms? See our Installation Options for Docker, Snap, Arch, Debian, and more.

Embeddable Lemonade

Portable binaries for bundling into your own installer. Run lemond ./ as a subprocess.

Platform Download
Ubuntu x64 lemonade-embeddable-11.0.0-ubuntu-x64.tar.gz
Ubuntu arm64 lemonade-embeddable-11.0.0-ubuntu-arm64.tar.gz
Windows x64 lemonade-embeddable-11.0.0-windows-x64.zip
macOS arm64 lemonade-embeddable-11.0.0-macos-arm64.tar.gz

What's Changed

Thanks @SlawomirNowaczyk, @abn, @ckuethe, @eddierichter-amd, @fl0rianr, @ianbmacdonald, @indistinctTalk, @kenvandine, @kyuubyN, @pwilkin, @ramkrishna2910, @superm1, @wariobot09 for your awesome contributions to this release!

Click to expand changelog
  • Update FLM to 0.9.44 and enable portable FLM for Linux by @superm1 in #2544
  • dev: change base image to Ubuntu 24.04 in Dockerfile by @fl0rianr in #2578
  • fix(server): replace dummy bind with connect check for port availability by @abn in #2576
  • Router/2385 collection.router recipe dispatch by @SlawomirNowaczyk in #2558
  • feat(telemetry): add WebSocket server endpoint and security controls by @abn in #2574
  • feat(rocm): enable AMD Instinct MI300X (gfx942) in the llama.cpp ROCm backend by @ianbmacdonald in #2587
  • Asset generation: OpenMOSS by @pwilkin in #2580
  • Start an abstraction layer for benchmark types by @ckuethe in #2557
  • Asset generation: Trellis by @pwilkin in #2581
  • fix(backends): enable sd-cpp CUDA support on Windows by @kenvandine in #2601
  • refactor(audio-gen): apply backend review feedback to ThinkSound and ACE-Step by @pwilkin in #2594
  • fix(rocm): detect version-suffixed HIP runtime on Windows (ROCm 7.x) by @ramkrishna2910 in #2603
  • Router/2386 decision trace response by @eddierichter-amd in #2606
  • fix(docker): drop to non-root user and remove unverified FLM download by @superm1 in #2617
  • fix(llamacpp): detect HIP plugin next to PATH-resolved llama-server by @pwilkin in #2628
  • fix: model update startup behavior in offline mode by @fl0rianr in #2612
  • fix(server): size HTTP thread pool from CPU count and add socket time… by @superm1 in #2618
  • log: reduce verbosity of model already loaded and websocket connection logs by @abn in #2599
  • Bench embed by @ckuethe in #2577
  • fix(auto-label): refactor community user checks to exclude bots by @fl0rianr in #2479
  • security: pin FetchContent deps to commit SHAs by @superm1 in #2633
  • fix: avoid HF user model name collisions act only when they occur by @fl0rianr in #2058
  • security(renderer): redact API key values from console logs by @superm1 in #2632
  • fix(acestep): music without lyrics isn't the greatest by @pwilkin in #2629
  • fix: handle AMD APU memory pressure correctly by @fl0rianr in #2638
  • chore(ci): parallelize link checking, headless setup flags, and documentation link fixes by @abn in #2646
  • chore(ci): enable package caching and ccache on distro builds by @abn in #2645
  • fix: readme and gen_backend_boilerplate by @fl0rianr in #2658
  • ci: add safe AMD64 and ARM64 container validation by @fl0rianr in #2637
  • Feat/dxgi use native DXGI QueryVideoMemoryInfo for Windows VRAM pressure by @kyuubyN in #2648
  • chore: bump FLM to v0.9.45 by @wariobot09 in #2661
  • fix: bump openmoss to v0.1.3 (fixes progressive audio degradation past 10 s) by @pwilkin in #2666
  • fix(server): forward ctx_size to auto-loaded models by @indistinctTalk in #2664
  • feat(vllm): stage AMD Instinct MI300X (gfx942) support (pending release asset) by @ianbmacdonald in #2588
  • feat: make model update checks manual configerable by @fl0rianr in #2659
  • docker: add xz support and validate backend extraction by @fl0rianr in #2671
  • fix(security): harden HTTP redirects by trust boundary by @superm1 in #2634
  • feat(flm): restore validated backend arguments by @fl0rianr in #2677
  • fix(security): replace system() with ProcessManager in archive extrac… by @superm1 in #2627
  • chore: normalize the tree with pre-commit run --all-files by @ianbmacdonald in #2690
  • fix(security): move WebSocket API key from query string to Sec-WebSoc… by @superm1 in #2636
  • fix(process): detect zombie backend processes by @fl0rianr in #2697
  • feat: add modelscope besides huggingface by @fl0rianr in #2647
  • Rename process_unix files to process_linux by @superm1 in #2692

New Contributors

Read more

v10.10.0

Choose a tag to compare

@github-actions github-actions released this 08 Jul 18:17

Headline

  • Audio generation arrives with the ThinkSound sound-effects and ACE-Step music backends, a new POST /v1/audio/generations endpoint, and a GUI audio-generation panel.
  • System-installed ROCm is now reused on Windows as well as Linux, and the experimental vLLM ROCm backend reliably targets AMD GPUs on hybrid AMD/NVIDIA hosts.
  • A suspend inhibitor keeps the machine awake while inference is running on Linux (systemd-logind), enabled by default and opt-out.
  • A new GET /v1/models/{id}/files endpoint reports each model's resolved local files for the GUI Files tab, with absolute paths gated behind an opt-in include_paths=true.

Breaking Changes

  • The experimental ROCm vLLM backend now requires a writable $XDG_RUNTIME_DIR; launch fails if one cannot be created, which may affect minimal or container setups.
  • After the Debian/Ubuntu package upgrade migration runs, re-enable the per-user service manually with systemctl --user enable lemond.

Lemonade Server

Operating System Downloads
Windows lemonade.msi
Ubuntu 24.04+ Launchpad PPA
Debian 13 (x86_64) lemonade-server_10.10.0-debian13_amd64.deb
Debian 13 (ARM64) lemonade-server_10.10.0-debian13_arm64.deb
Fedora 43 (x86_64) lemonade-server-10.10.0-fc43.x86_64.rpm
Fedora 43 (ARM64) lemonade-server-10.10.0-fc43.aarch64.rpm
Fedora 44 (x86_64) lemonade-server-10.10.0-fc44.x86_64.rpm
Fedora 44 (ARM64) lemonade-server-10.10.0-fc44.aarch64.rpm
macOS Lemonade-10.10.0-Darwin.pkg

Other platforms? See our Installation Options for Docker, Snap, Arch, Debian, and more.

Embeddable Lemonade

Portable binaries for bundling into your own installer. Run lemond ./ as a subprocess.

Platform Download
Ubuntu x64 lemonade-embeddable-10.10.0-ubuntu-x64.tar.gz
Ubuntu arm64 lemonade-embeddable-10.10.0-ubuntu-arm64.tar.gz
Windows x64 lemonade-embeddable-10.10.0-windows-x64.zip
macOS arm64 lemonade-embeddable-10.10.0-macos-arm64.tar.gz

What's Changed

Thanks @SlawomirNowaczyk, @abn, @blackdeathdrow, @coolduderules, @eddierichter-amd, @fl0rianr, @jeremyfowers, @kenvandine, @pwilkin, @sofiageo, @superm1, @volen-silo, @wariobot09 for your awesome contributions to this release!

Click to expand changelog
  • feat(rocm): detect externally-installed ROCm on Windows by @volen-silo in #2508
  • Router/2382 RoutingPolicyEngine — assembly + evaluate() (M8) by @SlawomirNowaczyk in #2499
  • docs: add Telemetry guide to mkdocs nav by @jeremyfowers in #2514
  • fix(vLLM): ensures vLLM sees only ROCm devices by @fl0rianr in #2007
  • docs: update arch linux instructions by @sofiageo in #2517
  • fix(installer): add missing architecture_defaults.json to MSI by @blackdeathdrow in #2525
  • fix(app): store Windows favicon as regular file by @fl0rianr in #2526
  • Add support for inhibiting suspend while inference is running by @superm1 in #2515
  • fix: llama.cpp backend updates make sure artifacts are present by @fl0rianr in #2518
  • feat: add model files endpoint by @fl0rianr in #2437
  • docs: cover tests and API docs in adding-a-backend guide by @jeremyfowers in #2541
  • Fix: flaky Whisper realtime transcription event handling by @fl0rianr in #2535
  • Fix disabling systemd user service by @superm1 in #2516
  • fix: support nested schemas and handle client disconnects in responses telemetry by @abn in #2532
  • feat(telemetry): reduce verbosity of telemetry logging by @abn in #2545
  • fix(tray): use /live instead of /api/v1/health for server readiness check by @blackdeathdrow in #2523
  • docs: add two new YouTube videos to news feed by @jeremyfowers in #2534
  • test: relax streaming response length assertions from >5 to >0 by @coolduderules in #2556
  • Router/2383 policy parser hot reload by @eddierichter-amd in #2519
  • fix(router): capture load duration before std::move to prevent null deref by @coolduderules in #2555
  • Enhance contribution guidelines for PR reviews and AI use by @fl0rianr in #2550
  • fix: scan entire install_dir for executable permissions after extraction by @wariobot09 in #2549
  • feat(backends): audio generation — ThinkSound (SFX) + ACE-Step (music) by @pwilkin in #2530
  • feat(router): wire classifier services to router calls by @eddierichter-amd in #2548
  • chore: Version bump v10.10.0 in preparation for release by @kenvandine in #2582

New Contributors

Full Changelog: v10.9.0...v10.10.0


Windows installers are signed. Free code signing provided by SignPath.io, certificate by SignPath Foundation. See our Code Signing Policy.

v10.9.0

Choose a tag to compare

@github-actions github-actions released this 01 Jul 15:12
af311e1

Headline

  • ARM64 (aarch64) Linux packages now ship for Debian, Fedora, the portable embeddable archive, and Docker.
  • Users can set custom system prompts for Lemonade omni models, as demonstrated in the new RPG-HaloTales-V1 narrative experience model.
  • A new OTLP telemetry subsystem exports traces using OpenInference and OpenTelemetry GenAI conventions, driven by a lemonade telemetry command.
  • The vLLM backend now works with Claude Code through the Anthropic Messages API, and adds Qwen3.6 and GLM-4.7-Flash models.

Breaking Changes

  • The Linux system tray is now disabled by default (REQUIRE_LINUX_TRAY=OFF), so Linux server packages ship headless; rebuild with the tray option enabled to restore it.

Lemonade Server

Operating System Downloads
Windows lemonade.msi
Ubuntu 24.04+ Launchpad PPA
Debian 13 (x86_64) lemonade-server_10.9.0-debian13_amd64.deb
Debian 13 (ARM64) lemonade-server_10.9.0-debian13_arm64.deb
Fedora 43 (x86_64) lemonade-server-10.9.0-fc43.x86_64.rpm
Fedora 43 (ARM64) lemonade-server-10.9.0-fc43.aarch64.rpm
Fedora 44 (x86_64) lemonade-server-10.9.0-fc44.x86_64.rpm
Fedora 44 (ARM64) lemonade-server-10.9.0-fc44.aarch64.rpm
macOS Lemonade-10.9.0-Darwin.pkg

Other platforms? See our Installation Options for Docker, Snap, Arch, Debian, and more.

Embeddable Lemonade

Portable binaries for bundling into your own installer. Run lemond ./ as a subprocess.

Platform Download
Ubuntu x64 lemonade-embeddable-10.9.0-ubuntu-x64.tar.gz
Ubuntu arm64 lemonade-embeddable-10.9.0-ubuntu-arm64.tar.gz
Windows x64 lemonade-embeddable-10.9.0-windows-x64.zip
macOS arm64 lemonade-embeddable-10.9.0-macos-arm64.tar.gz

What's Changed

Thanks @GabrielReusRodriguez, @SlawomirNowaczyk, @abn, @bitgamma, @blackdeathdrow, @bong-water-water-bong, @ckuethe, @clemperorpenguin, @eddierichter-amd, @fl0rianr, @gchriswill, @github-actions, @ianbmacdonald, @jeremyfowers, @kenvandine, @lucifer-vali, @ramkrishna2910, @sawansri, @siavashhub, @superm1, @volen-silo for your awesome contributions to this release!

Click to expand changelog
Read more

v10.8.1

Choose a tag to compare

@github-actions github-actions released this 25 Jun 03:32

Headline

  • Speculative decoding now accepts draft/MTP/EAGLE3 checkpoints, with new Gemma-4 MTP models ready to pull.
  • ROCm installation and GPU detection are restored for Radeon RX RDNA2/3/4 dGPUs on Windows and Linux.
  • Backend installs are now crash-safe, with resilient downloads that fall back gracefully when a release lookup or cache snapshot is unavailable.
  • lemonade bench --response-log captures each model's responses and run metadata to a JSONL file for later quality evaluation.
  • The lemonade backends command now lists only supported recipes and backends by default; use lemonade backends --all to see every available option.

Breaking Changes

  • The --model-draft, -md, and --spec-draft-model flags are now reserved for internal speculation-decoding support and can no longer be passed manually through llamacpp_args.

Lemonade Server

Operating System Downloads
Windows lemonade.msi
Ubuntu 24.04+ Launchpad PPA
Debian 13 lemonade-server_10.8.1-debian13_amd64.deb
Fedora 43 lemonade-server-10.8.1-fc43.x86_64.rpm
Fedora 44 lemonade-server-10.8.1-fc44.x86_64.rpm
macOS Lemonade-10.8.1-Darwin.pkg

Other platforms? See our Installation Options for Docker, Snap, Arch, Debian, and more.

Embeddable Lemonade

Portable binaries for bundling into your own installer. Run lemond ./ as a subprocess.

Platform Download
Ubuntu x64 lemonade-embeddable-10.8.1-ubuntu-x64.tar.gz
Windows x64 lemonade-embeddable-10.8.1-windows-x64.zip
macOS arm64 lemonade-embeddable-10.8.1-macos-arm64.tar.gz

What's Changed

Thanks @GabrielReusRodriguez, @Kushal1213, @Phqen1x, @abn, @bitgamma, @blackdeathdrow, @ckuethe, @fl0rianr, @github-actions, @ianbmacdonald, @jeremyfowers, @jtlayton, @kenvandine, @lucifer-vali, @matthewjhunter, @ramkrishna2910, @sagebind, @superm1 for your awesome contributions to this release!

Click to expand changelog
  • ci: support tagging releases from a release branch by @jeremyfowers in #2272
  • ci: add repo-manager workflow by @jeremyfowers in #2276
  • fix(whisper): drop gfx103X from rocm whisper supported archs by @ramkrishna2910 in #2274
  • test(gguf): add unit tests for MTP / capability label detection (#2176) by @ramkrishna2910 in #2281
  • fix(rocm): accept wildcard GPU arch families in TheRock install gate (#2093 follow-up) by @ramkrishna2910 in #2280
  • fix(test): require Whisper model load before language transcription test by @fl0rianr in #2278
  • docs(cli): correct launch note - LEMONADE_* recipe env vars no longer honored by @ramkrishna2910 in #2275
  • ci(repo-manager): automatic repo-manager fully operational by @jeremyfowers in #2285
  • docs(release): update release process for repo-manager automation by @jeremyfowers in #2288
  • fix(ci): restart MacOS server before whisper metal tests by @fl0rianr in #2303
  • auto update and validate sd-cpp by @fl0rianr in #2139
  • fix(macOS): updates whisper from v1.8.4 to v.1.8.5 for metal by @fl0rianr in #2309
  • Fix Problem with .devcontainer. It did not copy .devcontainer/reinstall-cmake.sh when building container by @GabrielReusRodriguez in #2273
  • Add support for additional draft checkpoint by @bitgamma in #2317
  • docs: fix Debian 13 installation docs for issue #2299 by @superm1 in #2323
  • docs: add documentation style guide for community and AI-assisted contributions by @kenvandine in #2054
  • Fix copy-to-clipboard buttons silently failing in web-app over HTTP by @blackdeathdrow in #2260
  • Fix(cli): Lemonade backends now shows only supported backends . Added --all option to show all backends. by @GabrielReusRodriguez in #2254
  • fix(gpu): support wildcards in GPU detection logic by @jtlayton in #2295
  • Fix ROCm whisper-server startup: add TheRock lib dir to LD_LIBRARY_PATH by @matthewjhunter in #2293
  • Capture output from lemonade bench by @ckuethe in #2214
  • fix(windows): use ProcessManager::run_command for 7z extraction instead of system() Fixes #2313 by @Phqen1x in #2322
  • fix(server): fall back to installed llama.cpp binary when "latest" release lookup fails by @ianbmacdonald in #2279
  • fix(moonshine): return 400 on invalid audio by @abn in #2326
  • fix(backends): stage and verify backend install before removing the working binary by @ianbmacdonald in #2315
  • docs: system-stats API by @jeremyfowers in #2284
  • fix: return 400 instead of 500 when request body is empty or not valid JSON by @Kushal1213 in #2232
  • devcontainers - Create the python env and install reqs to allow python test execution by @GabrielReusRodriguez in #2336
  • systemd: add user-service symlink at /usr/lib/systemd/user/ by @lucifer-vali in #2173
  • fix: resolve shared-repo GGUF variants orphaned by refs/main advance by @ianbmacdonald in #2311
  • Fix: eviction_engine does not run nvidia-smi on AMD configs anymore and some testing problems fixed. by @GabrielReusRodriguez in #2331
  • Update stable-diffusion.cpp to master-709-92a3b73 by @github-actions[bot] in #2335
  • Support image[] parameter for /v1/images/edits by @sagebind in #2321
  • Update llama.cpp to b9747 by @github-actions[bot] in #2333
  • Better auto context size estimate by @bitgamma in #2337
  • Version bump to 10.8.1 to prepare for the release by @kenvandine in #2374

New Contributors

Full Changelog: v10.8.0...v10.8.1


Windows installers are signed. Free code signing provided by SignPath.io, certificate by SignPath Foundation. See our Code Signing Policy.

v10.8.0

Choose a tag to compare

@github-actions github-actions released this 17 Jun 18:04

Headline

  • Live model management: auto-unload is available, along with the ability to pin models to prevent eviction.
  • LMX-Omni image generation gains fine-grained parameters, unified collection import/export, and Hugging Face distribution.
  • Cloud offload serves chat completions from any OpenAI-compatible provider alongside local models.
  • New MCP gateway and lemonade launch pi integrations let external tools and agents call local models.
  • Expanded platform support adds Moonshine speech-to-text, NVIDIA GB10 arm64, Debian 13, and ROCm for Radeon GPUs.

Breaking Changes

  • vLLM model IDs renamed from Qwen3.5-*-vLLM to Qwen3.5-*-FP16-vLLM.
  • The --flm-args CLI flag and flm_args API parameter have been removed.
  • Recipe-configuration environment variables have been removed.
  • The legacy GUI collection export bundle format can no longer be imported.
  • The default ctx_size changed from 4096 to -1 (auto-tuned).

Lemonade Server

Operating System Downloads
Windows lemonade.msi
Ubuntu 24.04+ Launchpad PPA
Debian 13 lemonade-server_10.8.0-debian13_amd64.deb
Fedora 43 lemonade-server-10.8.0-fc43.x86_64.rpm
Fedora 44 lemonade-server-10.8.0-fc44.x86_64.rpm
macOS Lemonade-10.8.0-Darwin.pkg

Other platforms? See our Installation Options for Docker, Snap, Arch, Debian, and more.

Embeddable Lemonade

Portable binaries for bundling into your own installer. Run lemond ./ as a subprocess.

Platform Download
Ubuntu x64 lemonade-embeddable-10.8.0-ubuntu-x64.tar.gz
Windows x64 lemonade-embeddable-10.8.0-windows-x64.zip
macOS arm64 lemonade-embeddable-10.8.0-macos-arm64.tar.gz

What's Changed

Thanks @Geramy, @Kushal1213, @abn, @anditherobot, @bitgamma, @blackdeathdrow, @ckuethe, @clemperorpenguin, @fl0rianr, @github-actions, @iswaryaalex, @jeremyfowers, @kenvandine, @neoblizz, @noamsto, @ramkrishna2910, @sawansri, @siavashhub, @superm1, @vgodsoe for your awesome contributions to this release!

Click to expand changelog
Read more

v10.7.0

Choose a tag to compare

@github-actions github-actions released this 10 Jun 14:56
659807f

Headline

  • LMX-Omni models are now supported for any OpenAI API compatible app that can render multimedia output, including Open WebUI and AnythingLLM.
  • The new lemonade bench command provides apples-to-apples LLM benchmarking across llama.cpp, FastFlowLM, vLLM, and Ryzen AI SW.
  • Greatly improved cross-platform compatibility: llama.cpp CUDA support added for Windows and Linux; stable-diffusion.cpp CUDA added for Linux, stable-diffusion.cpp Vulkan added for Windows and Linux.
  • Added a native Prometheus endpoint for real time stats monitoring.

Breaking Changes

  • The deprecated environment variables for lemond configuration have finally been removed, use lemonade config instead.
  • Windows AMD users are highly encouraged to update their Adrenalin driver before generating images.

Lemonade Server

Operating System Downloads
Windows lemonade.msi
Ubuntu 24.04+ Launchpad PPA
Fedora 43 lemonade-server-10.7.0-fc43.x86_64.rpm
Fedora 44 lemonade-server-10.7.0-fc44.x86_64.rpm
macOS Lemonade-10.7.0-Darwin.pkg

Other platforms? See our Installation Options for Docker, Snap, Arch, Debian, and more.

Embeddable Lemonade

Portable binaries for bundling into your own installer. Run lemond ./ as a subprocess.

Platform Download
Ubuntu x64 lemonade-embeddable-10.7.0-ubuntu-x64.tar.gz
Windows x64 lemonade-embeddable-10.7.0-windows-x64.zip
macOS arm64 lemonade-embeddable-10.7.0-macos-arm64.tar.gz

What's Changed

Thanks @Geramy, @clemperorpenguin, @Kushal1213, @Phqen1x, @Storce, @ZaneNi, @anditherobot, @bitgamma, @ckuethe, @fl0rianr, @github-actions, @jeremyfowers, @julianxhokaxhiu, @kenvandine, @kylemanna, @lucifer-vali, @noamsto, @ramkrishna2910, @sawansri, @siavashhub, @superm1 for your awesome contributions to this release!

Click to expand changelog
  • Stop backend archive staging from using shared /tmp during ROCm installs by @Copilot in #1996
  • Add bench command by @bitgamma in #1953
  • Remove more cases of hardcoded /tmp or predictable paths to mitigate … by @superm1 in #1997
  • speech: Avoid duplicate Content-Type headers by @kylemanna in #2005
  • fix: harden local model path finder by @fl0rianr in #1989
  • Add llamacpp:cuda backend for NVIDIA GPUs by @Phqen1x in #1772
  • feat: update FLM version to v0.9.43 by @ZaneNi in #2026
  • fix(kokoro): correct ESPEAK_DATA_PATH construction by @anditherobot in #2025
  • fix: harden markdown link handling against prompt injection by @superm1 in #2016
  • security: fix path traversal in NPU cache download by @superm1 in #2017
  • fix(readme): row arrangement fixed by @fl0rianr in #2023
  • Smooth displayed download speed by @fl0rianr in #1995
  • fix: bump macOS sd.cpp metal version and macOS release number by @Geramy in #2030
  • Add LFM2.5-8B-A1B by @sawansri in #2036
  • Fix downloaded status for multi-checkpoint models by @anditherobot in #2031
  • add instructions to start/enable lemond on Fedora based distros by @lucifer-vali in #2029
  • Correct websockets not to listen on 0.0.0.0 by default by @superm1 in #2034
  • fix(server): translate model names before checking if they are downloaded (#2014) by @anditherobot in #2048
  • Map LEMONADE_WHISPERCPP_VULKAN_{BIN,ARGS} env vars for parity by @noamsto in #2045
  • Link system cpp-httplib portably (header-only friendly) by @noamsto in #2047
  • feat: Add WSL support via librocdxg by @julianxhokaxhiu in #2049
  • Vulkan back-end support for sdcpp by @ckuethe in #2039
  • Update URL for CUDA backend for llama.cpp (llamacpp:cuda) by @Phqen1x in #2011
  • fix: stop refreshing models on download progress by @fl0rianr in #2051
  • Allow LEMONADE_GGML_HIP_PATH to locate the HIP plugin on non-FHS installs by @noamsto in #2044
  • Fix: Adds SHA check on every download by @fl0rianr in #1950
  • Show 3-line descriptions in Marketplace cards by @Copilot in #2069
  • Fix: HF snapshot ref reuse for unchanged model artifacts by @fl0rianr in #2066
  • fix: user model RAM filtering by @fl0rianr in #2067
  • test: give pull multi endpoint test a unique number by @fl0rianr in #2059
  • fix(vLLM): make startup timeout adjustable, increased global_timeout by @fl0rianr in #2004
  • Fix spurious model re-downloads: make client pulls cache-first by default by @jeremyfowers in #2065
  • fix: user model registry writes and stale cache lookups by @fl0rianr in #2064
  • fix(cuda): NVIDIA Blackwell/PRIME detection and CUDA device fixes on Linux by @kenvandine in #2070
  • security: validate URL scheme in openExternal handler by @superm1 in #2019
  • Fix #1959: Replace old Qwen example model in Lemonade API docs by @anditherobot in #2087
  • Add Gemma 4 12B by @sawansri in #2090
  • feat: server-side Omni orchestration for /chat/completions (Open WebUI) by @jeremyfowers in #2071
  • Separate local and available model list output by @anditherobot in #2086
  • Create a set of working groups by @jeremyfowers in #2079
  • CI: Limit distro builds to relevant changes by @fl0rianr in #2104
  • ci: consolidate GitHub-hosted test jobs to reduce download rate limiting by @jeremyfowers in #2105
  • Update llama.cpp to b9518 by @github-actions[bot] in #2101
  • feat: support benchmarking multiple models in a single command by @ckuethe in #2075
  • feat: add CUDA backend support for stable-diffusion.cpp by @Phqen1x in #2062
  • Native Prometheus Metrics Endpoint by @Storce in #1897
  • Auto-label issues and PRs by backend and area by @ramkrishna2910 in #2076
  • ci / test: fix the 409 CI error by @fl0rianr in #2117
  • ci: set HF_HOME before starting hosted Linux server by @fl0rianr in #2116
  • test: add coverage for GET /v1/pull/variants (4 paths) by @Kushal1213 in #2096
  • Drop all environment variable migration code by @superm1 in #2106
  • Add Debian 13 to NPU installation instructions by @superm1 in #2114
  • Remove pointless comments from codebase by @superm1 in #2133
  • Update llama.cpp to b9550 by @github-actions[bot] in #2132
  • fix(security): prevent path traversal in /web-app/ route by @superm1 in #2084
  • test: retry transient model pull setup failures by @fl0rianr in #2123
  • feat: add Linux ARM64 CPU and Vulkan llamacpp backend support by @kenvandine in #2081
  • ...
Read more

v10.6.0

Choose a tag to compare

@github-actions github-actions released this 21 May 20:05
7af26f7

Headline

  • Lemonade's true omni-modal features have gotten a glow-up!
  • LMX-Omni-52B-Halo and LMX-Omni-5.5B-Lite replace the old "collections".
  • Add your own custom omni models in the GUI or CLI.
  • Downloading custom models have been improved with auto-detected sizes, labels, and improved download robustness.

Lemonade Server

Operating System Downloads
Windows lemonade.msi
Ubuntu 24.04+ Launchpad PPA
Fedora 43 lemonade-server-10.6.0-fc43.x86_64.rpm
Fedora 44 lemonade-server-10.6.0-fc44.x86_64.rpm
macOS Lemonade-10.6.0-Darwin.pkg

Other platforms? See our Installation Options for Docker, Snap, Arch, Debian, and more.

Embeddable Lemonade

Portable binaries for bundling into your own installer. Run lemond ./ as a subprocess.

Platform Download
Ubuntu x64 lemonade-embeddable-10.6.0-ubuntu-x64.tar.gz
Windows x64 lemonade-embeddable-10.6.0-windows-x64.zip
macOS arm64 lemonade-embeddable-10.6.0-macos-arm64.tar.gz

What's Changed

Thanks @Geramy, @abn, @fl0rianr, @github-actions, @jeremyfowers, @neubig, @sofiageo, @superm1 for your awesome contributions to this release!

Click to expand changelog
  • fix(sd-cpp): update macOS metal asset filename by @Geramy in #1949
  • Fix : Add 'vision' label to Qwen MTP models by @fl0rianr in #1952
  • d/copyright: Update licensing by @superm1 in #1955
  • Preserve backend error status by @neubig in #1933
  • fix(download manager): restore model download state across renderer r… by @fl0rianr in #1948
  • Add a tool for updating model sizes by @jeremyfowers in #1962
  • packaging: Linux systemd/sysusers compliance for downstream distros by @abn in #1954
  • Register lemonade:// scheme handler in app desktop entry by @abn in #1957
  • fix(app): normalize cleared server base URL to localhost mode by @fl0rianr in #1961
  • fix(app): don't skip port discovery when no explicit base URL is set by @abn in #1956
  • Enable custom user collections via /pull by @jeremyfowers in #1842
  • fix: custom models documentation link by @sofiageo in #1972
  • Improve download UX and correctness by @fl0rianr in #1764
  • Update llama.cpp to b9253 by @github-actions[bot] in #1975
  • Feat : Add UI options for custom Omni Models by @fl0rianr in #1769
  • Rebrand OmniRouter to Lemonade Omni by @jeremyfowers in #1973
  • fix: missing file size in custom models by @sofiageo in #1888
  • feat: added GGUF auto labeling for tools and vision by @fl0rianr in #1983
  • Rev the version number to v10.6.0 by @jeremyfowers in #1982
  • fix: emit collection components under public model names by @jeremyfowers in #1985

New Contributors

Full Changelog: v10.5.1...v10.6.0


Windows installers are signed. Free code signing provided by SignPath.io, certificate by SignPath Foundation. See our Code Signing Policy.

v10.5.1

Choose a tag to compare

@github-actions github-actions released this 18 May 20:37

Headline

  • MTP support added for up to 2x performance increase on supported models.
  • Fedora 43 support restored.
  • Set model load args on a per-backend basis.

Lemonade Server

Operating System Downloads
Windows lemonade.msi
Ubuntu 24.04+ Launchpad PPA
Fedora 43 lemonade-server-10.5.1-fc43.x86_64.rpm
Fedora 44 lemonade-server-10.5.1-fc44.x86_64.rpm
macOS Lemonade-10.5.1-Darwin.pkg

Other platforms? See our Installation Options for Docker, Snap, Arch, Debian, and more.

Embeddable Lemonade

Portable binaries for bundling into your own installer. Run lemond ./ as a subprocess.

Platform Download
Ubuntu x64 lemonade-embeddable-10.5.1-ubuntu-x64.tar.gz
Windows x64 lemonade-embeddable-10.5.1-windows-x64.zip
macOS arm64 lemonade-embeddable-10.5.1-macos-arm64.tar.gz

What's Changed

Thanks @bitgamma, @dmitrii-galantsev, @fl0rianr, @github-actions, @jeremyfowers, @kpoineal, @lucifer-vali, @seii, @sofiageo, @superm1 for your awesome contributions to this release!

Click to expand changelog

New Contributors

Full Changelog: v10.5.0...v10.5.1


Windows installers are signed. Free code signing provided by SignPath.io, certificate by SignPath Foundation. See our Code Signing Policy.