Releases: lemonade-sdk/lemonade
Release list
v11.5.1
Headline
lemonade benchadds an image-generation benchmark mode with capability-aware scenario and model filtering, response capture, and a new--timeoutflag.- The Router Builder gains a Test Prompt tab, backed by a new
POST /routing/validateendpoint, that runs a routing policy against a sample prompt and shows the decision, a step-by-step trace, and a decision-tree view. - Ten MiniCPM text and vision GGUF models from ModelScope join the built-in llama.cpp catalog.
- Tool-calling requests to llama.cpp with large JSON schema bounds are now accepted, working around a grammar limit that previously rejected valid tool calls.
Breaking Changes
- llama.cpp non-streaming responses now return the requested or registered model id in the
modelfield instead of the local.ggufabsolute path. - Registered and imported collections (
user.*/extra.*) now list under their canonical prefixed id on/v1/models, Ollama/api/tags, and MCPlemonade_list_models. autobackend selection now prefers Vulkan on AMD systems across all engines, matching the llamacpp behavior.
Lemonade Server
| Operating System | Downloads |
|---|---|
| Windows | lemonade.msi |
| Ubuntu 24.04+ | Launchpad PPA |
| Debian 13 (x86_64) | lemonade-server_11.5.1-debian13_amd64.deb |
| Debian 13 (ARM64) | lemonade-server_11.5.1-debian13_arm64.deb |
| Fedora 43 (x86_64) | lemonade-server-11.5.1-fc43.x86_64.rpm |
| Fedora 43 (ARM64) | lemonade-server-11.5.1-fc43.aarch64.rpm |
| Fedora 44 (x86_64) | lemonade-server-11.5.1-fc44.x86_64.rpm |
| Fedora 44 (ARM64) | lemonade-server-11.5.1-fc44.aarch64.rpm |
| macOS | Lemonade-11.5.1-Darwin.pkg |
Other platforms? See our Installation Options for Docker, Snap, Arch, Debian, and more.
Embeddable Lemonade
Portable binaries for bundling into your own installer. Run lemond ./ as a subprocess.
| Platform | Download |
|---|---|
| Ubuntu x64 | lemonade-embeddable-11.5.1-ubuntu-x64.tar.gz |
| Ubuntu arm64 | lemonade-embeddable-11.5.1-ubuntu-arm64.tar.gz |
| Windows x64 | lemonade-embeddable-11.5.1-windows-x64.zip |
| macOS arm64 | lemonade-embeddable-11.5.1-macos-arm64.tar.gz |
What's Changed
Thanks @QuMuzafferEge, @QuTosh, @SlawomirNowaczyk, @ZMXJJ, @abn, @ckuethe, @coolduderules, @fl0rianr, @jeremyfowers, @kenvandine, @ramkrishna2910, @sujikathir, @superm1 for your awesome contributions to this release!
Click to expand changelog
- Update trellis checksums to the pinned v0.4.3 assets by @ramkrishna2910 in #2778
- web: community links in navbar hamburger + homepage hero by @jeremyfowers in #2784
- Bench imagegen by @ckuethe in #2683
- Add libgomp runtime dependency to deb/rpm packages by @kenvandine in #2794
- Fix: Repeated model update reports after pull by @fl0rianr in #2715
- [Router] Fix DirectoryWatcher missing policy delete+rewrite on Windows by @SlawomirNowaczyk in #2798
- Fix llama.cpp model field echoing local .gguf path by @SlawomirNowaczyk in #2796
- Add JSON schema checking to pre-commit by @superm1 in #2802
- fix(cli): parse configuration values as JSON arrays and objects by @abn in #2816
- Fix JSON pre-commit validation with permissive schema by @superm1 with @Copilot in #2810
- fix(http): add libcurl protocol fallback for macOS libcurl compatibility by @abn in #2806
- fix(custom_args): treat negative numbers as values, not flags by @coolduderules in #2773
- Issue 2651: Router Prompt Debugger (Ege Qutwo) by @QuMuzafferEge in #2726
- Add conformance tests (phase 1: deterministic) by @QuTosh in #2761
- Fix: list router/collection ids with their
user./extra.prefix inGET /v1/modelsby @SlawomirNowaczyk in #2797 - Add ModelScope registry search blog post by @ramkrishna2910 in #2828
- Add MiniCPM GGUF models to catalog by @ZMXJJ in #2825
- fix(server): preserve WebSocket auth state and support desktop client origins by @abn in #2790
- Fix Whisper realtime test isolation and stale session work by @fl0rianr in #2821
- docs(telemetry): improve telemetry and arize phoenix setup guide by @abn in #2817
- fix(llamacpp): sanitize oversized tool schema limits by @sujikathir in #2807
- fix(ci): job-isolated process cleanups and fast installer teardowns by @abn in #2643
- Apply a canonical backend preference order to all descriptors by @jeremyfowers in #2835
- wg: Add an Enterprise Grade working group and archive Omni Models by @jeremyfowers in #2812
- Bump project version from 11.5.0 to 11.5.1 by @jeremyfowers in #2849
- Update flm NPU version to v0.9.46 by @jeremyfowers in #2847
- fix(installer): handle slow tarball listings by @sujikathir in #2830
New Contributors
- @QuMuzafferEge made their first contribution in #2726
- @QuTosh made their first contribution in #2761
- @ZMXJJ made their first contribution in #2825
- @sujikathir made their first contribution in #2807
Full Changelog: v11.5.0...v11.5.1
Windows installers are signed. Free code signing provided by SignPath.io, certificate by SignPath Foundation. See our Code Signing Policy.
v11.5.0
Headline
- The Lemonade Router is complete: name a
collection.routermodel and requests are steered by rule, classifier, semantic-similarity, or LLM-as-router policies, with per-candidate decision traces, a GUI for authoring and editing routers, and aPOST /v1/classifytext-classification endpoint backed by a new onnxruntime backend. - ModelScope is now searchable alongside Hugging Face in the Model Manager, with source-aware model discovery, download, and registration.
- A server-side job engine lets clients post multi-step recipes and manage them through
/jobsendpoints, with pause, interrupt, resume, and delete lifecycle control. lemondcan act as an MCP client host, connecting to external stdio MCP servers and discovering their tools through admin-gated/internal/mcp/*endpoints.- The
lemonadeCLI now supports HTTPS/TLS connections to secure remote endpoints, honoringhttp(s)://schemes inLEMONADE_HOST.
Breaking Changes
- The server no longer sends
Access-Control-Allow-Origin: *by default: non-loopback browser origins are now rejected with 403 unless listed inLEMONADE_ALLOWED_ORIGINS, and the WebSocket same-origin fallback has been removed. Remote or LAN browser clients must setLEMONADE_ALLOWED_ORIGINS.
Lemonade Server
| Operating System | Downloads |
|---|---|
| Windows | lemonade.msi |
| Ubuntu 24.04+ | Launchpad PPA |
| Debian 13 (x86_64) | lemonade-server_11.5.0-debian13_amd64.deb |
| Debian 13 (ARM64) | lemonade-server_11.5.0-debian13_arm64.deb |
| Fedora 43 (x86_64) | lemonade-server-11.5.0-fc43.x86_64.rpm |
| Fedora 43 (ARM64) | lemonade-server-11.5.0-fc43.aarch64.rpm |
| Fedora 44 (x86_64) | lemonade-server-11.5.0-fc44.x86_64.rpm |
| Fedora 44 (ARM64) | lemonade-server-11.5.0-fc44.aarch64.rpm |
| macOS | Lemonade-11.5.0-Darwin.pkg |
Other platforms? See our Installation Options for Docker, Snap, Arch, Debian, and more.
Embeddable Lemonade
Portable binaries for bundling into your own installer. Run lemond ./ as a subprocess.
| Platform | Download |
|---|---|
| Ubuntu x64 | lemonade-embeddable-11.5.0-ubuntu-x64.tar.gz |
| Ubuntu arm64 | lemonade-embeddable-11.5.0-ubuntu-arm64.tar.gz |
| Windows x64 | lemonade-embeddable-11.5.0-windows-x64.zip |
| macOS arm64 | lemonade-embeddable-11.5.0-macos-arm64.tar.gz |
What's Changed
Thanks @OussamaBATOUCHE, @QuManu, @SlawomirNowaczyk, @abn, @ckopanos, @ekkoitac, @fl0rianr, @jon-hotaisle, @kenvandine, @kyuubyN, @meghsat, @midu16, @pwilkin, @radhaksri, @ramkrishna2910, @superm1, @therealjuanmartinez for your awesome contributions to this release!
Click to expand changelog
- Update version to prepare for release by @superm1 in #2702
- fix(security): pin SHA-256 checksums for contributor-hosted backend assets by @superm1 in #2710
- fix(ci): always run macOS C++ unit tests regardless of signing by @superm1 in #2712
- docs (fix): typo in readme by @jon-hotaisle in #2701
- feat(router): onnxruntime classification backend + /v1/classify (capability for #2592; policy wiring in #2384) by @ramkrishna2910 in #2626
- Fix: re-pulling a
collection.routermodel fails with "unknown key 'source'" by @SlawomirNowaczyk in #2703 - feat: add Modelscope search by @fl0rianr in #2716
- fix(websocket): allow Windows Tauri WebView2 origin for upgrades by @superm1 in #2721
- fix: quote /MANIFESTINPUT path and detect RX 7600 as gfx110X by @kyuubyN in #2678
- Add server-side MCP client host foundation by @fl0rianr in #2605
- fix(docker): Add libreadline8 to Dockerfile dependencies by @ckopanos in #2733
- fix(security): apply HTTP trust policies to POST request paths by @fl0rianr in #2741
- feat: job engine by @pwilkin in #2718
- Keep sd-cpp validation images out of auto-update PRs by @fl0rianr in #2502
- feat(server): support PNA CORS, custom allowed origins, and custom headers by @abn in #2660
- feat(cli): add native HTTPS/TLS and URL scheme parsing support by @abn in #2373
- feat(trellis): per-request UV atlas method, bump trellis to v0.4.3 by @pwilkin in #2667
- fix(docker): include build-essential in runtime stage for vLLM Triton… by @midu16 in #2749
- Wire collection.router classifiers to Router::classify + validate model capability at parse time by @QuManu in #2727
- [Router] llm router classifier + routing.router desugaring (#2405) by @OussamaBATOUCHE in #2698
- Support gfx950, using the same path as gfx942 by @SlawomirNowaczyk in #2687
- feat(telemetry): honor incoming W3C traceparent (opt-in) by @radhaksri in #2734
- [Router] [UI] Author collection.router in the custom-collection panel (#2406) by @meghsat in #2693
- Router end-to-end demo, integration test, and docs (#2388) by @ramkrishna2910 in #2732
- fix(router): isolate routing helpers from standard model LRU slots by @fl0rianr in #2729
- Update version to 11.5.0 by @ramkrishna2910 in #2772
- fix: detect Arch ggml HIP plugin paths by @ekkoitac in #2760
- api: expose is_busy and is_streaming flags in /health response by @therealjuanmartinez in #2720
- Fix arm64 PPA packages missing bundled web UI by @kenvandine in #2770
- fix: resolve CORS blockage on MCP Gateway Endpoint by @abn in #2771
New Contributors
- @jon-hotaisle made their first contribution in #2701
- @ckopanos made their first contribution in #2733
- @midu16 made their first contribution in #2749
- @QuManu made their first contribution in #2727
- @OussamaBATOUCHE made their first contribution in #2698
- @radhaksri made their first contribution in #2734
- @ekkoitac made their first contribution in #2760
- @therealjuanmartinez made their first contribution in #2720
Full Changelog: v11.0.0...v11.5.0
Windows installers are signed. Free code signing provided by SignPath.io, certificate by SignPath Foundation. See our Code Signing Policy.
Router Milestone Contributors
The Lemonade Router shipped across v11.0.0 and v11.5.0 (17 PRs). PR authors: @eddierichter-amd, @SlawomirNowaczyk, @ramkrishna2910, @OussamaBATOUCHE, @QuManu, @meghsat, @fl0rianr, @coolduderules. Reviewers: @fl0rianr, @SlawomirNowaczyk, @eddierichter-amd, @ramkrishna2910, @meghsat, @superm1, @bong-water-water-bong.
v11.0.0
Headline
- A new 3D-generation modality ports the Trellis.2 image-to-3D pipeline, exposing a
POST /v1/3d/generationsendpoint and a GUI 3D panel with an in-app model viewer. - Text-to-speech arrives with the OpenMOSS backend, including voice-cloning and voice-design models and a dedicated TTS panel in the GUI.
- Naming a
collection.routermodel on/chat/completions,/completions, or/responsesnow runs its routing engine and reports the selected route via anx_lemonade_routebody field andx-lemonade-routeheader. - ModelScope is now supported as a second remote model registry alongside Hugging Face, with source selection across the CLI, API, and desktop app.
- The FastFlowLM NPU backend now auto-installs on Linux instead of requiring a manual system-package install, with a new
prefer_systemconfig flag.
Breaking Changes
- The Docker runtime image now runs
lemondas unprivileged UID 10001 and stores caches under/opt/lemonade/.cacheinstead of/root/.cache; chown or recreate existing root-owned named volumes. - Re-registering a Hugging Face user model under a name already used by a different checkpoint now returns an error instead of silently overwriting the existing
user.*model; choose a different name.
Lemonade Server
| Operating System | Downloads |
|---|---|
| Windows | lemonade.msi |
| Ubuntu 24.04+ | Launchpad PPA |
| Debian 13 (x86_64) | lemonade-server_11.0.0-debian13_amd64.deb |
| Debian 13 (ARM64) | lemonade-server_11.0.0-debian13_arm64.deb |
| Fedora 43 (x86_64) | lemonade-server-11.0.0-fc43.x86_64.rpm |
| Fedora 43 (ARM64) | lemonade-server-11.0.0-fc43.aarch64.rpm |
| Fedora 44 (x86_64) | lemonade-server-11.0.0-fc44.x86_64.rpm |
| Fedora 44 (ARM64) | lemonade-server-11.0.0-fc44.aarch64.rpm |
| macOS | Lemonade-11.0.0-Darwin.pkg |
Other platforms? See our Installation Options for Docker, Snap, Arch, Debian, and more.
Embeddable Lemonade
Portable binaries for bundling into your own installer. Run lemond ./ as a subprocess.
| Platform | Download |
|---|---|
| Ubuntu x64 | lemonade-embeddable-11.0.0-ubuntu-x64.tar.gz |
| Ubuntu arm64 | lemonade-embeddable-11.0.0-ubuntu-arm64.tar.gz |
| Windows x64 | lemonade-embeddable-11.0.0-windows-x64.zip |
| macOS arm64 | lemonade-embeddable-11.0.0-macos-arm64.tar.gz |
What's Changed
Thanks @SlawomirNowaczyk, @abn, @ckuethe, @eddierichter-amd, @fl0rianr, @ianbmacdonald, @indistinctTalk, @kenvandine, @kyuubyN, @pwilkin, @ramkrishna2910, @superm1, @wariobot09 for your awesome contributions to this release!
Click to expand changelog
- Update FLM to 0.9.44 and enable portable FLM for Linux by @superm1 in #2544
- dev: change base image to Ubuntu 24.04 in Dockerfile by @fl0rianr in #2578
- fix(server): replace dummy bind with connect check for port availability by @abn in #2576
- Router/2385 collection.router recipe dispatch by @SlawomirNowaczyk in #2558
- feat(telemetry): add WebSocket server endpoint and security controls by @abn in #2574
- feat(rocm): enable AMD Instinct MI300X (gfx942) in the llama.cpp ROCm backend by @ianbmacdonald in #2587
- Asset generation: OpenMOSS by @pwilkin in #2580
- Start an abstraction layer for benchmark types by @ckuethe in #2557
- Asset generation: Trellis by @pwilkin in #2581
- fix(backends): enable sd-cpp CUDA support on Windows by @kenvandine in #2601
- refactor(audio-gen): apply backend review feedback to ThinkSound and ACE-Step by @pwilkin in #2594
- fix(rocm): detect version-suffixed HIP runtime on Windows (ROCm 7.x) by @ramkrishna2910 in #2603
- Router/2386 decision trace response by @eddierichter-amd in #2606
- fix(docker): drop to non-root user and remove unverified FLM download by @superm1 in #2617
- fix(llamacpp): detect HIP plugin next to PATH-resolved llama-server by @pwilkin in #2628
- fix: model update startup behavior in offline mode by @fl0rianr in #2612
- fix(server): size HTTP thread pool from CPU count and add socket time… by @superm1 in #2618
- log: reduce verbosity of model already loaded and websocket connection logs by @abn in #2599
- Bench embed by @ckuethe in #2577
- fix(auto-label): refactor community user checks to exclude bots by @fl0rianr in #2479
- security: pin FetchContent deps to commit SHAs by @superm1 in #2633
- fix: avoid HF user model name collisions act only when they occur by @fl0rianr in #2058
- security(renderer): redact API key values from console logs by @superm1 in #2632
- fix(acestep): music without lyrics isn't the greatest by @pwilkin in #2629
- fix: handle AMD APU memory pressure correctly by @fl0rianr in #2638
- chore(ci): parallelize link checking, headless setup flags, and documentation link fixes by @abn in #2646
- chore(ci): enable package caching and ccache on distro builds by @abn in #2645
- fix: readme and gen_backend_boilerplate by @fl0rianr in #2658
- ci: add safe AMD64 and ARM64 container validation by @fl0rianr in #2637
- Feat/dxgi use native DXGI QueryVideoMemoryInfo for Windows VRAM pressure by @kyuubyN in #2648
- chore: bump FLM to v0.9.45 by @wariobot09 in #2661
- fix: bump openmoss to v0.1.3 (fixes progressive audio degradation past 10 s) by @pwilkin in #2666
- fix(server): forward ctx_size to auto-loaded models by @indistinctTalk in #2664
- feat(vllm): stage AMD Instinct MI300X (gfx942) support (pending release asset) by @ianbmacdonald in #2588
- feat: make model update checks manual configerable by @fl0rianr in #2659
- docker: add xz support and validate backend extraction by @fl0rianr in #2671
- fix(security): harden HTTP redirects by trust boundary by @superm1 in #2634
- feat(flm): restore validated backend arguments by @fl0rianr in #2677
- fix(security): replace system() with ProcessManager in archive extrac… by @superm1 in #2627
- chore: normalize the tree with pre-commit run --all-files by @ianbmacdonald in #2690
- fix(security): move WebSocket API key from query string to Sec-WebSoc… by @superm1 in #2636
- fix(process): detect zombie backend processes by @fl0rianr in #2697
- feat: add modelscope besides huggingface by @fl0rianr in #2647
- Rename process_unix files to process_linux by @superm1 in #2692
New Contributors
- @kyuubyN made their first contribution in https://github.com/lemonade-sdk/lemonade/pull/...
v10.10.0
Headline
- Audio generation arrives with the ThinkSound sound-effects and ACE-Step music backends, a new
POST /v1/audio/generationsendpoint, and a GUI audio-generation panel. - System-installed ROCm is now reused on Windows as well as Linux, and the experimental vLLM ROCm backend reliably targets AMD GPUs on hybrid AMD/NVIDIA hosts.
- A suspend inhibitor keeps the machine awake while inference is running on Linux (systemd-logind), enabled by default and opt-out.
- A new
GET /v1/models/{id}/filesendpoint reports each model's resolved local files for the GUI Files tab, with absolute paths gated behind an opt-ininclude_paths=true.
Breaking Changes
- The experimental ROCm vLLM backend now requires a writable
$XDG_RUNTIME_DIR; launch fails if one cannot be created, which may affect minimal or container setups. - After the Debian/Ubuntu package upgrade migration runs, re-enable the per-user service manually with
systemctl --user enable lemond.
Lemonade Server
| Operating System | Downloads |
|---|---|
| Windows | lemonade.msi |
| Ubuntu 24.04+ | Launchpad PPA |
| Debian 13 (x86_64) | lemonade-server_10.10.0-debian13_amd64.deb |
| Debian 13 (ARM64) | lemonade-server_10.10.0-debian13_arm64.deb |
| Fedora 43 (x86_64) | lemonade-server-10.10.0-fc43.x86_64.rpm |
| Fedora 43 (ARM64) | lemonade-server-10.10.0-fc43.aarch64.rpm |
| Fedora 44 (x86_64) | lemonade-server-10.10.0-fc44.x86_64.rpm |
| Fedora 44 (ARM64) | lemonade-server-10.10.0-fc44.aarch64.rpm |
| macOS | Lemonade-10.10.0-Darwin.pkg |
Other platforms? See our Installation Options for Docker, Snap, Arch, Debian, and more.
Embeddable Lemonade
Portable binaries for bundling into your own installer. Run lemond ./ as a subprocess.
| Platform | Download |
|---|---|
| Ubuntu x64 | lemonade-embeddable-10.10.0-ubuntu-x64.tar.gz |
| Ubuntu arm64 | lemonade-embeddable-10.10.0-ubuntu-arm64.tar.gz |
| Windows x64 | lemonade-embeddable-10.10.0-windows-x64.zip |
| macOS arm64 | lemonade-embeddable-10.10.0-macos-arm64.tar.gz |
What's Changed
Thanks @SlawomirNowaczyk, @abn, @blackdeathdrow, @coolduderules, @eddierichter-amd, @fl0rianr, @jeremyfowers, @kenvandine, @pwilkin, @sofiageo, @superm1, @volen-silo, @wariobot09 for your awesome contributions to this release!
Click to expand changelog
- feat(rocm): detect externally-installed ROCm on Windows by @volen-silo in #2508
- Router/2382 RoutingPolicyEngine — assembly + evaluate() (M8) by @SlawomirNowaczyk in #2499
- docs: add Telemetry guide to mkdocs nav by @jeremyfowers in #2514
- fix(vLLM): ensures vLLM sees only ROCm devices by @fl0rianr in #2007
- docs: update arch linux instructions by @sofiageo in #2517
- fix(installer): add missing architecture_defaults.json to MSI by @blackdeathdrow in #2525
- fix(app): store Windows favicon as regular file by @fl0rianr in #2526
- Add support for inhibiting suspend while inference is running by @superm1 in #2515
- fix: llama.cpp backend updates make sure artifacts are present by @fl0rianr in #2518
- feat: add model files endpoint by @fl0rianr in #2437
- docs: cover tests and API docs in adding-a-backend guide by @jeremyfowers in #2541
- Fix: flaky Whisper realtime transcription event handling by @fl0rianr in #2535
- Fix disabling systemd user service by @superm1 in #2516
- fix: support nested schemas and handle client disconnects in responses telemetry by @abn in #2532
- feat(telemetry): reduce verbosity of telemetry logging by @abn in #2545
- fix(tray): use /live instead of /api/v1/health for server readiness check by @blackdeathdrow in #2523
- docs: add two new YouTube videos to news feed by @jeremyfowers in #2534
- test: relax streaming response length assertions from >5 to >0 by @coolduderules in #2556
- Router/2383 policy parser hot reload by @eddierichter-amd in #2519
- fix(router): capture load duration before std::move to prevent null deref by @coolduderules in #2555
- Enhance contribution guidelines for PR reviews and AI use by @fl0rianr in #2550
- fix: scan entire install_dir for executable permissions after extraction by @wariobot09 in #2549
- feat(backends): audio generation — ThinkSound (SFX) + ACE-Step (music) by @pwilkin in #2530
- feat(router): wire classifier services to router calls by @eddierichter-amd in #2548
- chore: Version bump v10.10.0 in preparation for release by @kenvandine in #2582
New Contributors
- @coolduderules made their first contribution in #2556
- @wariobot09 made their first contribution in #2549
Full Changelog: v10.9.0...v10.10.0
Windows installers are signed. Free code signing provided by SignPath.io, certificate by SignPath Foundation. See our Code Signing Policy.
v10.9.0
Headline
- ARM64 (aarch64) Linux packages now ship for Debian, Fedora, the portable embeddable archive, and Docker.
- Users can set custom system prompts for Lemonade omni models, as demonstrated in the new RPG-HaloTales-V1 narrative experience model.
- A new OTLP telemetry subsystem exports traces using OpenInference and OpenTelemetry GenAI conventions, driven by a
lemonade telemetrycommand. - The vLLM backend now works with Claude Code through the Anthropic Messages API, and adds Qwen3.6 and GLM-4.7-Flash models.
Breaking Changes
- The Linux system tray is now disabled by default (
REQUIRE_LINUX_TRAY=OFF), so Linux server packages ship headless; rebuild with the tray option enabled to restore it.
Lemonade Server
| Operating System | Downloads |
|---|---|
| Windows | lemonade.msi |
| Ubuntu 24.04+ | Launchpad PPA |
| Debian 13 (x86_64) | lemonade-server_10.9.0-debian13_amd64.deb |
| Debian 13 (ARM64) | lemonade-server_10.9.0-debian13_arm64.deb |
| Fedora 43 (x86_64) | lemonade-server-10.9.0-fc43.x86_64.rpm |
| Fedora 43 (ARM64) | lemonade-server-10.9.0-fc43.aarch64.rpm |
| Fedora 44 (x86_64) | lemonade-server-10.9.0-fc44.x86_64.rpm |
| Fedora 44 (ARM64) | lemonade-server-10.9.0-fc44.aarch64.rpm |
| macOS | Lemonade-10.9.0-Darwin.pkg |
Other platforms? See our Installation Options for Docker, Snap, Arch, Debian, and more.
Embeddable Lemonade
Portable binaries for bundling into your own installer. Run lemond ./ as a subprocess.
| Platform | Download |
|---|---|
| Ubuntu x64 | lemonade-embeddable-10.9.0-ubuntu-x64.tar.gz |
| Ubuntu arm64 | lemonade-embeddable-10.9.0-ubuntu-arm64.tar.gz |
| Windows x64 | lemonade-embeddable-10.9.0-windows-x64.zip |
| macOS arm64 | lemonade-embeddable-10.9.0-macos-arm64.tar.gz |
What's Changed
Thanks @GabrielReusRodriguez, @SlawomirNowaczyk, @abn, @bitgamma, @blackdeathdrow, @bong-water-water-bong, @ckuethe, @clemperorpenguin, @eddierichter-amd, @fl0rianr, @gchriswill, @github-actions, @ianbmacdonald, @jeremyfowers, @kenvandine, @lucifer-vali, @ramkrishna2910, @sawansri, @siavashhub, @superm1, @volen-silo for your awesome contributions to this release!
Click to expand changelog
- fix(packaging): don't auto-enable the per-user lemond.service (Closes #2125) by @ianbmacdonald in #2354
- fix(config): accept flat backend keys like vllm_args in config set (#1824) by @ramkrishna2910 in #2394
- test/ci: harden CLI endpoint suites against shared-server flakes by @fl0rianr in #2365
- Lemonade cli list models with size in Gb by @GabrielReusRodriguez in #2329
- Handle separate sd-cpp CUDA release pins by @fl0rianr in #2369
- fix: refuse to start a second lemond when the port is already in use (#2255) by @siavashhub in #2258
- Fix sd-cpp:metal install (resolve asset filename wildcard) by @jeremyfowers in #2402
- Allow HTTP custom backends with warnings by @sawansri in #2370
- Add comment and PR description guidelines to AGENTS.md by @superm1 in #2409
- [Router] Interfaces + fixtures stub (foundation) by @ramkrishna2910 in #2408
- fix: Prevent the Rosetta prompt on macOS installation by @clemperorpenguin in #2297
- fix(cli): resolve option inheritance bug in launch help options by @abn in #2396
- Move omni collection system prompt to per-model JSON by @ramkrishna2910 in #2395
- fix: ROCm Support for RDNA2 Device Models by @gchriswill in #2410
- feat: expand system stats with storage infos by @fl0rianr in #2436
- test: fix whisper realtime macOS VAD flake by @abn in #2442
- test: fix stale docstring and add VAD rationale comment by @bong-water-water-bong in #2447
- feat(telemetry): add unified OTLP telemetry with OpenInference and OpenTelemetry GenAI support by @abn in #2330
- Router/2378 2379 evaluator registry by @eddierichter-amd in #2440
- test/ci: follow up on hosted Ollama tool-calling timeouts by @fl0rianr in #2399
- website: Overhaul the front page by @jeremyfowers in #2427
- refactor(backends): self-describing WrappedServer backends (#2287) by @jeremyfowers in #2320
- Fix startup self-deadlock with a thread-local recursion guard (minimal alt to #2443) by @jeremyfowers in #2488
- fix(launch): resolve npm .cmd launcher on Windows for pi and codex by @jeremyfowers in #2489
- Fix three broken doc links found by zensical by @lucifer-vali in #2486
- Enable vLLM + Messages API and per model family vLLM args by @sawansri in #2143
- [Router] 2381 unified interface for semantic_similarity and model classifier by @SlawomirNowaczyk in #2483
- Fix flaky Ollama tool-calling CI by disabling default thinking for tool requests by @fl0rianr in #2485
- Merge release-v10.8.1 back to main for proper release tag handling by @kenvandine in #2493
- fix(backends): fallback to installed backend when offline by @fl0rianr in #2393
- Fix (#2412) : Added offline check before pulling a model on server.cpp by @GabrielReusRodriguez in #2434
- Add arm64 builds to all Linux release packages and PPA by @kenvandine in #2430
- fix(rocm): resolve backend assets to published gfx family names (#2415) by @superm1 in #2490
- Add lemonade and lemond options to bug report template by @ckuethe in #2444
- add per-architecture options by @bitgamma in #2496
- Publish rolling :edge and immutable :sha- container images on merge to main by @siavashhub in #2397
- Detect externally-installed ROCm before downloading TheRock by @volen-silo in #2498
- docs(release): add step to reconcile release tag into main by @jeremyfowers in #2504
- fix(server): recover stalled HF model downloads by @fl0rianr in #2421
- [Router] Deterministic conditions: keywords / regex / min_chars / has_* / metadata (M4, #2380) by @ramkrishna2910 in #2491
- fix(packaging): strip lemonade-tray from RPM by @lucifer-vali in #2484
- Update stable-diffusion.cpp to master-721-8caa3f9 and CUDA master-726-db48014 by @github-actions[bot] in #2477
- feat: detect HuggingFace model updates and show Update button in web UI by @blackdeathdrow in #2243
- docs: list ARM64 Linux release artifacts left out by #2430 by @jeremyfowers in #2505
- chore(release): bump version to v10.9.0 by @jeremyfowers in #2506
- feat(models): add RPG-HaloTales-V1 omni collection by @jeremyfowers in https://github.com/lemonade-sdk/le...
v10.8.1
Headline
- Speculative decoding now accepts draft/MTP/EAGLE3 checkpoints, with new Gemma-4 MTP models ready to pull.
- ROCm installation and GPU detection are restored for Radeon RX RDNA2/3/4 dGPUs on Windows and Linux.
- Backend installs are now crash-safe, with resilient downloads that fall back gracefully when a release lookup or cache snapshot is unavailable.
lemonade bench --response-logcaptures each model's responses and run metadata to a JSONL file for later quality evaluation.- The
lemonade backendscommand now lists only supported recipes and backends by default; uselemonade backends --allto see every available option.
Breaking Changes
- The
--model-draft,-md, and--spec-draft-modelflags are now reserved for internal speculation-decoding support and can no longer be passed manually throughllamacpp_args.
Lemonade Server
| Operating System | Downloads |
|---|---|
| Windows | lemonade.msi |
| Ubuntu 24.04+ | Launchpad PPA |
| Debian 13 | lemonade-server_10.8.1-debian13_amd64.deb |
| Fedora 43 | lemonade-server-10.8.1-fc43.x86_64.rpm |
| Fedora 44 | lemonade-server-10.8.1-fc44.x86_64.rpm |
| macOS | Lemonade-10.8.1-Darwin.pkg |
Other platforms? See our Installation Options for Docker, Snap, Arch, Debian, and more.
Embeddable Lemonade
Portable binaries for bundling into your own installer. Run lemond ./ as a subprocess.
| Platform | Download |
|---|---|
| Ubuntu x64 | lemonade-embeddable-10.8.1-ubuntu-x64.tar.gz |
| Windows x64 | lemonade-embeddable-10.8.1-windows-x64.zip |
| macOS arm64 | lemonade-embeddable-10.8.1-macos-arm64.tar.gz |
What's Changed
Thanks @GabrielReusRodriguez, @Kushal1213, @Phqen1x, @abn, @bitgamma, @blackdeathdrow, @ckuethe, @fl0rianr, @github-actions, @ianbmacdonald, @jeremyfowers, @jtlayton, @kenvandine, @lucifer-vali, @matthewjhunter, @ramkrishna2910, @sagebind, @superm1 for your awesome contributions to this release!
Click to expand changelog
- ci: support tagging releases from a release branch by @jeremyfowers in #2272
- ci: add repo-manager workflow by @jeremyfowers in #2276
- fix(whisper): drop gfx103X from rocm whisper supported archs by @ramkrishna2910 in #2274
- test(gguf): add unit tests for MTP / capability label detection (#2176) by @ramkrishna2910 in #2281
- fix(rocm): accept wildcard GPU arch families in TheRock install gate (#2093 follow-up) by @ramkrishna2910 in #2280
- fix(test): require Whisper model load before language transcription test by @fl0rianr in #2278
- docs(cli): correct launch note - LEMONADE_* recipe env vars no longer honored by @ramkrishna2910 in #2275
- ci(repo-manager): automatic repo-manager fully operational by @jeremyfowers in #2285
- docs(release): update release process for repo-manager automation by @jeremyfowers in #2288
- fix(ci): restart MacOS server before whisper metal tests by @fl0rianr in #2303
- auto update and validate sd-cpp by @fl0rianr in #2139
- fix(macOS): updates whisper from v1.8.4 to v.1.8.5 for metal by @fl0rianr in #2309
- Fix Problem with .devcontainer. It did not copy .devcontainer/reinstall-cmake.sh when building container by @GabrielReusRodriguez in #2273
- Add support for additional draft checkpoint by @bitgamma in #2317
- docs: fix Debian 13 installation docs for issue #2299 by @superm1 in #2323
- docs: add documentation style guide for community and AI-assisted contributions by @kenvandine in #2054
- Fix copy-to-clipboard buttons silently failing in web-app over HTTP by @blackdeathdrow in #2260
- Fix(cli): Lemonade backends now shows only supported backends . Added --all option to show all backends. by @GabrielReusRodriguez in #2254
- fix(gpu): support wildcards in GPU detection logic by @jtlayton in #2295
- Fix ROCm whisper-server startup: add TheRock lib dir to LD_LIBRARY_PATH by @matthewjhunter in #2293
- Capture output from
lemonade benchby @ckuethe in #2214 - fix(windows): use ProcessManager::run_command for 7z extraction instead of system() Fixes #2313 by @Phqen1x in #2322
- fix(server): fall back to installed llama.cpp binary when "latest" release lookup fails by @ianbmacdonald in #2279
- fix(moonshine): return 400 on invalid audio by @abn in #2326
- fix(backends): stage and verify backend install before removing the working binary by @ianbmacdonald in #2315
- docs: system-stats API by @jeremyfowers in #2284
- fix: return 400 instead of 500 when request body is empty or not valid JSON by @Kushal1213 in #2232
- devcontainers - Create the python env and install reqs to allow python test execution by @GabrielReusRodriguez in #2336
- systemd: add user-service symlink at /usr/lib/systemd/user/ by @lucifer-vali in #2173
- fix: resolve shared-repo GGUF variants orphaned by refs/main advance by @ianbmacdonald in #2311
- Fix: eviction_engine does not run nvidia-smi on AMD configs anymore and some testing problems fixed. by @GabrielReusRodriguez in #2331
- Update stable-diffusion.cpp to master-709-92a3b73 by @github-actions[bot] in #2335
- Support
image[]parameter for/v1/images/editsby @sagebind in #2321 - Update llama.cpp to b9747 by @github-actions[bot] in #2333
- Better auto context size estimate by @bitgamma in #2337
- Version bump to 10.8.1 to prepare for the release by @kenvandine in #2374
New Contributors
- @jtlayton made their first contribution in #2295
- @matthewjhunter made their first contribution in #2293
- @sagebind made their first contribution in #2321
Full Changelog: v10.8.0...v10.8.1
Windows installers are signed. Free code signing provided by SignPath.io, certificate by SignPath Foundation. See our Code Signing Policy.
v10.8.0
Headline
- Live model management: auto-unload is available, along with the ability to pin models to prevent eviction.
- LMX-Omni image generation gains fine-grained parameters, unified collection import/export, and Hugging Face distribution.
- Cloud offload serves chat completions from any OpenAI-compatible provider alongside local models.
- New MCP gateway and
lemonade launch piintegrations let external tools and agents call local models. - Expanded platform support adds Moonshine speech-to-text, NVIDIA GB10 arm64, Debian 13, and ROCm for Radeon GPUs.
Breaking Changes
- vLLM model IDs renamed from
Qwen3.5-*-vLLMtoQwen3.5-*-FP16-vLLM. - The
--flm-argsCLI flag andflm_argsAPI parameter have been removed. - Recipe-configuration environment variables have been removed.
- The legacy GUI collection export bundle format can no longer be imported.
- The default
ctx_sizechanged from 4096 to -1 (auto-tuned).
Lemonade Server
| Operating System | Downloads |
|---|---|
| Windows | lemonade.msi |
| Ubuntu 24.04+ | Launchpad PPA |
| Debian 13 | lemonade-server_10.8.0-debian13_amd64.deb |
| Fedora 43 | lemonade-server-10.8.0-fc43.x86_64.rpm |
| Fedora 44 | lemonade-server-10.8.0-fc44.x86_64.rpm |
| macOS | Lemonade-10.8.0-Darwin.pkg |
Other platforms? See our Installation Options for Docker, Snap, Arch, Debian, and more.
Embeddable Lemonade
Portable binaries for bundling into your own installer. Run lemond ./ as a subprocess.
| Platform | Download |
|---|---|
| Ubuntu x64 | lemonade-embeddable-10.8.0-ubuntu-x64.tar.gz |
| Windows x64 | lemonade-embeddable-10.8.0-windows-x64.zip |
| macOS arm64 | lemonade-embeddable-10.8.0-macos-arm64.tar.gz |
What's Changed
Thanks @Geramy, @Kushal1213, @abn, @anditherobot, @bitgamma, @blackdeathdrow, @ckuethe, @clemperorpenguin, @fl0rianr, @github-actions, @iswaryaalex, @jeremyfowers, @kenvandine, @neoblizz, @noamsto, @ramkrishna2910, @sawansri, @siavashhub, @superm1, @vgodsoe for your awesome contributions to this release!
Click to expand changelog
- ci: wire HF_TOKEN into linux distro builds; drop Fedora by @jeremyfowers in #2169
- Fix light theme persistence by @anditherobot in #2121
- cli: group run/load recipe options by @anditherobot in #2144
- docs: document pre-v10 legacy Linux config.json path by @anditherobot in #2145
- fix(vllm): report streaming TTFT and TPS by @fl0rianr in #2009
- Fix compat with vscode by @superm1 in #2146
- trivial: Run pre-commit whitespace hook by @superm1 in #2140
- feat(backends): add Moonshine streaming STT backend (#2115) by @Geramy in #2178
- Rewrite heartbeat + monitor workflows by @vgodsoe in #1960
- ci(windows): migrate Windows builds to Visual Studio 2026 by @jeremyfowers in #2199
- fix: remove load options environment variable support from lemonade CLI by @superm1 in #2185
- feat: auto-detect MTP capability from GGUF metadata by @blackdeathdrow in #2176
- moonshine follow-ups: dedupe realtime docs (#2192), GUI label (#2193), platform list by @Geramy in #2196
- fix(ui): connect log stream on main HTTP port instead of dedicated WebSocket port by @blackdeathdrow in #2191
- Add support for launching pi.dev by @superm1 in #2198
- fix: use Win32 API fallback for create_directories on symlinked Huggi… by @superm1 in #2184
- fix: enable TheRock ROCm installation on Windows for Radeon RX GPUs by @anditherobot in #2093
- Add triage dashboard with GitHub Pages auto-publish by @ramkrishna2910 in #2159
- Fix CUDA backend on NVIDIA GB10 (sm_121) arm64 by @kenvandine in #2203
- Refactor codebase to drop so much
#ifdef _WIN32by @superm1 in #2142 - ci: narrow API key CLI smoke tests by @fl0rianr in #2149
- Fix: recipe/backend status resolution for duplicated backend definition by @fl0rianr in #2206
- docs: add LangChain integration guide for Lemonade Server by @Kushal1213 in #2038
- vllm: rename built-in models with -FP16- suffix by @ramkrishna2910 in #2155
- Enable ROCm on gfx1152 by @ckuethe in #2186
- Show models of several backends in agent launch model picker by @sawansri in #2205
- ci: add engine::moonshine to auto-labeling by @ramkrishna2910 in #2209
- ci: grant pull-requests:read to triage dashboard workflow by @ramkrishna2910 in #2210
- Add instructions about dkms conflict for users that run into that by @vgodsoe in #2208
- feat(cli): add interactive chat in the terminal by @siavashhub in #2207
- Fix AMD GPU architecture detection for CDNA datacenter parts by @neoblizz in #2182
- feat(config): honor LEMONADE_DEFAULTS_PATH for non-FHS installs by @noamsto in #2220
- fix(cli): lemonade launch claude fails to launch on Windows, throws Error 193 by @anditherobot in #2213
- Fix download speed and ETA display at very low speeds by @fl0rianr in #2219
- Cloud offload: provider-agnostic OpenAI-compat backend + UI by @ramkrishna2910 in #1785
- Generate an artifact for Debian 13 by @superm1 in #2240
- Add inotify to extra models directory by @superm1 in #2217
- feat: Add backend watchdog for hung child servers by @fl0rianr in #2028
- Update llama.cpp to b9632 by @github-actions[bot] in #2238
- docs(config): document defaults.json seeding and LEMONADE_DEFAULTS_PATH by @noamsto in #2221
- feat: opt-in dynamic VRAM management (auto-evict idle models) by @clemperorpenguin in #2183
- fix(rocm): repair stable runtime when backend is update_required by @fl0rianr in #2003
- Drop support for
flm_argsby @superm1 in #2015 - fix: re-download missing checkpoint files automatically (no restart needed) by @blackdeathdrow in #2239
- trivial: Update debian/copyright by @superm1 in #2244
- cli: use long read timeout for pull and install streams by @abn in #2222
- docs: add release process guide by @jeremyfowers in #2200
- Fix(Omni): image tool options for Omni image generation by @fl0rianr in #1998
- fix(windows): set safe cwd for backend child processes by @fl0rianr in #2246
- ci: keep Windows inference cache outside workspace by @fl0rianr in #2148
- ci: drop src/cpp from distro build triggers by @jeremyfowers in #2170
- fix: align moonshine backend lifecycle with watchdog by @fl0rianr in #2252
- test: pre-warm ROCm (TheRock) runtime before rocm-backend tests by @jeremyfowers in #2250
- fix(server): han...
v10.7.0
Headline
- LMX-Omni models are now supported for any OpenAI API compatible app that can render multimedia output, including Open WebUI and AnythingLLM.
- The new
lemonade benchcommand provides apples-to-apples LLM benchmarking across llama.cpp, FastFlowLM, vLLM, and Ryzen AI SW. - Greatly improved cross-platform compatibility: llama.cpp CUDA support added for Windows and Linux; stable-diffusion.cpp CUDA added for Linux, stable-diffusion.cpp Vulkan added for Windows and Linux.
- Added a native Prometheus endpoint for real time stats monitoring.
Breaking Changes
- The deprecated environment variables for lemond configuration have finally been removed, use
lemonade configinstead. - Windows AMD users are highly encouraged to update their Adrenalin driver before generating images.
Lemonade Server
| Operating System | Downloads |
|---|---|
| Windows | lemonade.msi |
| Ubuntu 24.04+ | Launchpad PPA |
| Fedora 43 | lemonade-server-10.7.0-fc43.x86_64.rpm |
| Fedora 44 | lemonade-server-10.7.0-fc44.x86_64.rpm |
| macOS | Lemonade-10.7.0-Darwin.pkg |
Other platforms? See our Installation Options for Docker, Snap, Arch, Debian, and more.
Embeddable Lemonade
Portable binaries for bundling into your own installer. Run lemond ./ as a subprocess.
| Platform | Download |
|---|---|
| Ubuntu x64 | lemonade-embeddable-10.7.0-ubuntu-x64.tar.gz |
| Windows x64 | lemonade-embeddable-10.7.0-windows-x64.zip |
| macOS arm64 | lemonade-embeddable-10.7.0-macos-arm64.tar.gz |
What's Changed
Thanks @Geramy, @clemperorpenguin, @Kushal1213, @Phqen1x, @Storce, @ZaneNi, @anditherobot, @bitgamma, @ckuethe, @fl0rianr, @github-actions, @jeremyfowers, @julianxhokaxhiu, @kenvandine, @kylemanna, @lucifer-vali, @noamsto, @ramkrishna2910, @sawansri, @siavashhub, @superm1 for your awesome contributions to this release!
Click to expand changelog
- Stop backend archive staging from using shared
/tmpduring ROCm installs by @Copilot in #1996 - Add bench command by @bitgamma in #1953
- Remove more cases of hardcoded /tmp or predictable paths to mitigate … by @superm1 in #1997
- speech: Avoid duplicate Content-Type headers by @kylemanna in #2005
- fix: harden local model path finder by @fl0rianr in #1989
- Add llamacpp:cuda backend for NVIDIA GPUs by @Phqen1x in #1772
- feat: update FLM version to v0.9.43 by @ZaneNi in #2026
- fix(kokoro): correct ESPEAK_DATA_PATH construction by @anditherobot in #2025
- fix: harden markdown link handling against prompt injection by @superm1 in #2016
- security: fix path traversal in NPU cache download by @superm1 in #2017
- fix(readme): row arrangement fixed by @fl0rianr in #2023
- Smooth displayed download speed by @fl0rianr in #1995
- fix: bump macOS sd.cpp metal version and macOS release number by @Geramy in #2030
- Add LFM2.5-8B-A1B by @sawansri in #2036
- Fix downloaded status for multi-checkpoint models by @anditherobot in #2031
- add instructions to start/enable lemond on Fedora based distros by @lucifer-vali in #2029
- Correct websockets not to listen on 0.0.0.0 by default by @superm1 in #2034
- fix(server): translate model names before checking if they are downloaded (#2014) by @anditherobot in #2048
- Map LEMONADE_WHISPERCPP_VULKAN_{BIN,ARGS} env vars for parity by @noamsto in #2045
- Link system cpp-httplib portably (header-only friendly) by @noamsto in #2047
- feat: Add WSL support via librocdxg by @julianxhokaxhiu in #2049
- Vulkan back-end support for sdcpp by @ckuethe in #2039
- Update URL for CUDA backend for llama.cpp (llamacpp:cuda) by @Phqen1x in #2011
- fix: stop refreshing models on download progress by @fl0rianr in #2051
- Allow LEMONADE_GGML_HIP_PATH to locate the HIP plugin on non-FHS installs by @noamsto in #2044
- Fix: Adds SHA check on every download by @fl0rianr in #1950
- Show 3-line descriptions in Marketplace cards by @Copilot in #2069
- Fix: HF snapshot ref reuse for unchanged model artifacts by @fl0rianr in #2066
- fix: user model RAM filtering by @fl0rianr in #2067
- test: give pull multi endpoint test a unique number by @fl0rianr in #2059
- fix(vLLM): make startup timeout adjustable, increased global_timeout by @fl0rianr in #2004
- Fix spurious model re-downloads: make client pulls cache-first by default by @jeremyfowers in #2065
- fix: user model registry writes and stale cache lookups by @fl0rianr in #2064
- fix(cuda): NVIDIA Blackwell/PRIME detection and CUDA device fixes on Linux by @kenvandine in #2070
- security: validate URL scheme in openExternal handler by @superm1 in #2019
- Fix #1959: Replace old Qwen example model in Lemonade API docs by @anditherobot in #2087
- Add Gemma 4 12B by @sawansri in #2090
- feat: server-side Omni orchestration for /chat/completions (Open WebUI) by @jeremyfowers in #2071
- Separate local and available model list output by @anditherobot in #2086
- Create a set of working groups by @jeremyfowers in #2079
- CI: Limit distro builds to relevant changes by @fl0rianr in #2104
- ci: consolidate GitHub-hosted test jobs to reduce download rate limiting by @jeremyfowers in #2105
- Update llama.cpp to b9518 by @github-actions[bot] in #2101
- feat: support benchmarking multiple models in a single command by @ckuethe in #2075
- feat: add CUDA backend support for stable-diffusion.cpp by @Phqen1x in #2062
- Native Prometheus Metrics Endpoint by @Storce in #1897
- Auto-label issues and PRs by backend and area by @ramkrishna2910 in #2076
- ci / test: fix the 409 CI error by @fl0rianr in #2117
- ci: set HF_HOME before starting hosted Linux server by @fl0rianr in #2116
- test: add coverage for GET /v1/pull/variants (4 paths) by @Kushal1213 in #2096
- Drop all environment variable migration code by @superm1 in #2106
- Add Debian 13 to NPU installation instructions by @superm1 in #2114
- Remove pointless comments from codebase by @superm1 in #2133
- Update llama.cpp to b9550 by @github-actions[bot] in #2132
- fix(security): prevent path traversal in /web-app/ route by @superm1 in #2084
- test: retry transient model pull setup failures by @fl0rianr in #2123
- feat: add Linux ARM64 CPU and Vulkan llamacpp backend support by @kenvandine in #2081
- ...
v10.6.0
Headline
- Lemonade's true omni-modal features have gotten a glow-up!
- LMX-Omni-52B-Halo and LMX-Omni-5.5B-Lite replace the old "collections".
- Add your own custom omni models in the GUI or CLI.
- Downloading custom models have been improved with auto-detected sizes, labels, and improved download robustness.
Lemonade Server
| Operating System | Downloads |
|---|---|
| Windows | lemonade.msi |
| Ubuntu 24.04+ | Launchpad PPA |
| Fedora 43 | lemonade-server-10.6.0-fc43.x86_64.rpm |
| Fedora 44 | lemonade-server-10.6.0-fc44.x86_64.rpm |
| macOS | Lemonade-10.6.0-Darwin.pkg |
Other platforms? See our Installation Options for Docker, Snap, Arch, Debian, and more.
Embeddable Lemonade
Portable binaries for bundling into your own installer. Run lemond ./ as a subprocess.
| Platform | Download |
|---|---|
| Ubuntu x64 | lemonade-embeddable-10.6.0-ubuntu-x64.tar.gz |
| Windows x64 | lemonade-embeddable-10.6.0-windows-x64.zip |
| macOS arm64 | lemonade-embeddable-10.6.0-macos-arm64.tar.gz |
What's Changed
Thanks @Geramy, @abn, @fl0rianr, @github-actions, @jeremyfowers, @neubig, @sofiageo, @superm1 for your awesome contributions to this release!
Click to expand changelog
- fix(sd-cpp): update macOS metal asset filename by @Geramy in #1949
- Fix : Add 'vision' label to Qwen MTP models by @fl0rianr in #1952
- d/copyright: Update licensing by @superm1 in #1955
- Preserve backend error status by @neubig in #1933
- fix(download manager): restore model download state across renderer r… by @fl0rianr in #1948
- Add a tool for updating model sizes by @jeremyfowers in #1962
- packaging: Linux systemd/sysusers compliance for downstream distros by @abn in #1954
- Register lemonade:// scheme handler in app desktop entry by @abn in #1957
- fix(app): normalize cleared server base URL to localhost mode by @fl0rianr in #1961
- fix(app): don't skip port discovery when no explicit base URL is set by @abn in #1956
- Enable custom user collections via /pull by @jeremyfowers in #1842
- fix: custom models documentation link by @sofiageo in #1972
- Improve download UX and correctness by @fl0rianr in #1764
- Update llama.cpp to b9253 by @github-actions[bot] in #1975
- Feat : Add UI options for custom Omni Models by @fl0rianr in #1769
- Rebrand OmniRouter to Lemonade Omni by @jeremyfowers in #1973
- fix: missing file size in custom models by @sofiageo in #1888
- feat: added GGUF auto labeling for tools and vision by @fl0rianr in #1983
- Rev the version number to v10.6.0 by @jeremyfowers in #1982
- fix: emit collection components under public model names by @jeremyfowers in #1985
New Contributors
Full Changelog: v10.5.1...v10.6.0
Windows installers are signed. Free code signing provided by SignPath.io, certificate by SignPath Foundation. See our Code Signing Policy.
v10.5.1
Headline
- MTP support added for up to 2x performance increase on supported models.
- Fedora 43 support restored.
- Set model load args on a per-backend basis.
Lemonade Server
| Operating System | Downloads |
|---|---|
| Windows | lemonade.msi |
| Ubuntu 24.04+ | Launchpad PPA |
| Fedora 43 | lemonade-server-10.5.1-fc43.x86_64.rpm |
| Fedora 44 | lemonade-server-10.5.1-fc44.x86_64.rpm |
| macOS | Lemonade-10.5.1-Darwin.pkg |
Other platforms? See our Installation Options for Docker, Snap, Arch, Debian, and more.
Embeddable Lemonade
Portable binaries for bundling into your own installer. Run lemond ./ as a subprocess.
| Platform | Download |
|---|---|
| Ubuntu x64 | lemonade-embeddable-10.5.1-ubuntu-x64.tar.gz |
| Windows x64 | lemonade-embeddable-10.5.1-windows-x64.zip |
| macOS arm64 | lemonade-embeddable-10.5.1-macos-arm64.tar.gz |
What's Changed
Thanks @bitgamma, @dmitrii-galantsev, @fl0rianr, @github-actions, @jeremyfowers, @kpoineal, @lucifer-vali, @seii, @sofiageo, @superm1 for your awesome contributions to this release!
Click to expand changelog
- feat(app): add full custom sd.cpp model options by @fl0rianr in #1909
- fix: update bug report template with current CLI commands by @kpoineal in #1914
- keep quotes during arg merging by @bitgamma in #1920
- Separate releases for Fedora 43 and 44 by @lucifer-vali in #1917
- Update Fedora maintainer in contribution guide by @lucifer-vali in #1928
- fix: add missing rdna1, rdna2, and gfx1150 targets by @sofiageo in #1923
- Introduce per-backend args by @bitgamma in #1915
- Update llama.cpp to b9196 by @github-actions[bot] in #1931
- Polish auto-generated release notes by @jeremyfowers in #1935
- Expose llama.cpp "/tokenize" endpoint by @seii in #1926
- test(app): add regression guards for model options and collections by @fl0rianr in #1786
- Switch to upstream builds for stable diffusion by @superm1 in #1922
- fix: Update and remove non-existing .md links by @dmitrii-galantsev in #1938
- fix: resolve rocm channel when checking expected sd-cpp/llamacpp version by @jeremyfowers in #1934
- feat: built-in MTP support by @jeremyfowers in #1944
- remove deprecated lemonade-server CLI by @jeremyfowers in #1918
- fix: vLLM memory behavior on APUs by @fl0rianr in #1919
- Update llama.cpp to b9213 by @github-actions[bot] in #1946
New Contributors
- @lucifer-vali made their first contribution in #1917
- @seii made their first contribution in #1926
- @dmitrii-galantsev made their first contribution in #1938
Full Changelog: v10.5.0...v10.5.1
Windows installers are signed. Free code signing provided by SignPath.io, certificate by SignPath Foundation. See our Code Signing Policy.