What's Changed

• [NA] [BE] Apply unit conversion for duration metrics in histogram aggregation by @thiagohora in #3889
• [OPIK-2669] [SDK] Improvements and Bug fix for GEPA Optimizer by @vincentkoc in #3869
• [NA] [Optimizer] Bump version to 2.2.1 by @dsblank in #3894
• [NA][SDK] Opik Optimizer Makefile Improvement by @vincentkoc in #3896
• [OPIK-2731] [FE] Improve Hide all/Show all option on Columns menu by @JetoPistola in #3811
• [OPIK-2863] [HELM] Add initContainer wait-for-mysql for opik-backend by @liyaka in #3902
• [NA] Fix help text alignment for --quick-restart mode in dev-runner.sh by @YarivHashaiComet in #3810
• Bump com.jayway.jsonpath:json-path from 2.9.0 to 2.10.0 in /apps/opik-backend by @dependabot[bot] in #3907
• [NA] [E2E] test names and tags for suites by @AndreiCautisanu in #3888
• Bump software.amazon.awssdk:bom from 2.36.2 to 2.37.3 in /apps/opik-backend by @dependabot[bot] in #3905
• Bump com.mysql:mysql-connector-j from 9.4.0 to 9.5.0 in /apps/opik-backend by @dependabot[bot] in #3906
• [NA] [Docs] Add Amazon Bedrock as AI Provider configuration guide by @Nimrod007 in #3903
• [NA] [Docs] Align playground supported providers with AI providers configuration by @juanferrub in #3908
• [NA] [DOCS] Add Google ADK section to agent graph logging documentation by @juanferrub in #3911
• [OPIK-2909][FE] Playground fe improvements by @BorisTkachenko in #3890
• [OPIK-2786] [P SDK] Implement recording context manager that will allow to get Trace- and Span- models for the submitted data by @yaricom in #3880
• [NA] [BE] Upgrade MySQL container from Testcontainers by @thiagohora in #3909
• [NA] - Updating dev-runner.ps1 script to support --quick-restart by @YarivHashaiComet in #3915
• [OPIK-2870] [P SDK] Implement an utility function to workaround the langgraph execution context disconnection when running in asyncio context by @alexkuzmik in #3914

Full Changelog: 1.8.97...1.8.98

What's Changed

• [OPIK-0000] [P SDK] alexkuzmik / Update Simulation docstrings by @alexkuzmik in #3861
• [OPIK-2858] [BE] Model name matching fix, and vision capability by @JetoPistola in #3858
• [OPIK-2857] [DOCS] Update Broken Links by @vincentkoc in #3865
• [OPIK-2732] [Docs] Fix links in Agent Optimizer by @vincentkoc in #3864
• [NA] [BE] Add histogram bucket configuration support to OpikMetricProviderCustomizer by @thiagohora in #3856
• [OPIK-2900] [E2E] add suite tags and workflow by @AndreiCautisanu in #3873
• [NA] [BE] Follow up comments from previous PR about histogram config by @thiagohora in #3872
• [NA] [E2E] TS E2E tests package lock by @AndreiCautisanu in #3875
• [issue-3687] [SDK] Fix LangGraph Command node output capture by @collincunn in #3860
• [OPIK-2719] [FE] Add link to metrics docs on Create new experiment modal by @JetoPistola in #3781
• [OPIK-2792][FE][BE] manual evaluation by @idoberko2 in #3820
• [OPIK-2882] [FE] Pass dataset item field to scoring metrics in online evals by @BorisTkachenko in #3871
• [OPIK-0000] [P SDK] Alexkuzmik / update copilot rules by @alexkuzmik in #3881
• [OPIK-2902] [BE] Optimize attachment JSON processing by @ldaugusto in #3877
• [OPIK-846] [BE] Add Redis subscriber message claimer for pending messages by @andrescrz in #3797
• [NA] [SCRIPTS] Replace unsafe docker volume prune with docker compose down -v by @andrescrz in #3882
• [issue-3878] [SDK] fix: show actual configured project name in log message by @mecampbellsoup in #3879
• [NA] [BE] Add aggregation config only for histograms by @thiagohora in #3883
• [OPIK-0000] [P SDK] alexkuzmik / Update the Copilot instruction by @alexkuzmik in #3884
• [OPIK-2512][SDK] Add Multimodal Judge Support to Python SDK by @vincentkoc in #3848
• [NA][SDK/Docs] Added AGENTS.md and Updated Sphinx Build and Rules by @vincentkoc in #3847
• Add service labels to service.yaml helm template by @Dentling in #3754
• [NA] version bump by @AndreiCautisanu in #3887

New Contributors

• @collincunn made their first contribution in #3860
• @mecampbellsoup made their first contribution in #3879
• @Dentling made their first contribution in #3754

Full Changelog: 1.8.96...1.8.97

What's Changed

• [OPIK-2874] [Docs]Updated multi-turn agent evaluation docs by @jverre in #3845

Full Changelog: 1.8.93...1.8.94

What's Changed

• [OPIK-2788] [P SDK] alexkuzmik / crewai v1.0.0 release update the integration llm calls are not logged now by @alexkuzmik in #3823
• [OPIK-2835] [Docs] Opik Uni: No-code eval workflow by @fschlz in #3798
• [OPIK-2853] [BE] Add per-project dynamic sorting control by @andrescrz in #3840
• [OPIK-2871] [Docs] Create new agent evaluation guide by @jverre in #3842
• [OPIK-2858] [BE/FE] Fix playground models not receiving context for base64 images by @YarivHashaiComet in #3839

Full Changelog: 1.8.92...1.8.93

What's Changed

• Added Portuguese (pt-BR) translation for README.md by @ananya26102006 in #3819
• [NA] [BE] Update model prices file by @github-actions[bot] in #3832
• [OPIK-2789] [HELM] Added clickhouse recommended configuration to default values by @liyaka in #3756
• [NA] [FE] If messages missing name of tool, the UI crashes by @dsblank in #3825
• [issue-3786] [DOCS] Add Portuguese (Brazil) translation for README by @andrescrz in #3834
• [OPIK-2822] [OPIK-2831] [E2E] Tracing and threads tests by @AndreiCautisanu in #3818
• [NA] approve CUST tickets in PR linter by @AndreiCautisanu in #3837
• [OPIK-2860] [FE] Add vision support for Qwen VL models by @YarivHashaiComet in #3831

New Contributors

• @ananya26102006 made their first contribution in #3819

Full Changelog: 1.8.91...1.8.92

What's Changed

• [NA] [BE] Add extension to add workspace and SDK version to Otel metrics by @thiagohora in #3812
• [NA] [Docs] Homepage updates by @jverre in #3826
• Fix typo in 'Evaluating your LLM Application' header by @AarushDogra in #3817
• [OPIK-2745][Docs] Alert native integrations documentation by @BorisTkachenko in #3815
• [NA] [SDK] [DOCS] Update automatically OpenAPI spec and Fern code by @github-actions[bot] in #3828
• [OPIK-2861] [FE] Fix experiments page infinite loading state with met… by @YarivHashaiComet in #3830

New Contributors

• @AarushDogra made their first contribution in #3817

Full Changelog: 1.8.90...1.8.91

What's Changed

• [OPIK-2434] Add sorting capability for all experiment items columns by @YarivHashaiComet in #3573
• [OPIK-2637] [BE] Add configurable JSON string length limits for large attachment handling by @ldaugusto in #3778
• [NA] [SDK] Remove Vercel integration from TypeScript SDK build by @YarivHashaiComet in #3821
• [NA] Update version.txt by @AndreiCautisanu in #3824

Full Changelog: 1.8.89...1.8.90

What's Changed

• [OPIK-2799] [E2E] TS E2E projects suite by @AndreiCautisanu in #3776
• [OPIK-2724][BE] Add sorting by last created experiment for experiment groups by @BorisTkachenko in #3696
• [OPIK-2802] [P SDK] Implement straightforward solution to save prompts info with spans/traces by @yaricom in #3766
• [NA] [P SDK] alexkuzmik / Fix the regression with rate limit handling by @alexkuzmik in #3792

Full Changelog: 1.8.86...1.8.87

What's Changed

• [OPIK-2791] [BE] Add manual evaluation API endpoints by @idoberko2 in #3759
• [OPIK-2743][BE] Add PagerDuty native integration for Alerts by @BorisTkachenko in #3765
• [NA] update PR linter rules by @liyaka in #3767
• [NA] [BE] Update model prices file by @github-actions[bot] in #3772
• [NA] [SDK] [DOCS] Update automatically OpenAPI spec and Fern code by @github-actions[bot] in #3770
• [OPIK-2797] [E2E] Add TypeScript E2E test infrastructure with Flask helper service by @AndreiCautisanu in #3757
• [OPIK-2642] [FE] Add Project metrics section to Metrics Dashboard by @JetoPistola in #3762
• [NA] [P SDK]Alexkuzmik/move experiment items creation to background by @alexkuzmik in #3775
• [OPIK-1994] [FE] Add prompt link to experiment details page by @awkoy in #3780
• [OPIK-1990] unify the column names by @awkoy in #3782
• [OPIK-2741] [FE] Add PagerDuty integration to alerts system by @andriidudar in #3774
• [NA] [SDK] Add rate limit retry for dataset and experiment items by @YarivHashaiComet in #3777
• [OPIK-2618] [BE] Add isolated subprocess executor with HTTP-based log streaming by @thiagohora in #3702
• [NA] [Optimizer] Refactor public methods for optimizer by @jverre in #3748
• Update optimizer version by @jverre in #3785
• [NA] [BE] Update model prices file by @github-actions[bot] in #3789
• [NA] [SDK] [DOCS] Update automatically OpenAPI spec and Fern code by @github-actions[bot] in #3788

Full Changelog: 1.8.85...1.8.86

📦 opik-vercel v1.0.1

Released opik-vercel version 1.0.1

📥 Installation

npm install opik-vercel@1.0.1

🔗 Links

• NPM Package
• Changelog

⚙️ Compatibility

• Node.js: >= 18
• TypeScript: >= 5.0
• Opik SDK: See peerDependencies in package.json

What's Changed

• [OPIK-2807] Vercel AI npm package integration by @awkoy in #3771
• [OPIK-2807] fix vercel integration build by @awkoy in #3796

Full Changelog: 1.8.87...opik-vercel-v1.0.1