Skip to content

[ML] SageMaker Elastic Payload (#129413)#129882

Merged
elasticsearchmachine merged 1 commit intoelastic:8.19from
prwhelan:backport/8.19/129413
Jun 23, 2025
Merged

[ML] SageMaker Elastic Payload (#129413)#129882
elasticsearchmachine merged 1 commit intoelastic:8.19from
prwhelan:backport/8.19/129413

Conversation

@prwhelan
Copy link
Member

@prwhelan prwhelan commented Jun 23, 2025 •
edited
Loading

Backport #129413
@prwhelan
[ML] SageMaker Elastic Payload (elastic#129413)
bdab961 
Send the Elastic API Payload to a SageMaker endpoint, and parse the
response as if it were an Elastic API response.

- SageMaker now supports all task types in the Elastic API format.
- Streaming is supported using the SageMaker client/server rpc,
  rather than SSE. Payloads must be in a complete and valid JSON
  structure.
- Task Settings can be used for additional passthrough settings, but
  they will not be saved alongside the model. Elastic cannot make
  guarantees on the structure or contents of this payload, so Elastic
  will treat it like the other input payloads and only allow them during
  inference.
@prwhelan prwhelan added >enhancement :ml Machine learning backport Team:ML Meta label for the ML team auto-merge-without-approval Automatically merge pull request when CI checks pass (NB doesn't wait for reviews!) v8.19.0 labels Jun 23, 2025
@prwhelan prwhelan marked this pull request as ready for review June 23, 2025 21:15
@elasticsearchmachine elasticsearchmachine merged commit 6cf7526 into elastic:8.19 Jun 23, 2025
23 checks passed
@prwhelan prwhelan deleted the backport/8.19/129413 branch June 23, 2025 22:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

auto-merge-without-approval Automatically merge pull request when CI checks pass (NB doesn't wait for reviews!) backport >enhancement :ml Machine learning Team:ML Meta label for the ML team v8.19.0

2 participants

@prwhelan @elasticsearchmachine