Skip to content

[ML] The ModelLoadingService does not autoscale #140845

New issue
New issue
Open
Open
[ML] The ModelLoadingService does not autoscale#140845
Labels
:mlMachine learning>enhancementTeam:MLMeta label for the ML team
@davidkyle

Description

@davidkyle
davidkyle
opened on Jan 16, 2026

Description

ModelLoadingService has a circuit breaker with a limit based on node size. When this circuit breaker is triggered is should autoscale to a larger node which can accommodate all the models.

Related to #140844

Metadata

Metadata

Assignees

No one assigned

    Labels

    :mlMachine learning>enhancementTeam:MLMeta label for the ML team

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions