Adding endpoint creation validation to ElasticsearchInternalService

[dan-rubinstein]

Description

This change adds endpoint creation validation to all task types for ElasticsearchInternalService. As part of this change we can refactor all of our other services to remove checkModelConfig as they all call ModelValidatorBuilder.buildModelValidator(...).validate(...). This can now be pulled out of the inference service and called directly in the TransportPutInferenceModelAction. This reduces the amount of duplicated code across inference service and test files. Part of this change also updates the model validators to take in a timeout value to ensure that the validation process ends if a users exceeds their requested timeout time.

TLDR of changes made in this PR to accomplish the above:

1. Removing checkModelConfig from all services
2. Adding timeouts to model validation process based on user provided timeout value.
3. Adding a new model validator for ElasticsearchInternalService that starts the model before validation and stops it on validation failure.
4. Updated our IT integration services to return valid values for text_embedding endpoint inferences. These test services were already being used to "create text_embedding endpoints" in our IT tests so they needed to have a inference response to pass validation.

Testing

• Unit tests
• Tested that creating a valid endpoint for each integration runs through validation and successfully makes a test call and creates the inference endpoint.
• Tested that attempting to create an invalid endpoint fails the validation call and does not make the endpoint for each integration.

[elasticsearchmachine]

Hi @dan-rubinstein, I've created a changelog YAML for you.

[elasticsearchmachine]

Pinging @elastic/ml-core (Team:ML)

[jonathan-buttner]

Looks good, just left a few questions

[dan-rubinstein]

@elasticmachine merge upstream

[elasticsearchmachine]

💔 Backport failed

Status	Branch	Result
❌	8.x	Commit could not be cherrypicked due to conflicts

You can use sqren/backport to manually backport by running backport --upstream elastic/elasticsearch --pr 123044