Skip to content

[ML] AI Connector/Inference endpoints creation UI: Adds icon for AI21 labs and Llama Stack#232098

Merged
KodeRad merged 6 commits intoelastic:mainfrom
KodeRad:ml-ai-connector-add-ai21-and-llama-icons
Aug 26, 2025
Merged

[ML] AI Connector/Inference endpoints creation UI: Adds icon for AI21 labs and Llama Stack#232098
KodeRad merged 6 commits intoelastic:mainfrom
KodeRad:ml-ai-connector-add-ai21-and-llama-icons

Conversation

@KodeRad
Copy link
Contributor

@KodeRad KodeRad commented Aug 18, 2025

Summary

Fixes #230463

The corresponding back-end pull request has not been merged yet to avoid showing AI21 Labs and Llama Stack providers without icons in the list of available connector services. This PR is intended to go first for that reason. Once we receive the updated list of services, the front end will be ready to display them correctly.

I’ve been provided with the expected response objects:

AI21

{
    "service": "ai21",
    "name": "AI21",
    "task_types": [
        "completion",
        "chat_completion"
    ],
    "configurations": {
        "api_key": {
            "description": "API Key for the provider you're connecting to.",
            "label": "API Key",
            "required": true,
            "sensitive": true,
            "updatable": true,
            "type": "str",
            "supported_task_types": [
                "completion",
                "chat_completion"
            ]
        },
        "rate_limit.requests_per_minute": {
            "description": "Minimize the number of rate limit errors.",
            "label": "Rate Limit",
            "required": false,
            "sensitive": false,
            "updatable": false,
            "type": "int",
            "supported_task_types": [
                "completion",
                "chat_completion"
            ]
        },
        "model_id": {
            "description": "Refer to the AI21 models documentation for the list of available inference models.",
            "label": "Model",
            "required": true,
            "sensitive": false,
            "updatable": false,
            "type": "str",
            "supported_task_types": [
                "completion",
                "chat_completion"
            ]
        }
    }
},

Llama

{
        "service": "llama",
        "name": "Llama",
        "task_types": [
            "text_embedding",
            "completion",
            "chat_completion"
        ],
        "configurations": {
            "api_key": {
                "description": "API Key for the provider you're connecting to.",
                "label": "API Key",
                "required": true,
                "sensitive": true,
                "updatable": true,
                "type": "str",
                "supported_task_types": [
                    "text_embedding",
                    "completion",
                    "chat_completion"
                ]
            },
            "rate_limit.requests_per_minute": {
                "description": "Minimize the number of rate limit errors.",
                "label": "Rate Limit",
                "required": false,
                "sensitive": false,
                "updatable": false,
                "type": "int",
                "supported_task_types": [
                    "text_embedding",
                    "completion",
                    "chat_completion"
                ]
            },
            "model_id": {
                "description": "Refer to the Llama models documentation for the list of available models.",
                "label": "Model",
                "required": true,
                "sensitive": false,
                "updatable": false,
                "type": "str",
                "supported_task_types": [
                    "text_embedding",
                    "completion",
                    "chat_completion"
                ]
            },
            "url": {
                "description": "The URL endpoint to use for the requests.",
                "label": "URL",
                "required": true,
                "sensitive": false,
                "updatable": false,
                "type": "str",
                "supported_task_types": [
                    "text_embedding",
                    "completion",
                    "chat_completion"
                ]
            }
        }
    },

Checklist

Check the PR satisfies following conditions.

Reviewers should verify this PR satisfies this list as well.

  • Any text added follows EUI's writing guidelines, uses sentence case text and includes i18n support
  • Documentation was added for features that require explanation or tutorials
  • Unit or functional tests were updated or added to match the most common scenarios
  • If a plugin configuration key changed, check if it needs to be allowlisted in the cloud and added to the docker list
  • This was checked for breaking HTTP API changes, and any breaking changes have been approved by the breaking-change committee. The release_note:breaking label should be applied in these situations.
  • Flaky Test Runner was used on any tests changed
  • The PR description includes the appropriate Release Notes section, and the correct release_note:* label is applied per the guidelines
  • Review the backport guidelines and apply applicable backport:* labels.

Identify risks

Does this PR introduce any risks? For example, consider risks like hard to test bugs, performance regression, potential of data loss.

Describe the risk, its severity, and mitigation for each identified risk. Invite stakeholders and evaluate how to proceed before merging.

@KodeRad KodeRad self-assigned this Aug 18, 2025
@KodeRad KodeRad force-pushed the ml-ai-connector-add-ai21-and-llama-icons branch from d747dd5 to 8717c32 Compare August 18, 2025 14:22
@KodeRad KodeRad force-pushed the ml-ai-connector-add-ai21-and-llama-icons branch from 8717c32 to e315271 Compare August 18, 2025 14:27
@KodeRad KodeRad marked this pull request as ready for review August 25, 2025 19:18
@KodeRad KodeRad requested a review from a team as a code owner August 25, 2025 19:18
@KodeRad KodeRad added release_note:enhancement :ml Feature:Inference UI ML Inference endpoints UI and AI connector v9.2.0 labels Aug 25, 2025
@elasticmachine
Copy link
Contributor

Pinging @elastic/ml-ui (:ml)

@KodeRad KodeRad added the backport:skip This PR does not require backporting label Aug 25, 2025
@elasticmachine
Copy link
Contributor

💚 Build Succeeded

Metrics [docs]

Module Count

Fewer modules leads to a faster build time

id before after diff
indexManagement 671 673 +2
searchInferenceEndpoints 149 151 +2
searchPlayground 412 414 +2
securitySolution 7890 7892 +2
stackConnectors 341 343 +2
total +10

Public APIs missing comments

Total count of every public API that lacks a comment. Target amount is 0. Run node scripts/build_api_docs --plugin [yourplugin] --stats comments for more detailed information.

id before after diff
@kbn/inference-endpoint-ui-common 146 154 +8

Async chunks

Total size of all lazy-loaded chunks that will be downloaded as the user navigates the app

id before after diff
indexManagement 683.4KB 686.9KB +3.5KB
searchInferenceEndpoints 100.4KB 103.9KB +3.5KB
searchPlayground 224.5KB 228.0KB +3.5KB
securitySolution 10.4MB 10.4MB +46.0B
stackConnectors 621.8KB 625.3KB +3.5KB
total +13.9KB
Unknown metric groups

API count

id before after diff
@kbn/inference-endpoint-ui-common 146 154 +8

miscellaneous assets size

id before after diff
indexManagement 192.4KB 201.7KB +9.3KB
searchInferenceEndpoints 192.4KB 201.7KB +9.3KB
searchPlayground 192.4KB 201.7KB +9.3KB
securitySolution 5.0MB 5.0MB +9.3KB
stackConnectors 40.1KB 49.4KB +9.3KB
total +46.6KB

cc @KodeRad

Copy link
Contributor

@peteharverson peteharverson left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code changes LGTM

Copy link
Contributor

@alvarezmelissa87 alvarezmelissa87 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM ⚡

@KodeRad KodeRad merged commit 3571920 into elastic:main Aug 26, 2025
12 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

backport:skip This PR does not require backporting Feature:Inference UI ML Inference endpoints UI and AI connector :ml release_note:enhancement v9.2.0

5 participants