[ML] Displays document count chart for ES|QL categorize queries

[jgowdyelastic]

Overrides the chart query when a categorize query is detected so that it renders a simple doc count rather than the count of all patterns.

[elasticmachine]

Pinging @elastic/ml-ui (:ml)

[rbrtj]

LGTM, just a heads up, if no timestamp is found, the histogram won't be shown. Previously, it was always displayed with the pattern count, but that's okay, I guess

[stratoula]

The fact that we are not suggesting anything now if there is no @timestamp in the source seems a bit concerning to me.

What we could do is on the recommendations to also suggest the time params (which enable the time picker for sources without the @timestamp field.

So this

FROM meow
  | WHERE datefield <= ?_tend AND datefield > ?_tstart
  | SAMPLE .001
  | STATS Count=COUNT(*)/.001 BY Pattern=CATEGORIZE(category)
  | SORT Count DESC

instead of

FROM meow
  | SAMPLE .001
  | STATS Count=COUNT(*)/.001 BY Pattern=CATEGORIZE(category)
  | SORT Count DESC

Of course the users now need to know that. Maybe the recommendation is a good training point but still. It is a business decision after all. But at least let's suggest it on the recommendations

[Copilot]

Pull Request Overview

This PR improves the chart rendering for ES|QL categorize queries by showing a simple document count histogram instead of the count of all patterns. The change ensures that categorize queries display more meaningful chart visualizations.

Key changes:

• Modified the chart query detection to override categorize queries with a document count chart
• Fixed array indexing for the categorize field extraction
• Removed unused visualization attribute modifications and imports

Reviewed Changes

Copilot reviewed 2 out of 3 changed files in this pull request and generated no comments.

File	Description
src/platform/plugins/shared/discover/public/context_awareness/profile_providers/common/patterns/profile.ts	Fixes array indexing for categorize field and removes unused visualization modifications
src/platform/packages/shared/kbn-unified-histogram/services/lens_vis_service.ts	Adds categorize query detection and document count chart override logic

[jgowdyelastic]

What we could do is on the recommendations to also suggest the time params (which enable the time picker for sources without the @timestamp field.

I've added this change. It adds | WHERE ${timeField} <=?_tend and ${timeField} >?_tstart to the recommended query when there is a time field.
If there is no time field, the query is the same as before and no chart is displayed.

[peteharverson]

LGTM, using the edits to the recommended query with the start / end params.

The document count chart provides a better UX than the current bar chart - consistency with the chart displayed for other queries, with ability to zoom in to time ranges on the chart. This will also pave the way for showing how the doc counts for a pattern compare to the baseline in future enhancements.

[stratoula]

ES|QL changes LGTM, code review only

[jughosta]

Suggested change

	availableSuggestionsWithType.push({
	suggestion: histogramSuggestionForESQL,
	type: UnifiedHistogramSuggestionType.histogramForESQL,
	});
	if (histogramSuggestionForESQL) {
	availableSuggestionsWithType.push({
	suggestion: histogramSuggestionForESQL,
	type: UnifiedHistogramSuggestionType.histogramForESQL,
	});
	}

can we additionally check that it returned a valid suggestion?

[jgowdyelastic]

Updated in cad683e

[elasticmachine]

💚 Build Succeeded

• Buildkite Build
• Commit: cad683e

Metrics [docs]

Async chunks

Total size of all lazy-loaded chunks that will be downloaded as the user navigates the app

id	before	after	diff
discover	1.2MB	1.2MB	+92.0B
unifiedSearch	354.3KB	354.5KB	+137.0B
total			+229.0B

Page load bundle

Size of the bundles that are downloaded on every page load. Target size is below 100kb

id	before	after	diff
kbnUiSharedDeps-srcJs	3.9MB	3.9MB	+137.0B

History

• 💛 Build #341924 was flaky 781a0a4
• 💛 Build #340906 was flaky d7b5a91
• 💛 Build #339108 was flaky 324bdb5
• 💔 Build #338712 failed bc885f1
• 💚 Build #336179 succeeded 5955d5d
• 💚 Build #332840 succeeded 0b459c0

cc @jgowdyelastic

[jughosta]

Data Discovery changes LGTM - code review only