ESQL: Enable nullify and fail unmapped resolution in tech-preview by GalLalouche · Pull Request #140528 · elastic/elasticsearch

GalLalouche · 2026-01-12T18:04:30Z

This PR removes the snapshot protection of FAIL and NULLIFY options for unmapped fields (only LOAD remains protected under snapshot).

Follow up to #140463.
Related: #138888.

elasticsearchmachine · 2026-01-12T18:04:56Z

Pinging @elastic/es-analytical-engine (Team:Analytics)

elasticsearchmachine · 2026-01-12T18:04:56Z

Hi @GalLalouche, I've created a changelog YAML for you.

GalLalouche · 2026-01-12T18:05:58Z

x-pack/plugin/esql/src/test/java/org/elasticsearch/xpack/esql/parser/SetParserTests.java


    public void testSet() {
-        assumeTrue("SET command available in snapshot only", EsqlCapabilities.Cap.SET_COMMAND.isEnabled());
+        assumeTrue("SET command required", EsqlCapabilities.Cap.SET_COMMAND.isEnabled());


Apparently, SET no longer requires snapshot, so I've updated these comments in this file.

github-actions · 2026-01-12T18:07:06Z

ℹ️ Important: Docs version tagging

👋 Thanks for updating the docs! Just a friendly reminder that our docs are now cumulative. This means all 9.x versions are documented on the same page and published off of the main branch, instead of creating separate pages for each minor version.

We use applies_to tags to mark version-specific features and changes.

Expand for a quick overview

When to use applies_to tags:

✅ At the page level to indicate which products/deployments the content applies to (mandatory)
✅ When features change state (e.g. preview, ga) in a specific version
✅ When availability differs across deployments and environments

What NOT to do:

❌ Don't remove or replace information that applies to an older version
�� Don't add new information that applies to a specific version without an applies_to tag
❌ Don't forget that applies_to tags can be used at the page, section, and inline level

🤔 Need help?

Check out the cumulative docs guidelines
Reach out in the #docs Slack channel

ivancea

LGTM

ivancea · 2026-01-12T18:10:41Z

x-pack/plugin/esql/src/main/java/org/elasticsearch/xpack/esql/plan/QuerySettings.java

+            } catch (ParsingException pe) {
+                throw pe;


Is this needed?

Yes, since otherwise it would be swallowed up by the catch (Exception e) below it, which would lead to a very confusing error message :) In theory, we can probably do better than try/catch to begin with, but I didn't want to change whatever underlying logic existed, other than invalidating LOAD.

ivancea · 2026-01-12T18:12:52Z

x-pack/plugin/esql/src/test/java/org/elasticsearch/xpack/esql/parser/SetParserTests.java

+        verifySetUnmappedFields(List.of("FAIL", "NULLIFY"));
+
+        try {
+            statement("SET unmapped_fields=\"" + randomizeCase(UnmappedResolution.LOAD.name()) + "\"; row a = 1");


nit: assertThrows()?

x-pack/plugin/esql/src/test/java/org/elasticsearch/xpack/esql/plan/QuerySettingsTests.java

alex-spies

LGTM with minor comments only

x-pack/plugin/esql/src/main/java/org/elasticsearch/xpack/esql/plan/QuerySettings.java

x-pack/plugin/esql/src/test/java/org/elasticsearch/xpack/esql/parser/SetParserTests.java

x-pack/plugin/esql/src/test/java/org/elasticsearch/xpack/esql/plan/QuerySettingsTests.java

x-pack/plugin/esql/src/test/java/org/elasticsearch/xpack/esql/parser/SetParserTests.java

x-pack/plugin/esql/src/test/java/org/elasticsearch/xpack/esql/plan/QuerySettingsTests.java

…Lalouche/elasticsearch into feat/set_unmapped_nullify_keyword_tp

elasticsearchmachine · 2026-01-14T13:49:57Z

💔 Backport failed

Status	Branch	Result
❌	9.3	Commit could not be cherrypicked due to conflicts

You can use sqren/backport to manually backport by running backport --upstream elastic/elasticsearch --pr 140528

…astic#140528) This PR removes the snapshot protection of FAIL and NULLIFY options for unmapped fields (only LOAD remains protected under snapshot). Follow up to elastic#140463. Related: elastic#138888.

…ew (#140528) (#140657) * ESQL: Enable nullify and fail unmapped resolution in tech-preview (#140528) This PR removes the snapshot protection of FAIL and NULLIFY options for unmapped fields (only LOAD remains protected under snapshot). Follow up to #140463. Related: #138888. * Fix statsAggs tests --------- Co-authored-by: Alexander Spies <alexander.spies@elastic.co>

…astic#140528) This PR removes the snapshot protection of FAIL and NULLIFY options for unmapped fields (only LOAD remains protected under snapshot). Follow up to elastic#140463. Related: elastic#138888.

ESQL: Enable nullify and fail unmapped resolution in tech-preview

ec88a5b

GalLalouche requested a review from alex-spies January 12, 2026 18:04

GalLalouche added >feature Team:Analytics Meta label for analytical engine team (ESQL/Aggs/Geo) auto-backport Automatically create backport pull requests when merged :Analytics/ES|QL AKA ESQL v9.3.0 v9.4.0 labels Jan 12, 2026

Update docs/changelog/140528.yaml

5d650c5

GalLalouche commented Jan 12, 2026

View reviewed changes

Small fixes

c67ab21

ivancea approved these changes Jan 12, 2026

View reviewed changes

GalLalouche added the test-release Trigger CI checks against release build label Jan 12, 2026

CR Fixes

edbd140

alex-spies mentioned this pull request Jan 13, 2026

ESQL: support for mapping-unavailable fields meta-issue #138888

Closed

63 tasks

alex-spies approved these changes Jan 13, 2026

View reviewed changes

GalLalouche added 7 commits January 13, 2026 15:56

More CR fixes

400fdd0

Avoid snapshot, use cap

9bb9e69

Merge branch 'main' into feat/set_unmapped_nullify_keyword_tp

7ac0e7c

Fix SetParserTests for release

f8aeca4

Merge branch 'main' into feat/set_unmapped_nullify_keyword_tp

3acaf9c

Merge branch 'main' into feat/set_unmapped_nullify_keyword_tp

c796d07

Fix failing release test

6b6ea48

alex-spies reviewed Jan 14, 2026

View reviewed changes

x-pack/plugin/esql/src/test/java/org/elasticsearch/xpack/esql/parser/SetParserTests.java Outdated Show resolved Hide resolved

alex-spies reviewed Jan 14, 2026

View reviewed changes

x-pack/plugin/esql/src/test/java/org/elasticsearch/xpack/esql/plan/QuerySettingsTests.java Outdated Show resolved Hide resolved

alex-spies mentioned this pull request Jan 14, 2026

EsqlClientYamlIT "test {p0=esql/250_high_cardinality_keyword/Test avg length}" failing in release tests #140639

Closed

More CR fixes

44b61c0

alex-spies and others added 4 commits January 14, 2026 11:06

Merge branch 'main' into feat/set_unmapped_nullify_keyword_tp

26b9a6f

Merge branch 'main' into feat/set_unmapped_nullify_keyword_tp

ed4a7cd

Merge branch 'feat/set_unmapped_nullify_keyword_tp' of github.com:Gal…

5f87e69

…Lalouche/elasticsearch into feat/set_unmapped_nullify_keyword_tp

Merge branch 'main' into feat/set_unmapped_nullify_keyword_tp

78eec21

alex-spies added the auto-merge-without-approval Automatically merge pull request when CI checks pass (NB doesn't wait for reviews!) label Jan 14, 2026

GalLalouche enabled auto-merge (squash) January 14, 2026 13:44

GalLalouche merged commit e0a15c4 into elastic:main Jan 14, 2026
37 checks passed

GalLalouche deleted the feat/set_unmapped_nullify_keyword_tp branch January 14, 2026 13:49

elasticsearchmachine added the backport pending label Jan 14, 2026

alex-spies mentioned this pull request Jan 14, 2026

[9.3] ESQL: Enable nullify and fail unmapped resolution in tech-preview (#140528) #140657

Merged

luigidellaquila mentioned this pull request Jan 15, 2026

[CI] SetParserTests testSetUnmappedFieldsWrongValue failing #140673

Closed

alex-spies removed the backport pending label Jan 26, 2026

alex-spies mentioned this pull request Feb 12, 2026

ESQL: de-SNAPSHOT unmapped_fields="load" and add documentation #142369

Open

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

ESQL: Enable nullify and fail unmapped resolution in tech-preview#140528

ESQL: Enable nullify and fail unmapped resolution in tech-preview#140528
GalLalouche merged 16 commits intoelastic:mainfrom
GalLalouche:feat/set_unmapped_nullify_keyword_tp

GalLalouche commented Jan 12, 2026 •

edited

Loading

elasticsearchmachine commented Jan 12, 2026

elasticsearchmachine commented Jan 12, 2026

GalLalouche Jan 12, 2026

github-actions bot commented Jan 12, 2026

When to use applies_to tags:

What NOT to do:

ivancea left a comment

ivancea Jan 12, 2026

GalLalouche Jan 12, 2026 •

edited

Loading

ivancea Jan 12, 2026

GalLalouche Jan 12, 2026

Uh oh!

alex-spies left a comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

elasticsearchmachine commented Jan 14, 2026

Labels

4 participants

Conversation

GalLalouche commented Jan 12, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

elasticsearchmachine commented Jan 12, 2026

elasticsearchmachine commented Jan 12, 2026

GalLalouche Jan 12, 2026

Choose a reason for hiding this comment

github-actions bot commented Jan 12, 2026

ℹ️ Important: Docs version tagging

When to use applies_to tags:

What NOT to do:

🤔 Need help?

ivancea left a comment

Choose a reason for hiding this comment

ivancea Jan 12, 2026

Choose a reason for hiding this comment

GalLalouche Jan 12, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

ivancea Jan 12, 2026

Choose a reason for hiding this comment

GalLalouche Jan 12, 2026

Choose a reason for hiding this comment

Uh oh!

alex-spies left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

elasticsearchmachine commented Jan 14, 2026

💔 Backport failed

Labels

4 participants

GalLalouche commented Jan 12, 2026 •

edited

Loading

GalLalouche Jan 12, 2026 •

edited

Loading