Skip to content

ES|QL Absent and AbsentOverTime functions#134475

Merged
leontyevdv merged 53 commits intoelastic:mainfrom
leontyevdv:feature/esql-absent-and-absent-over-time-functions
Sep 12, 2025
Merged

ES|QL Absent and AbsentOverTime functions#134475
leontyevdv merged 53 commits intoelastic:mainfrom
leontyevdv:feature/esql-absent-and-absent-over-time-functions

Conversation

@leontyevdv
Copy link
Contributor

@leontyevdv leontyevdv commented Sep 10, 2025

Add two new ES|QL functions:

  • ABSENT checks for the absence of a field in the output result. Absence means that the input expression yields null values only or nothing.
  • ABSENT_OVER_TIME is similar to ABSENT, but is used to check the presence of values over a time series in the given field.

Closes #131069
leontyevdv and others added 30 commits September 2, 2025 15:45
@leontyevdv
ES|QL: Add PRESENT ES|QL function
0ba57ea 
Add a new ES|QL function that checks for the presence of a field in the
output result. Presence means that the input expression yields any
non-null value.

Part of elastic#131069
[CI] Auto commit changes from spotless
8bbf92c
@leontyevdv
ES|QL: Add PRESENT ES|QL function
004542b 
Add unit tests and documentation for the PRESENT function.

Part of elastic#131069
@leontyevdv
Merge remote-tracking branch 'origin/feature/esql-present-function' i…
134929b 
…nto feature/esql-present-function
@leontyevdv
ES|QL: Add PRESENT ES|QL function
da9774f 
Clean-up of the PRESENT function.

Part of elastic#131069
@leontyevdv
Merge branch 'main' into feature/esql-present-function
06632d3 
# Conflicts:
#	x-pack/plugin/esql/src/main/java/org/elasticsearch/xpack/esql/action/EsqlCapabilities.java
@leontyevdv
ES|QL: Add PRESENT ES|QL function
7f8d913 
- Change intermediate state for using boolean
- Add unit tests for PresentAggregatorFunctionTests and
PresentGroupingAggregatorFunctionTests

Part of elastic#131069
@leontyevdv
ES|QL: Add PRESENT ES|QL function
59d6b3b 
- Add VerifierTests

Part of elastic#131069
@leontyevdv
ES|QL: Add PRESENT ES|QL function
f537b8b 
- Add union_types csv tests

Part of elastic#131069
@leontyevdv
Merge branch 'main' into feature/esql-present-function
4c38aaa
@leontyevdv
ES|QL: Add PRESENT ES|QL function
0a5721f 
- Fix unit tests

Part of elastic#131069
[CI] Auto commit changes from spotless
bb54a7b
@leontyevdv
ES|QL: Add PRESENT_OVER_TIME ES|QL function
c2a7edb 
- Comment out TestLogging on CsvTests
- Add missing DataTypes to the function

Part of elastic#131069
[CI] Auto commit changes from spotless
63fa255
@leontyevdv
ES|QL: Add PRESENT_OVER_TIME ES|QL function
ec176ee 
- Improve documentation

Part of elastic#131069
@leontyevdv
ES|QL: Add PRESENT ES|QL function
bf0a02c 
- Optimize AggregatorFunctions

Part of elastic#131069
@leontyevdv
Merge branch 'main' into feature/esql-present-function
7b4d4cf
[CI] Auto commit changes from spotless
bbd5a18
@leontyevdv
ES|QL: Add PRESENT ES|QL function
d916601 
- Fix Rest Tests

Part of elastic#131069
@leontyevdv
ES|QL: Add PRESENT_OVER_TIME ES|QL function
478f545 
Add PRESENT_OVER_TIME ES|QL function.

Part of elastic#131069
@leontyevdv
ES|QL: Add PRESENT_OVER_TIME ES|QL function
6ac7cba 
Add PRESENT_OVER_TIME ES|QL function.

Part of elastic#131069
@leontyevdv
ES|QL: Add PRESENT ES|QL function
55dcb0b 
Optimize AggregatorFunction

Part of elastic#131069
@leontyevdv
Merge branch 'feature/esql-present-function' into feature/esql-presen…
b5682be 
…t-over-time-function
@leontyevdv
ES|QL: Add PRESENT ES|QL function
23ccfe7 
Optimize PresentGroupingAggregatorFunction

Part of elastic#131069
@leontyevdv
Merge branch 'main' into feature/esql-present-function
236267b
@leontyevdv
Merge branch 'feature/esql-present-function' into feature/esql-presen…
5de0c63 
…t-over-time-function
@leontyevdv
ES|QL: Add PRESENT ES|QL function
3f79391 
Add PresentErrorTests

Part of elastic#131069
@leontyevdv
Merge branch 'feature/esql-present-function' into feature/esql-presen…
7ef4699 
…t-over-time-function
@leontyevdv
ES|QL: Add PRESENT ES|QL function
7cec7c3 
Add docs

Part of elastic#131069
@leontyevdv
Merge branch 'feature/esql-present-function' into feature/esql-presen…
9c419be 
…t-over-time-function
@leontyevdv leontyevdv added Team:Analytics Meta label for analytical engine team (ESQL/Aggs/Geo) :StorageEngine/TSDB You know, for Metrics :Analytics/ES|QL AKA ESQL Team:StorageEngine v9.2.0 :StorageEngine/ES|QL Timeseries / metrics / PromQL / logsdb capabilities in ES|QL labels Sep 10, 2025
@elasticsearchmachine
Copy link
Collaborator

elasticsearchmachine commented Sep 10, 2025

Pinging @elastic/es-analytical-engine (Team:Analytics)
@elasticsearchmachine
Copy link
Collaborator

elasticsearchmachine commented Sep 10, 2025

Pinging @elastic/es-storage-engine (Team:StorageEngine)
@leontyevdv leontyevdv changed the title Feature/esql absent and absent over time functions Sep 10, 2025
@github-actions
Copy link
Contributor

github-actions bot commented Sep 10, 2025 •
edited
Loading

🔍 Preview links for changed docs
@github-actions
Copy link
Contributor

github-actions bot commented Sep 10, 2025

ℹ️ Important: Docs version tagging

👋 Thanks for updating the docs! Just a friendly reminder that our docs are now cumulative. This means all 9.x versions are documented on the same page and published off of the main branch, instead of creating separate pages for each minor version.

We use applies_to tags to mark version-specific features and changes.

Expand for a quick overview

When to use applies_to tags:

✅ At the page level to indicate which products/deployments the content applies to (mandatory)
✅ When features change state (e.g. preview, ga) in a specific version
✅ When availability differs across deployments and environments

What NOT to do:

❌ Don't remove or replace information that applies to an older version
❌ Don't add new information that applies to a specific version without an applies_to tag
❌ Don't forget that applies_to tags can be used at the page, section, and inline level

🤔 Need help?
@elasticsearchmachine
Copy link
Collaborator

elasticsearchmachine commented Sep 10, 2025

Hi @leontyevdv, I've created a changelog YAML for you.
dnhatn
dnhatn approved these changes Sep 10, 2025
View reviewed changes
Copy link
Member

@dnhatn dnhatn left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks great. Thanks Dima!
elasticsearchmachine and others added 9 commits September 10, 2025 17:04
[CI] Auto commit changes from spotless
e82feb6
@leontyevdv
Merge branch 'main' into feature/esql-absent-and-absent-over-time-fun…
00ea0a9 
…ctions

# Conflicts:
#	x-pack/plugin/esql/src/main/java/org/elasticsearch/xpack/esql/action/EsqlCapabilities.java
@leontyevdv
ES|QL: Add ABSENT ES|QL function
dad8279 
- Improve docs
- Add tests

Part of elastic#131069
@leontyevdv
ES|QL: Add ABSENT ES|QL function
68a3e59 
- Fix docs

Part of elastic#131069
@leontyevdv
Merge branch 'main' into feature/esql-absent-and-absent-over-time-fun…
cf6ebf1 
…ctions
@leontyevdv
ES|QL: Add ABSENT ES|QL function
55dde93 
- Fix docs

Part of elastic#131069
@leontyevdv
Merge branch 'main' into feature/esql-absent-and-absent-over-time-fun…
ab46860 
…ctions
@leontyevdv
Merge branch 'main' into feature/esql-absent-and-absent-over-time-fun…
3636458 
…ctions

# Conflicts:
#	x-pack/plugin/esql/src/main/java/org/elasticsearch/xpack/esql/action/EsqlCapabilities.java
@leontyevdv
ES|QL: Add ABSENT ES|QL function
a9e1dcd 
- Fix docs

Part of elastic#131069
@leontyevdv leontyevdv merged commit d73f051 into elastic:main Sep 12, 2025
32 of 34 checks passed
@jordan-powers jordan-powers mentioned this pull request Sep 15, 2025
Merged
jordan-powers added a commit that referenced this pull request Sep 15, 2025
@jordan-powers
Increment esql function count (#134745)
0dff3aa 
In #134475 we added another ES|QL function, but forgot to increment the
expected function count in the "60_usage/Basic ESQL usage output
(telemetry) non-snapshot version" test, causing release tests to fail. This
PR fixes that.
mridula-s109 pushed a commit to mridula-s109/elasticsearch that referenced this pull request Sep 17, 2025
@leontyevdv @mridula-s109
ES|QL Absent and AbsentOverTime functions (elastic#134475)
befe02b 
* ES|QL: Add ABSENT ES|QL function

- Add an ABSENT function
- Add an ABSENT_OVER_TIME function

Closes elastic#131069
mridula-s109 pushed a commit to mridula-s109/elasticsearch that referenced this pull request Sep 17, 2025
@jordan-powers @mridula-s109
Increment esql function count (elastic#134745)
5a4d247 
In elastic#134475 we added another ES|QL function, but forgot to increment the
expected function count in the "60_usage/Basic ESQL usage output
(telemetry) non-snapshot version" test, causing release tests to fail. This
PR fixes that.
gmjehovich pushed a commit to gmjehovich/elasticsearch that referenced this pull request Sep 18, 2025
@leontyevdv @gmjehovich
ES|QL Absent and AbsentOverTime functions (elastic#134475)
153287c 
* ES|QL: Add ABSENT ES|QL function

- Add an ABSENT function
- Add an ABSENT_OVER_TIME function

Closes elastic#131069
gmjehovich pushed a commit to gmjehovich/elasticsearch that referenced this pull request Sep 18, 2025
@jordan-powers @gmjehovich
Increment esql function count (elastic#134745)
11b204e 
In elastic#134475 we added another ES|QL function, but forgot to increment the
expected function count in the "60_usage/Basic ESQL usage output
(telemetry) non-snapshot version" test, causing release tests to fail. This
PR fixes that.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

:Analytics/ES|QL AKA ESQL >enhancement :StorageEngine/ES|QL Timeseries / metrics / PromQL / logsdb capabilities in ES|QL :StorageEngine/TSDB You know, for Metrics Team:Analytics Meta label for analytical engine team (ESQL/Aggs/Geo) Team:StorageEngine v9.2.0

3 participants

@leontyevdv @elasticsearchmachine @dnhatn