Skip to content

ti_abusech: fix deleted_at pipeline error after upgrade to v4 - #19491

Merged
efd6 merged 1 commit into
elastic:mainfrom
efd6:19490-ti_abusech
Jun 15, 2026
Merged

ti_abusech: fix deleted_at pipeline error after upgrade to v4#19491
efd6 merged 1 commit into
elastic:mainfrom
efd6:19490-ti_abusech

Conversation

@efd6

@efd6 efd6 commented Jun 11, 2026

Copy link
Copy Markdown
Contributor

Proposed commit message

ti_abusech: fix deleted_at pipeline error after upgrade to v4

The date processor for deleted_at runs unconditionally but the
Painless script that computes the value is guarded by
_conf.ioc_expiration_duration being present. When upgrading from
an earlier version the agent may still be running the old template
which does not inject this field, causing a hard error on every
document.

Widen the script condition to always compute deleted_at and fall
back to a 90-day expiration when ioc_expiration_duration is absent.
Guard the date processor so a missing value is not a fatal error.
Apply the same fix to all six data streams and add pipeline tests
that simulate the upgrade scenario.

Fixes #19490

Checklist

  • I have reviewed tips for building integrations and this pull request is aligned with them.
  • I have verified that all data streams collect metrics or logs.
  • I have added an entry to my package's changelog.yml file.
  • I have verified that Kibana version constraints are current according to guidelines.
  • I have verified that any added dashboard complies with Kibana's Dashboard good practices

Author's Checklist

  • [ ]

How to test this PR locally

Related issues

Screenshots

@efd6 efd6 self-assigned this Jun 11, 2026
@efd6 efd6 added Integration:ti_abusech abuse.ch bugfix Pull request that fixes a bug issue Team:Security-Service Integrations Security Service Integrations team [elastic/security-service-integrations] labels Jun 11, 2026
The date processor for deleted_at runs unconditionally but the
Painless script that computes the value is guarded by
_conf.ioc_expiration_duration being present. When upgrading from
an earlier version the agent may still be running the old template
which does not inject this field, causing a hard error on every
document.

Widen the script condition to always compute deleted_at and fall
back to a 90-day expiration when ioc_expiration_duration is absent.
Guard the date processor so a missing value is not a fatal error.
Apply the same fix to all six data streams and add pipeline tests
that simulate the upgrade scenario.

Fixes elastic#19490
@efd6
efd6 force-pushed the 19490-ti_abusech branch from 2a10282 to ea08e90 Compare June 11, 2026 03:01
@github-actions

Copy link
Copy Markdown
Contributor

✅ Elastic Docs Style Checker (Vale)

No issues found on modified lines!


The Vale linter checks documentation changes against the Elastic Docs style guide. To use Vale locally or report issues, refer to Elastic style guide for Vale.

@elastic-vault-github-plugin-prod

Copy link
Copy Markdown
Contributor

✅ All changelog entries have the correct PR link.

@elastic-vault-github-plugin-prod

Copy link
Copy Markdown
Contributor

🚀 Benchmarks report

To see the full report comment with /test benchmark fullreport

@elasticmachine

Copy link
Copy Markdown

💚 Build Succeeded

cc @efd6

@efd6
efd6 marked this pull request as ready for review June 11, 2026 03:41
@efd6
efd6 requested review from a team as code owners June 11, 2026 03:41
@infra-vault-gh-plugin-prod

Copy link
Copy Markdown

Pinging @elastic/security-service-integrations (Team:Security-Service Integrations)

@navnit-elastic navnit-elastic left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@efd6
efd6 merged commit 1049f0b into elastic:main Jun 15, 2026
9 checks passed
@elastic-vault-github-plugin-prod

Copy link
Copy Markdown
Contributor

Package ti_abusech - 4.1.1 containing this change is available at https://epr.elastic.co/package/ti_abusech/4.1.1/

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

bugfix Pull request that fixes a bug issue Integration:ti_abusech abuse.ch Team:Security-Service Integrations Security Service Integrations team [elastic/security-service-integrations]

3 participants