Skip to content

x-pack/filebeat/input/cel: add data stream identification to status updates#47229

Merged
efd6 merged 1 commit intoelastic:mainfrom
efd6:cel_data_stream_identities
Oct 30, 2025
Merged

x-pack/filebeat/input/cel: add data stream identification to status updates#47229
efd6 merged 1 commit intoelastic:mainfrom
efd6:cel_data_stream_identities

Conversation

@efd6
Copy link
Contributor

@efd6 efd6 commented Oct 21, 2025

Proposed commit message

See title.

Checklist

  • My code follows the style guidelines of this project
  • I have commented my code, particularly in hard-to-understand areas
  • I have made corresponding changes to the documentation
  • I have made corresponding change to the default configuration files
  • I have added tests that prove my fix is effective or that my feature works
  • I have added an entry in ./changelog/fragments using the changelog tool.

Disruptive User Impact

Author's Checklist

  • [ ]

How to test this PR locally

Related issues

Use cases

Screenshots

Logs

@efd6 efd6 self-assigned this Oct 21, 2025
@efd6 efd6 added enhancement Filebeat Filebeat Team:Security-Service Integrations Security Service Integrations Team backport-active-8 Automated backport with mergify to all the active 8.[0-9]+ branches backport-active-9 Automated backport with mergify to all the active 9.[0-9]+ branches labels Oct 21, 2025
@botelastic botelastic bot added needs_team Indicates that the issue/PR needs a Team:* label and removed needs_team Indicates that the issue/PR needs a Team:* label labels Oct 21, 2025
@github-actions
Copy link
Contributor

🤖 GitHub comments

Expand to view the GitHub comments

Just comment with:

  • run docs-build : Re-trigger the docs validation. (use unformatted text in the comment!)

@efd6 efd6 force-pushed the cel_data_stream_identities branch from 59cb2d1 to 93f898d Compare October 21, 2025 21:08
@efd6 efd6 marked this pull request as ready for review October 21, 2025 23:03
@efd6 efd6 requested a review from a team as a code owner October 21, 2025 23:03
@elasticmachine
Copy link
Contributor

Pinging @elastic/security-service-integrations (Team:Security-Service Integrations)

Copy link
Contributor

@chemamartinez chemamartinez left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It looks good to me but I am missing something, is this data stream name expected to come from user config? I don't see it as an available option when configuring the input.

@efd6
Copy link
Contributor Author

efd6 commented Oct 29, 2025

The config fields are populated by fleet. You can see this in this test diagnostic bundle pre-config snippet.

inputs:
    - data_stream:
        namespace: "91406"
      id: tcp-symantec-e5d6b11c-d85b-4344-83d5-3d981d2e1ebb
      meta:
        package:
            name: symantec_endpoint
            version: 2.20.0
      name: symantec_endpoint-log-91406
      package_policy_id: e5d6b11c-d85b-4344-83d5-3d981d2e1ebb
      revision: 1
      streams:
        - data_stream:
            dataset: symantec_endpoint.log
            type: logs
          fields:
            _conf:
                remove_mapped_fields: false
                tz_offset: UTC
          fields_under_root: true
          host: 0.0.0.0:9514
          id: tcp-symantec_endpoint.log-e5d6b11c-d85b-4344-83d5-3d981d2e1ebb
          max_message_size: 1 MiB
          publisher_pipeline:
            disable_host: true
          tags:
            - preserve_original_event
            - symantec-endpoint-log
            - forwarded
      type: tcp
      use_output: default

We are getting the value from inputs[0].streams[0].data_stream.dataset.

@efd6 efd6 merged commit 65e1f2d into elastic:main Oct 30, 2025
36 of 39 checks passed
@github-actions
Copy link
Contributor

@Mergifyio backport 8.19 9.1 9.2

@mergify
Copy link
Contributor

mergify bot commented Oct 30, 2025

backport 8.19 9.1 9.2

✅ Backports have been created

Details
mergify bot pushed a commit that referenced this pull request Oct 30, 2025
…pdates (#47229)

(cherry picked from commit 65e1f2d)

# Conflicts:
#	x-pack/filebeat/input/cel/input.go
mergify bot pushed a commit that referenced this pull request Oct 30, 2025
…pdates (#47229)

(cherry picked from commit 65e1f2d)

# Conflicts:
#	x-pack/filebeat/input/cel/input.go
#	x-pack/filebeat/input/cel/input_manager.go
mergify bot pushed a commit that referenced this pull request Oct 30, 2025
efd6 added a commit that referenced this pull request Oct 30, 2025
…pdates (#47229) (#47408)

(cherry picked from commit 65e1f2d)

Co-authored-by: Dan Kortschak <dan.kortschak@elastic.co>
efd6 added a commit that referenced this pull request Oct 30, 2025
…ntification to status updates (#47407)

* x-pack/filebeat/input/cel: add data stream identification to status updates (#47229)

(cherry picked from commit 65e1f2d)

# Conflicts:
#	x-pack/filebeat/input/cel/input.go
#	x-pack/filebeat/input/cel/input_manager.go

* resolve conflicts

---------

Co-authored-by: Dan Kortschak <dan.kortschak@elastic.co>
efd6 added a commit that referenced this pull request Oct 30, 2025
…entification to status updates (#47406)

* x-pack/filebeat/input/cel: add data stream identification to status updates (#47229)

(cherry picked from commit 65e1f2d)

# Conflicts:
#	x-pack/filebeat/input/cel/input.go

* resolve conflicts

---------

Co-authored-by: Dan Kortschak <dan.kortschak@elastic.co>
andrzej-stencel pushed a commit to andrzej-stencel/beats that referenced this pull request Dec 1, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

backport-active-8 Automated backport with mergify to all the active 8.[0-9]+ branches backport-active-9 Automated backport with mergify to all the active 9.[0-9]+ branches enhancement Filebeat Filebeat Team:Security-Service Integrations Security Service Integrations Team

3 participants