[Cloud Security] Fix cluster_id missing error in the Ingest Pipeline

[opauloh]

Summary

This PR Fixes the Ingest Pipeline Error, this error was due to a missing check for the presence of the cluster_id field used in the copy_from.

Checklist

• I have reviewed tips for building integrations and this pull request is aligned with them.
• I have verified that all data streams collect metrics or logs.
• I have added an entry to my package's changelog.yml file.
• I have verified that Kibana version constraints are current according to guidelines.

Author's Checklist

• no pipeline errors in the latest findings docs

How to test this PR locally

Follow the guide described here to test this PR locally.

To collect the necessary data you can execute the following Reindex command in the dev tools (The pipeline is the important part!), point host and credentials to one of the long-running environments

Related issues

• It fixes [Cloud Security] [CSPM] Pipeline error: "field [cluster_id] not present as part of path [cluster_id]" #9435

[elasticmachine]

💚 Build Succeeded

• Buildkite Build
• Commit: 3aa1a78

History

• 💚 Build #9810 succeeded 195bbdf
• 💚 Build #9808 succeeded 70f3780

[elastic-sonarqube]

Quality Gate passed

Kudos, no new issues were introduced!

0 New issues
0 Security Hotspots
No data about Coverage
No data about Duplication

See analysis details on SonarQube

[elasticmachine]

Package cloud_security_posture - 1.9.0-preview02 containing this change is available at https://epr.elastic.co/search?package=cloud_security_posture

[elasticmachine]

Package cloud_security_posture - 1.9.0 containing this change is available at https://epr.elastic.co/search?package=cloud_security_posture