[Cloud Security] Add Cloud Connectors CSPM Support by Omolola-Akinleye · Pull Request #212200 · elastic/kibana

Omolola-Akinleye · 2025-02-24T07:54:51Z

Summary

Summarize your PR. If it involves visual changes include a screenshot or gif.
This PR adds support to Cloud Connector for CSPM.

Adds Cloud Connector Option for Credentials type
Cloud Formation UI opens an external Link to run Cloud Formation template which will generate the Role_ARN and External ID.
User will copy and paste those fields to input fields
Updates Agentless Policy to include cloud connector enabled support and the target cloud server provider
Locally, xpack.cloudSecurityPosture.enableExperimental: ['cloudConnectorsEnabled'] will be set kibana.dev.yml
In prod, xpack.cloudSecurityPosture.enableExperimental: ['cloudConnectorsEnabled'] will be set in kibana.yml and - Cloud Connector support is only available on AWS setup and AWS Deployed environment

How to run Locally:

E2E workflow is not supported yet for Cloud Connectors but we can see the updated UX with AgentPolicy being configured with cloud connector properties {enabled: true, target_csp: 'aws'} and Package Policy being configured
role_arn and external id

Search for `showCloudConnectors={showCloudConnectors}
Change property to true showCloudConnectors={true}
Select Cloud Connectors options and you should see the feature screenshot above

Omolola-Akinleye · 2025-03-06T10:33:03Z

/ci

Omolola-Akinleye · 2025-03-11T13:32:25Z

/ci

Omolola-Akinleye · 2025-03-12T14:06:06Z

/ci

Omolola-Akinleye · 2025-03-12T14:09:01Z

/ci

Omolola-Akinleye · 2025-03-20T20:02:17Z

/ci

elasticmachine · 2025-03-20T21:47:07Z

Pinging @elastic/fleet (Team:Fleet)

juliaElastic

Fleet change LGTM

seanrathier

Great work, just one comment but not blocking.

I was fixated on this section for a while trying to figure out what was happening. Might be good to add a comment if you can.

seanrathier · 2025-05-05T20:03:47Z

...ons/fleet/sections/agent_policy/create_package_policy_page/single_page_layout/hooks/form.tsx

+  const input = packagePolicy.inputs?.filter(
+    (pinput: NewPackagePolicyInput) => pinput.enabled === true
+  )[0];
+  const enabled = input?.streams?.[0]?.vars?.['aws.supports_cloud_connectors']?.value;


Since we are checking for other CSPs, should we be checking for gcp.supports_cloud_connectors and azure.supports_cloud_connectors?

So for right now, Cloud Connectors is supported for aws. However, you raise a good point and maybe we should change the name field to be more generic support_cloud_connectors.

seanrathier · 2025-05-05T20:10:50Z

...ons/fleet/sections/agent_policy/create_package_policy_page/single_page_layout/hooks/form.tsx

+    if (input?.type.includes('aws')) {
+      targetCsp = 'aws';
+    }
+    if (input?.type.includes('gcp')) {


I've seen a similar pattern here and I quickly looked it up. While this is not wrong, but something to consider the following.

function findFirstInstanceCsp(inputType, pattern) { const regex = new RegExp("aws|gcp|azure", "i"); const match = inputType.match(regex); return match ? match[0] : null; } const targetCsp = findFirstInstanceCsp(input?.type);

x-pack/solutions/security/plugins/cloud_security_posture/common/types_old.ts

seanrathier · 2025-05-05T20:38:28Z

...e/public/components/fleet_extensions/setup_technology_selector/setup_technology_selector.tsx

 }: {
  disabled: boolean;
  setupTechnology: SetupTechnology;
+  isAgentless: boolean;


This makes sense, thanks!

seanrathier

Sorry, I approved by accident instead of commenting.

…ibana into cspm_cloud_connectors

Omolola-Akinleye · 2025-05-09T17:40:09Z

@elasticmachine merge upstream

elasticmachine · 2025-05-09T18:22:38Z

💛 Build succeeded, but was flaky

Failed CI Steps

Fleet Cypress Tests #1

Test Failures

[job] [logs] Fleet Cypress Tests #1 / View agents list Agent status filter should filter on healthy and unhealthy
[job] [logs] Fleet Cypress Tests #1 / View agents list Bulk actions should allow to bulk upgrade agents and cancel that upgrade

Metrics [docs]

Async chunks

Total size of all lazy-loaded chunks that will be downloaded as the user navigates the app

id	before	after	diff
`cloudSecurityPosture`	518.4KB	524.4KB	+6.0KB
`fleet`	1.7MB	1.7MB	+783.0B
total			+6.7KB

Page load bundle

Size of the bundles that are downloaded on every page load. Target size is below 100kb

id	before	after	diff
`cloudSecurityPosture`	18.0KB	18.1KB	+101.0B

History

💚 Build #300165 succeeded 533496f
💔 Build #300128 failed 0b0c327
💔 Build #300099 failed 60b499d
💔 Build #299870 failed a73d9ee
💔 Build #298609 failed fc03452

cc @Omolola-Akinleye

## Summary Summarize your PR. If it involves visual changes include a screenshot or gif. This PR adds support to Cloud Connector for CSPM. - Adds Cloud Connector Option for Credentials type - Cloud Formation UI opens an external Link to run Cloud Formation template which will generate the Role_ARN and External ID. - User will copy and paste those fields to input fields - Updates Agentless Policy to include cloud connector enabled support and the target `cloud server provider` - Locally, ` xpack.cloudSecurityPosture.enableExperimental: ['cloudConnectorsEnabled']` will be set `kibana.dev.yml` - In prod, ` xpack.cloudSecurityPosture.enableExperimental: ['cloudConnectorsEnabled']` will be set in `kibana.yml` and - Cloud Connector support is only available on AWS setup and AWS Deployed environment <img width="1723" alt="Screenshot 2025-05-05 at 9 47 17 AM" src="https://github.com/user-attachments/assets/13d29190-abfb-4cd0-9f1b-9d0012d1f70c" /> <img width="971" alt="Screenshot 2025-05-05 at 9 47 32 AM" src="https://github.com/user-attachments/assets/043cb3a0-0760-4dfd-9381-5fee37068848" /> ### How to run Locally: E2E workflow is not supported yet for Cloud Connectors but we can see the updated UX with AgentPolicy being configured with cloud connector properties {enabled: true, target_csp: 'aws'} and Package Policy being configured `role_arn` and `external id` 1. Search for `showCloudConnectors={showCloudConnectors} 2. Change property to true `showCloudConnectors={true}` 3. Select Cloud Connectors options and you should see the feature screenshot above

add Cloud Connectors Support

29291b9

Omolola-Akinleye added the ci:cloud-deploy Create or update a Cloud deployment label Feb 24, 2025

Omolola-Akinleye self-assigned this Feb 24, 2025

Omolola-Akinleye added 2 commits March 4, 2025 12:43

hide feature in aws cluster

b5609b6

fix hiding cloud connector options

580d5c0

fix translations and build issue

ce03c99

fix type issues

0def880

Merge branch 'main' into cspm_cloud_connectors

6a5cb7c

fix agentless type check

d29652a

Omolola-Akinleye marked this pull request as ready for review March 18, 2025 15:30

Omolola-Akinleye requested review from a team as code owners March 18, 2025 15:30

Omolola-Akinleye changed the title ~~[Cloud Security] Add Cloud Connectors CSPM Support~~ Mar 18, 2025

show cloud connectors poc

48e97ac

botelastic bot added the Team:Fleet Team label for Observability Data Collection Fleet team label Mar 20, 2025

Omolola-Akinleye added 9 commits March 24, 2025 23:43

Merge branch 'main' into cspm_cloud_connectors

612a07a

Merge branch 'main' into cspm_cloud_connectors

ec9dea1

refactor cloud_connectors ui

8483a84

fix type check

cd594e6

fix aws credentials type

3a2d7d2

Merge branch 'main' into cspm_cloud_connectors

169bfad

fix parent posture integration setup technology bug

4ff9ed2

fix unit tests

c21fc6e

fix unit tests

64313e2

Omolola-Akinleye added 2 commits April 30, 2025 11:50

fix broken ftr

8c86a3b

fix ftrs for cspm aws

96c3884

Omolola-Akinleye changed the title ~~[Cloud Security] Add Cloud Connectors CSPM Support poc~~ May 5, 2025

Merge branch 'main' into cspm_cloud_connectors

fc03452

Omolola-Akinleye added backport:skip This PR does not require backporting v8.19.0 v9.1.0 release_note:feature Makes this part of the condensed release notes labels May 5, 2025

juliaElastic approved these changes May 6, 2025

View reviewed changes

seanrathier approved these changes May 6, 2025

View reviewed changes

seanrathier self-requested a review May 6, 2025 21:18

Omolola-Akinleye added 4 commits May 7, 2025 11:02

Merge remote-tracking branch 'upstream/main' into cspm_cloud_connectors

410b66a

fix flaky FTR tests

5b3d2a2

Merge branch 'cspm_cloud_connectors' of github.com:Omolola-Akinleye/k…

4aeecdd

…ibana into cspm_cloud_connectors

address pr changes

a73d9ee

Omolola-Akinleye enabled auto-merge (squash) May 8, 2025 18:42

fix create default agent-based test

60b499d

Omolola-Akinleye removed the request for review from seanrathier May 9, 2025 14:06

Omolola-Akinleye added 2 commits May 9, 2025 10:41

fix type issues

0b0c327

fix types check build

533496f

Merge branch 'main' into cspm_cloud_connectors

6c7e8cf

Omolola-Akinleye merged commit 2bae707 into elastic:main May 9, 2025
9 checks passed

kibanamachine mentioned this pull request May 30, 2025

[Cloud Secutity Posture] Add cloud connector support for asset discovery #221689

Merged

kibanamachine mentioned this pull request Jun 3, 2025

[Security Solution][Data Quality Dashboard] Remove tour guide #222311

Merged

kibanamachine mentioned this pull request Oct 15, 2025

[UII] Use explicit fleet server & output IDs for agentless on ECH and Serverless #225188

Merged

2 tasks

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[Cloud Security] Add Cloud Connectors CSPM Support#212200

[Cloud Security] Add Cloud Connectors CSPM Support#212200
Omolola-Akinleye merged 32 commits intoelastic:mainfrom
Omolola-Akinleye:cspm_cloud_connectors

Omolola-Akinleye commented Feb 24, 2025 •

edited

Loading

Omolola-Akinleye commented Mar 6, 2025

Omolola-Akinleye commented Mar 11, 2025

Omolola-Akinleye commented Mar 12, 2025

Omolola-Akinleye commented Mar 12, 2025

Omolola-Akinleye commented Mar 20, 2025

elasticmachine commented Mar 20, 2025

juliaElastic left a comment

seanrathier left a comment

seanrathier May 5, 2025

Omolola-Akinleye May 7, 2025

seanrathier May 5, 2025

Uh oh!

Uh oh!

seanrathier May 5, 2025

seanrathier left a comment

Omolola-Akinleye commented May 9, 2025

elasticmachine commented May 9, 2025 •

edited

Loading

Uh oh!

Labels

4 participants

Conversation

Omolola-Akinleye commented Feb 24, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Summary

How to run Locally:

Omolola-Akinleye commented Mar 6, 2025

Omolola-Akinleye commented Mar 11, 2025

Omolola-Akinleye commented Mar 12, 2025

Omolola-Akinleye commented Mar 12, 2025

Omolola-Akinleye commented Mar 20, 2025

elasticmachine commented Mar 20, 2025

juliaElastic left a comment

Choose a reason for hiding this comment

seanrathier left a comment

Choose a reason for hiding this comment

seanrathier May 5, 2025

Choose a reason for hiding this comment

Omolola-Akinleye May 7, 2025

Choose a reason for hiding this comment

seanrathier May 5, 2025

Choose a reason for hiding this comment

Uh oh!

Uh oh!

seanrathier May 5, 2025

Choose a reason for hiding this comment

seanrathier left a comment

Choose a reason for hiding this comment

Omolola-Akinleye commented May 9, 2025

elasticmachine commented May 9, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

💛 Build succeeded, but was flaky

Failed CI Steps

Test Failures

Metrics [docs]

Async chunks

Page load bundle

History

Uh oh!

Labels

4 participants

Omolola-Akinleye commented Feb 24, 2025 •

edited

Loading

elasticmachine commented May 9, 2025 •

edited

Loading