Skip to content

[carbon_black_cloud] Add Carbon Black Cloud package. - #2760

Merged
andrewkroh merged 5 commits into
elastic:mainfrom
darshan-elastic:package_carbon_black_cloud
Apr 7, 2022
Merged

[carbon_black_cloud] Add Carbon Black Cloud package.#2760
andrewkroh merged 5 commits into
elastic:mainfrom
darshan-elastic:package_carbon_black_cloud

Conversation

@darshan-elastic

Copy link
Copy Markdown
Contributor

What does this PR do?

  • Generated the skeleton of the Carbon Black Cloud integration package.
  • Added 5 data streams (Alert, Audit, Endpoint Event, Watchlist Hit, Asset Vulnerability Summary).
  • Added data collection logic for all 5 data streams.
  • Added the ingest pipeline for all the data streams.
  • Mapped fields according to the ECS schema and added Fields metadata in the appropriate yml files
  • Added dashboards and visualizations.
  • Added test for pipeline for all the data streams.
  • Added system test cases for data streams that uses httpjson.

Checklist

  • I have reviewed tips for building integrations and this pull request is aligned with them.
  • I have verified that all data streams collect metrics or logs.
  • I have added an entry to my package's changelog.yml file.
  • I have verified that Kibana version constraints are current according to guidelines.

How to test this PR locally

  • Clone integrations repo.
  • Install elastic-package locally.
  • Start elastic stack using elastic-package.
  • Move to integrations/packages/carbon_black_cloud directory.
  • Run the following command to run tests.
    elastic-package test

Screenshots

image
image
image
image
image
image
image
image

@elasticmachine

elasticmachine commented Mar 2, 2022

Copy link
Copy Markdown

💚 Build Succeeded

the below badges are clickable and redirect to their specific view in the CI or DOCS
Pipeline View Test View Changes Artifacts preview preview

Expand to view the summary

Build stats

  • Start Time: 2022-04-07T04:56:09.111+0000

  • Duration: 15 min 42 sec

Test stats 🧪

Test Results
Failed 0
Passed 97
Skipped 0
Total 97

🤖 GitHub comments

To re-run your PR in the CI, just comment with:

  • /test : Re-trigger the build.
@elasticmachine

Copy link
Copy Markdown

Pinging @elastic/security-external-integrations (Team:Security-External Integrations)

@andrewkroh
andrewkroh requested a review from a team March 3, 2022 13:09
@andrewkroh

Copy link
Copy Markdown
Contributor

/test

Comment thread packages/carbon_black_cloud/data_stream/alert/agent/stream/httpjson.yml.hbs Outdated
Comment thread packages/carbon_black_cloud/data_stream/alert/sample_event.json Outdated
@darshan-elastic
darshan-elastic requested a review from a team as a code owner March 16, 2022 14:00
@andrewkroh

Copy link
Copy Markdown
Contributor

/test

1 similar comment
@andrewkroh

Copy link
Copy Markdown
Contributor

/test

@jsoriano

Copy link
Copy Markdown
Contributor

/test

@jamiehynds

Copy link
Copy Markdown

@andrewkroh looks like the code owner was accidentally set to the ecosystems team. Not sure if we can update it, or if it has to be done by @darshan-elastic..

@darshan-elastic

Copy link
Copy Markdown
Contributor Author

@jamiehynds, I'm also not able to update the code owners in the PR.

@andrewkroh

Copy link
Copy Markdown
Contributor

/test

@mtojek mtojek left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

CODEOWNERS looks good.

Comment thread packages/carbon_black_cloud/_dev/build/docs/README.md Outdated
Comment thread packages/carbon_black_cloud/_dev/build/docs/README.md
Comment thread packages/carbon_black_cloud/changelog.yml Outdated
Comment thread packages/carbon_black_cloud/data_stream/alert/fields/ecs.yml
Comment thread packages/carbon_black_cloud/data_stream/alert/sample_event.json Outdated
@jamiehynds jamiehynds linked an issue Apr 6, 2022 that may be closed by this pull request
15 tasks
@andrewkroh
andrewkroh merged commit 3c47f71 into elastic:main Apr 7, 2022
@CyberTaoFlow

CyberTaoFlow commented Apr 7, 2022

Copy link
Copy Markdown

I wanted to mention in environments where the hosts are windows machines that are joined to an AD domain the values that the ingest pipeline place into host.name and/or host.hostname and user.name contain the AD domain name in NT format:

TESTORG\user

I add the GROK processors following to correct that :

  {
    "rename": {
      "field": "json.device_name",
      "target_field": "host.hostname",
      "ignore_missing": true
    }
  },
  {
    "grok": {
      "field": "host.hostname",
      "patterns": [
        "^(%{DATA:user.domain})\\\\(%{GREEDYDATA:host.name})$"
      ],
      "ignore_missing": true,
      "ignore_failure": true
    }
  },
  {
    "grok": {
      "field": "json.device_username",
      "patterns": [
        "^(%{DATA:user.domain})\\\\(%{GREEDYDATA:user.name})$"
      ],
      "ignore_missing": true,
      "ignore_failure": true
    }
  },

@jamiehynds

Copy link
Copy Markdown

Thanks @CyberTaoFlow for the feedback. We've addressed your feedback via this PR: #3106

@andrewkroh andrewkroh added Crest Contributions from Crest developement team. New Integration Issue or pull request for creating a new integration package. labels Aug 13, 2024
orestisfl pushed a commit to orestisfl/integrations that referenced this pull request May 15, 2026
- Generated the skeleton of the Carbon Black Cloud integration package.
- Added 5 data streams (Alert, Audit, Endpoint Event, Watchlist Hit, Asset Vulnerability Summary).
- Added data collection logic for all 5 data streams.
- Added the ingest pipeline for all the data streams.
- Mapped fields according to the ECS schema and added Fields metadata in the appropriate yml files
- Added dashboards and visualizations.
- Added test for pipeline for all the data streams.
- Added system test cases for data streams that uses httpjson.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Crest Contributions from Crest developement team. Integration:carbon_black_cloud VMware Carbon Black Cloud New Integration Issue or pull request for creating a new integration package.

8 participants