Skip to content

[Azure Logs] Add caller_ip_address field for sign-in logs - #8813

Merged
lucian-ioan merged 8 commits into
elastic:mainfrom
lucian-ioan:fix_pipeline_azure_signin_logs
Jan 7, 2024
Merged

[Azure Logs] Add caller_ip_address field for sign-in logs#8813
lucian-ioan merged 8 commits into
elastic:mainfrom
lucian-ioan:fix_pipeline_azure_signin_logs

Conversation

@lucian-ioan

@lucian-ioan lucian-ioan commented Jan 2, 2024

Copy link
Copy Markdown
Contributor

Proposed commit message

Add pipeline processing for callerIpAddress field to the Azure sign-in logs.

Checklist

  • I have reviewed tips for building integrations and this pull request is aligned with them.
  • I have verified that all data streams collect metrics or logs.
  • I have added an entry to my package's changelog.yml file.
  • I have verified that Kibana version constraints are current according to guidelines.

Author's Checklist

  • [ ]

How to test this PR locally

Related issues

Screenshots

@lucian-ioan

Copy link
Copy Markdown
Contributor Author

Checking all other fields like tenant_id etc. but as far as I can tell those are being processed.

@elasticmachine

elasticmachine commented Jan 4, 2024

Copy link
Copy Markdown

🚀 Benchmarks report

To see the full report comment with /test benchmark fullreport

@lucian-ioan
lucian-ioan marked this pull request as ready for review January 4, 2024 19:14
@lucian-ioan
lucian-ioan requested review from a team as code owners January 4, 2024 19:14
@lucian-ioan
lucian-ioan requested a review from muthu-mps January 4, 2024 19:14
@muthu-mps muthu-mps changed the title [Azure Logs] Add callerIpAddress field for sign-in logs Jan 5, 2024
- set:
if: ctx?.source?.address == null
field: source.address
field: azure.signinlogs.properties.caller_ip_address

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

When we add the signinlogs.caller_ip_address into the signinlogs.properties.caller_ip_address what happens with the following use-cases,

  1. The callerIpAddress field is outside the properties when we receive from the Azure. Can we capture this field in the same way?
  2. In a certain scenarios we will get caller_ip_address inside the properties as well. How do we handle that?

@lucian-ioan lucian-ioan Jan 5, 2024

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

  1. Done, makes sense to keep it as the original.
  2. I couldn't find a scenario where caller_ip_address is inside the properties unless dynamic mapping was applied, which shouldn't be a problem anymore.

Also worth noting that there are no custom log capabilities in Azure for sign-in logs.

@lucian-ioan
lucian-ioan requested a review from muthu-mps January 5, 2024 08:07
ignore_missing: true
ignore_failure: true
- convert:
field: azure.signinlogs.properties.caller_ip_address

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
field: azure.signinlogs.properties.caller_ip_address
field: azure.signinlogs.caller_ip_address
@lucian-ioan
lucian-ioan requested a review from muthu-mps January 5, 2024 09:33
Comment thread packages/azure/data_stream/signinlogs/elasticsearch/ingest_pipeline/default.yml Outdated

@muthu-mps muthu-mps left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@lucian-ioan
lucian-ioan merged commit acb6506 into elastic:main Jan 7, 2024
@elasticmachine

Copy link
Copy Markdown

Package azure - 1.8.3 containing this change is available at https://epr.elastic.co/search?package=azure

@lucian-ioan
lucian-ioan deleted the fix_pipeline_azure_signin_logs branch February 6, 2025 19:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

4 participants