feat: add status reporting to CloudWatch by Kavindu-Dodan · Pull Request #45679 · elastic/beats

Kavindu-Dodan · 2025-07-31T20:21:14Z

Proposed commit message

Adds Status reporting for AWS CloudWatch input. I have introduced following,

cwStateReporter : This proxy the status to the actual status reporter. Validate status change from current before conveying status to internal reporter.
debugCWStatusReporter: Performs debug logging when context-bound reporter is missing. For example, this happens in standalone mode

Checklist

My code follows the style guidelines of this project
I have commented my code, particularly in hard-to-understand areas
I have made corresponding changes to the documentation
I have made corresponding change to the default configuration files
I have added tests that prove my fix is effective or that my feature works
I have added an entry in CHANGELOG.next.asciidoc or CHANGELOG-developer.next.asciidoc.

Disruptive User Impact

None - Status reports are utilized by the Agent. In standalone mode, logs are added in Debug level

How to test this PR locally

Run standalone filebeat with CloudWatch input & debug logs
Observe debug logs with CloudWatch input status updated: prefix for status changes

See below log entries from a standalone run,

Startup and configuration

Degraded - network connectivity issue

Back to running status

Related issues

Fixes #44648

github-actions · 2025-07-31T20:21:25Z

🤖 GitHub comments

Expand to view the GitHub comments

Just comment with:

run docs-build : Re-trigger the docs validation. (use unformatted text in the comment!)

elasticmachine · 2025-08-01T19:25:56Z

Pinging @elastic/obs-ds-hosted-services (Team:obs-ds-hosted-services)

x-pack/filebeat/input/awscloudwatch/state_reporter.go

Signed-off-by: Kavindu Dodanduwa <kavindu.dodanduwa@elastic.co>

x-pack/filebeat/input/awscloudwatch/input.go

Signed-off-by: Kavindu Dodanduwa <kavindu.dodanduwa@elastic.co>

taylor-swanson

The status reporting changes LGTM, I'll defer the rest of the review to the codeowners of this input.

x-pack/filebeat/input/awscloudwatch/state_reporter_test.go

x-pack/filebeat/input/awscloudwatch/input.go

x-pack/filebeat/input/awscloudwatch/state_reporter_test.go

gizas · 2025-08-07T11:20:33Z

Overall functionality is there , great one Kavindu
Some minors

Signed-off-by: Kavindu Dodanduwa <kavindu.dodanduwa@elastic.co>

joecompute

LGTM

* feat: add status reporting to CloudWatch Signed-off-by: Kavindu Dodanduwa <kavindu.dodanduwa@elastic.co> * improve status propagation Signed-off-by: Kavindu Dodanduwa <kavindu.dodanduwa@elastic.co> * add changelog entry Signed-off-by: Kavindu Dodanduwa <kavindu.dodanduwa@elastic.co> * review: sync for reporting Signed-off-by: Kavindu Dodanduwa <kavindu.dodanduwa@elastic.co> * review: add error message for degrading statuses Signed-off-by: Kavindu Dodanduwa <kavindu.dodanduwa@elastic.co> * review suggestions Signed-off-by: Kavindu Dodanduwa <kavindu.dodanduwa@elastic.co> * improve nil handling in error handling Signed-off-by: Kavindu Dodanduwa <kavindu.dodanduwa@elastic.co> --------- Signed-off-by: Kavindu Dodanduwa <kavindu.dodanduwa@elastic.co> (cherry picked from commit b17bbad)

* feat: add status reporting to CloudWatch (#45679) * feat: add status reporting to CloudWatch Signed-off-by: Kavindu Dodanduwa <kavindu.dodanduwa@elastic.co> * improve status propagation Signed-off-by: Kavindu Dodanduwa <kavindu.dodanduwa@elastic.co> * add changelog entry Signed-off-by: Kavindu Dodanduwa <kavindu.dodanduwa@elastic.co> * review: sync for reporting Signed-off-by: Kavindu Dodanduwa <kavindu.dodanduwa@elastic.co> * review: add error message for degrading statuses Signed-off-by: Kavindu Dodanduwa <kavindu.dodanduwa@elastic.co> * review suggestions Signed-off-by: Kavindu Dodanduwa <kavindu.dodanduwa@elastic.co> * improve nil handling in error handling Signed-off-by: Kavindu Dodanduwa <kavindu.dodanduwa@elastic.co> --------- Signed-off-by: Kavindu Dodanduwa <kavindu.dodanduwa@elastic.co> (cherry picked from commit b17bbad) * Update CHANGELOG.next.asciidoc --------- Signed-off-by: Kavindu Dodanduwa <kavindu.dodanduwa@elastic.co> Co-authored-by: Kavindu Dodanduwa <Kavindu-Dodan@users.noreply.github.com>

) * feat: add status reporting to CloudWatch (#45679) * feat: add status reporting to CloudWatch Signed-off-by: Kavindu Dodanduwa <kavindu.dodanduwa@elastic.co> * improve status propagation Signed-off-by: Kavindu Dodanduwa <kavindu.dodanduwa@elastic.co> * add changelog entry Signed-off-by: Kavindu Dodanduwa <kavindu.dodanduwa@elastic.co> * review: sync for reporting Signed-off-by: Kavindu Dodanduwa <kavindu.dodanduwa@elastic.co> * review: add error message for degrading statuses Signed-off-by: Kavindu Dodanduwa <kavindu.dodanduwa@elastic.co> * review suggestions Signed-off-by: Kavindu Dodanduwa <kavindu.dodanduwa@elastic.co> * improve nil handling in error handling Signed-off-by: Kavindu Dodanduwa <kavindu.dodanduwa@elastic.co> --------- Signed-off-by: Kavindu Dodanduwa <kavindu.dodanduwa@elastic.co> (cherry picked from commit b17bbad) * Update CHANGELOG.next.asciidoc --------- Signed-off-by: Kavindu Dodanduwa <kavindu.dodanduwa@elastic.co> Co-authored-by: Kavindu Dodanduwa <Kavindu-Dodan@users.noreply.github.com>

botelastic bot added the needs_team Indicates that the issue/PR needs a Team:* label label Jul 31, 2025

mergify bot assigned Kavindu-Dodan Jul 31, 2025

Kavindu-Dodan added the Team:obs-ds-hosted-services Label for the Observability Hosted Services team label Aug 1, 2025

botelastic bot removed the needs_team Indicates that the issue/PR needs a Team:* label label Aug 1, 2025

Kavindu-Dodan force-pushed the feat/cw-status-reporting branch from 8b74b85 to a7bd411 Compare August 1, 2025 18:49

Kavindu-Dodan added backport-8.19 Automated backport to the 8.19 branch backport-9.1 Automated backport to the 9.1 branch labels Aug 1, 2025

elastic deleted a comment from mergify bot Aug 1, 2025

Kavindu-Dodan force-pushed the feat/cw-status-reporting branch 2 times, most recently from 956ecb8 to d4caa4c Compare August 1, 2025 18:57

Kavindu-Dodan requested a review from taylor-swanson August 1, 2025 19:23

Kavindu-Dodan force-pushed the feat/cw-status-reporting branch from d4caa4c to 16e122b Compare August 1, 2025 19:25

Kavindu-Dodan marked this pull request as ready for review August 1, 2025 19:25

Kavindu-Dodan requested a review from a team as a code owner August 1, 2025 19:25

Kavindu-Dodan requested a review from joecompute August 1, 2025 19:27

joecompute reviewed Aug 4, 2025

View reviewed changes

x-pack/filebeat/input/awscloudwatch/state_reporter.go Show resolved Hide resolved

Kavindu-Dodan added 3 commits August 5, 2025 07:31

feat: add status reporting to CloudWatch

fdd20cb

Signed-off-by: Kavindu Dodanduwa <kavindu.dodanduwa@elastic.co>

improve status propagation

a328ede

Signed-off-by: Kavindu Dodanduwa <kavindu.dodanduwa@elastic.co>

add changelog entry

13609d0

Signed-off-by: Kavindu Dodanduwa <kavindu.dodanduwa@elastic.co>

Kavindu-Dodan force-pushed the feat/cw-status-reporting branch from 5b793d6 to e0ebed9 Compare August 5, 2025 14:31

Kavindu-Dodan requested a review from joecompute August 5, 2025 14:32

review: sync for reporting

53215ec

Signed-off-by: Kavindu Dodanduwa <kavindu.dodanduwa@elastic.co>

Kavindu-Dodan force-pushed the feat/cw-status-reporting branch from e0ebed9 to 53215ec Compare August 5, 2025 17:09

taylor-swanson reviewed Aug 5, 2025

View reviewed changes

x-pack/filebeat/input/awscloudwatch/input.go Outdated Show resolved Hide resolved

review: add error message for degrading statuses

eb86641

Signed-off-by: Kavindu Dodanduwa <kavindu.dodanduwa@elastic.co>

Kavindu-Dodan requested a review from taylor-swanson August 5, 2025 21:57

taylor-swanson approved these changes Aug 6, 2025

View reviewed changes

gizas reviewed Aug 7, 2025

View reviewed changes

x-pack/filebeat/input/awscloudwatch/state_reporter_test.go Show resolved Hide resolved

gizas reviewed Aug 7, 2025

View reviewed changes

x-pack/filebeat/input/awscloudwatch/input.go Outdated Show resolved Hide resolved

gizas reviewed Aug 7, 2025

View reviewed changes

x-pack/filebeat/input/awscloudwatch/input.go Show resolved Hide resolved

gizas reviewed Aug 7, 2025

View reviewed changes

x-pack/filebeat/input/awscloudwatch/state_reporter_test.go Show resolved Hide resolved

gizas approved these changes Aug 7, 2025

View reviewed changes

review suggestions

11283d0

Signed-off-by: Kavindu Dodanduwa <kavindu.dodanduwa@elastic.co>

Kavindu-Dodan force-pushed the feat/cw-status-reporting branch from 23f9d97 to 11283d0 Compare August 7, 2025 13:40

improve nil handling in error handling

56de270

Signed-off-by: Kavindu Dodanduwa <kavindu.dodanduwa@elastic.co>

joecompute approved these changes Aug 7, 2025

View reviewed changes

Kavindu-Dodan merged commit b17bbad into elastic:main Aug 7, 2025
38 of 39 checks passed

mergify bot mentioned this pull request Aug 7, 2025

[8.19](backport #45679) feat: add status reporting to CloudWatch #45842

Merged

6 tasks

mergify bot mentioned this pull request Aug 7, 2025

[9.1](backport #45679) feat: add status reporting to CloudWatch #45843

Merged

6 tasks

vishaangelova mentioned this pull request Aug 15, 2025

[9.0](backport #45810) x-pack/filebeat/input/httpjson: allow template termination without logging error #45996

Merged

6 tasks

joecompute mentioned this pull request Aug 25, 2025

[azure-eventhub] Add health status reporting to processor v2 #44846

Merged

6 tasks

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

feat: add status reporting to CloudWatch#45679

feat: add status reporting to CloudWatch#45679
Kavindu-Dodan merged 7 commits intoelastic:mainfrom
Kavindu-Dodan:feat/cw-status-reporting

Kavindu-Dodan commented Jul 31, 2025 •

edited

Loading

github-actions bot commented Jul 31, 2025

elasticmachine commented Aug 1, 2025

Uh oh!

Uh oh!

taylor-swanson left a comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

gizas commented Aug 7, 2025 •

edited

Loading

joecompute left a comment

Uh oh!

Labels

5 participants

Conversation

Kavindu-Dodan commented Jul 31, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Proposed commit message

Checklist

Disruptive User Impact

How to test this PR locally

Startup and configuration

Degraded - network connectivity issue

Back to running status

Related issues

github-actions bot commented Jul 31, 2025

🤖 GitHub comments

elasticmachine commented Aug 1, 2025

Uh oh!

Uh oh!

taylor-swanson left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

gizas commented Aug 7, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

joecompute left a comment

Choose a reason for hiding this comment

Uh oh!

Labels

5 participants

Kavindu-Dodan commented Jul 31, 2025 •

edited

Loading

gizas commented Aug 7, 2025 •

edited

Loading