[Azure Monitor] Add default timegrain to Azure Storage Account metricset

[zmoog]

Proposed commit message

Adds a new default_timegrain configuration option to allow users to customize the timegrain used in the Storage Account metricset. The default value remains PT5M, but users can now choose a different value.

Without this option, users can only collect metrics with a PT5M time grain. It is a sensible default, but some users want to collect metrics with a PT1M time grain.

To learn more, see elastic/integrations#15464.

Checklist

• My code follows the style guidelines of this project
• I have commented my code, particularly in hard-to-understand areas
• I have made corresponding changes to the documentation
• I have made corresponding change to the default configuration files
• I have added tests that prove my fix is effective or that my feature works
• I have added an entry in CHANGELOG.next.asciidoc or CHANGELOG-developer.next.asciidoc.

Disruptive User Impact

Here are a couple of Metricbeat config to run the tests:

# With `period: 300s` and `default_timegrain: "PT1M"`, the metricset
# collects 5 data points every 300s (5 mins) — one for each minute.
- module: azure
  metricsets:
  - storage
  enabled: true
  period: 300s
  client_id: '${AZURE_CLIENT_ID:""}'
  client_secret: '${AZURE_CLIENT_SECRET:""}'
  tenant_id: '${AZURE_TENANT_ID:""}'
  subscription_id: '${AZURE_SUBSCRIPTION_ID:""}'
  refresh_list_interval: 3600s # 1h
  enable_batch_api: true
  default_timegrain: "PT1M"

# With `period: 60s` and `default_timegrain: "PT1M"`, the metricset 
# collects 1 data points every 60s.
- module: azure
  metricsets:
  - storage
  enabled: true
  period: 60s
  client_id: '${AZURE_CLIENT_ID:""}'
  client_secret: '${AZURE_CLIENT_SECRET:""}'
  tenant_id: '${AZURE_TENANT_ID:""}'
  subscription_id: '${AZURE_SUBSCRIPTION_ID:""}'
  refresh_list_interval: 3600s # 1h
  enable_batch_api: true
  default_timegrain: "PT1M"

If you have tens of storage accounts (or more), we recommend setting enable_batch_api: true.

Related issues

• Relates [Azure] Support timegrains other that PT5M in the Storage Account integration integrations#15464

[github-actions]

🤖 GitHub comments

Expand to view the GitHub comments

Just comment with:

• run docs-build : Re-trigger the docs validation. (use unformatted text in the comment!)

[mergify]

This pull request does not have a backport label.
If this is a bug or security fix, could you label this PR @zmoog? 🙏.
For such, you'll need to label your PR with:

• The upcoming major version of the Elastic Stack
• The upcoming minor version of the Elastic Stack (if you're not pushing a breaking change)

To fixup this pull request, you need to add the backport labels for the needed
branches, such as:

• backport-8./d is the label to automatically backport to the 8./d branch. /d is the digit
• backport-active-all is the label that automatically backports to all active branches.
• backport-active-8 is the label that automatically backports to all active minor branches for the 8 major.
• backport-active-9 is the label that automatically backports to all active minor branches for the 9 major.

[elasticmachine]

Pinging @elastic/obs-ds-hosted-services (Team:obs-ds-hosted-services)

[constanca-m]

Awesome!

[github-actions]

🔍 Preview links for changed docs

• docs/reference/metricbeat/metricbeat-metricset-azure-storage.md

[zmoog]

@elastic/ingest-docs, could you review this PR when you get a chance? I'm hoping to include this change in today's FF 🙇

[github-actions]

@Mergifyio backport 8.18 8.19 9.0 9.1

[mergify]

backport 8.18 8.19 9.0 9.1

✅ Backports have been created

Details

• #46853 [8.18](backport #46786) [Azure Monitor] Add default timegrain to Azure Storage Account metricset has been created for branch 8.18 but encountered conflicts
• #46851 [8.19](backport #46786) [Azure Monitor] Add default timegrain to Azure Storage Account metricset has been created for branch 8.19 but encountered conflicts
• #46852 [9.0](backport #46786) [Azure Monitor] Add default timegrain to Azure Storage Account metricset has been created for branch 9.0
• #46854 [9.1](backport #46786) [Azure Monitor] Add default timegrain to Azure Storage Account metricset has been created for branch 9.1