feat: mixin, allow overriding of some labels by parameterizing mixin recording/alert rules

[alex5517]

What this PR does / why we need it:
Allows for more dynamic generation of recording/alert rules.

Which issue(s) this PR fixes:
Fixes N/A

Special notes for your reviewer:

Checklist

• Reviewed the CONTRIBUTING.md guide (required)
• Documentation added
• Tests updated
• CHANGELOG.md updated
  • If the change is worth mentioning in the release notes, add add-to-release-notes label
• Changes that require user attention or interaction to upgrade are documented in docs/sources/setup/upgrade/_index.md
• For Helm chart changes bump the Helm chart version in production/helm/loki/Chart.yaml and update production/helm/loki/CHANGELOG.md and production/helm/loki/README.md. Example PR
• If the change is deprecating or removing a configuration option, update the deprecated-config.yaml and deleted-config.yaml files respectively in the tools/deprecated-config-checker directory. Example PR

[github-actions]

Trivy scan found the following vulnerabilities:

• HIGH, Target: docker.io/grafana/loki:main-e93243f (alpine 3.18.4), Type: alpine openssl: Incorrect cipher key and IV length processing in libcrypto3 v3.1.3-r0. Fixed in v3.1.4-r0
• HIGH, Target: docker.io/grafana/loki:main-e93243f (alpine 3.18.4), Type: alpine openssl: Incorrect cipher key and IV length processing in libssl3 v3.1.3-r0. Fixed in v3.1.4-r0
  \nTo see more details on these vulnerabilities, and how/where to fix them, please run docker build -t grafana/loki:main-e93243f -f cmd/loki/Dockerfile .
  trivy i grafana/loki:main-e93243f on your branch. If these were not introduced by your PR, please considering fixing them in via a subsequent PR. Thanks!

[cstyan]

I think making the label selectors more modular is a good idea

[cstyan]

@alex5517 looking good! I think we're more or less good to go. Unfortunately we need to merge/rebase on master to pull in changes for CI.

[cstyan]

@alex5517 sorry, one last change. Looks like the linter doesn't like the newline after the imports, or maybe there's a whitespace tab on that line?

[alex5517]

@cstyan

Found the culprit :)

[cstyan]

We also need to update the compiled mixins that are used for the helm chart Please build mixin by running 'make loki-mixin'

[alex5517]

@cstyan,

Done :)

[cstyan]

Sorry @alex5517 because I missed your earlier updates it looks like we need to pull in main and update the compiled dashboards again. I can get this merged this week assuming we can get all the CI checks green 👍

[alex5517]

@cstyan, i have merged changes from main, and re-run make loki-mixin

[cstyan]

@alex5517 sorry, the mixin check is still failing because it thinks there should be additional changes to the compiled mixin. It might be due to jsonnet versions? The check uses jsonnet v0.20 and doesn't use our build image (Run make BUILD_IN_CONTAINER=false loki-mixin-check). I still need to update our build image to use that version of jsonnet.

[alex5517]

@cstyan,

Sorry for the delay, i synced the branch and ran the commands you asked.

[cstyan]

can we make these names more explicit? even if it's long, I'd prefer to know all labels that are present from the name OR have to use each per_x_label for readability sake

[alex5517]

@cstyan,

I can change it, but would it not be better if it matches what mimir-mixin does, så that it easier for one who has used mimir-mixin to also use loki-mixin?

[cstyan]

thanks for your patience @alex5517 , just one last comment I think

[cstyan]

cool, thanks @alex5517