Skip to content

Define store-gateway protobuf and client #2433

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 2 commits into from
Apr 10, 2020

Conversation

pracucci
Copy link
Contributor

@pracucci pracucci commented Apr 9, 2020

What this PR does:
In this PR I'm doing a step forward towards integrating the first version of the blocks storage store-gateway service (proposal). In particular:

  1. Defined the protobuf for the store-gateway service, keeping it 100% compatible with the Thanos store (at the current stage won't be possible to build the consistency check because we lack the list of queried blocks in the response, but the consistency check will be added in a second phase and I would like to propose to expose blocks info in Thanos too)
  2. Implemented a store-gateway client (that will be used by the querier) following the same approach we took for the ingester client (since the store-gateway client will use the gRPC clients pool too)

Notes to the reviewer:

  • The store-gateway protobuf definition is in a separate package to avoid circular dependencies between querier and store-gateway (the querier needs the store-gateway protobuf and, for a while, the store-gateway needs the querier's BucketStores)

Which issue(s) this PR fixes:
N/A

Checklist

  • Tests updated
  • Documentation added
  • CHANGELOG.md updated - the order of entries should be [CHANGE], [FEATURE], [ENHANCEMENT], [BUGFIX]
Signed-off-by: Marco Pracucci <marco@pracucci.com>
@pracucci pracucci requested a review from pstibrany April 9, 2020 08:07
@pracucci pracucci force-pushed the define-store-gateway-protobuf branch from 26ccf9a to 953fdb2 Compare April 9, 2020 08:18
Signed-off-by: Marco Pracucci <marco@pracucci.com>
@pracucci pracucci force-pushed the define-store-gateway-protobuf branch from 953fdb2 to 7e9cda1 Compare April 9, 2020 08:28
Copy link
Contributor

@jtlisi jtlisi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

"github.com/cortexproject/cortex/pkg/util/grpcclient"
)

func NewStoreGatewayClientFactory(cfg grpcclient.Config, reg prometheus.Registerer) client.PoolFactory {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This doesn't look to be called anywhere? I assume it will be added in a consecutive PR.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Exactly. I'm still in the process of submitting partial PRs in preparation of the final PR where I will submit the store-gateway and blocks sharding logic, otherwise the final one will be too huge to review.

@pracucci pracucci merged commit 4410bed into cortexproject:master Apr 10, 2020
@pracucci pracucci deleted the define-store-gateway-protobuf branch April 10, 2020 07:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
2 participants