Skip to content

Commit 0d67831

Browse files
authored
feat: update blockbuilder to use scheduler for fetching jobs (#15224)
1 parent 0981273 commit 0d67831

File tree

11 files changed

+1150
-1262
lines changed

11 files changed

+1150
-1262
lines changed

‎docs/sources/shared/configuration.md‎

Lines changed: 20 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -171,10 +171,6 @@ block_builder:
171171
# CLI flag: -blockbuilder.max-chunk-age
172172
[max_chunk_age: <duration> | default = 2h]
173173

174-
# The interval at which to run.
175-
# CLI flag: -blockbuilder.interval
176-
[interval: <duration> | default = 10m]
177-
178174
backoff_config:
179175
# Minimum delay when backing off.
180176
# CLI flag: -blockbuilder.backoff..backoff-min-period
@@ -188,6 +184,25 @@ block_builder:
188184
# CLI flag: -blockbuilder.backoff..backoff-retries
189185
[max_retries: <int> | default = 10]
190186

187+
# The number of workers to run in parallel to process jobs.
188+
# CLI flag: -blockbuilder.worker-parallelism
189+
[worker_parallelism: <int> | default = 1]
190+
191+
# The interval at which to sync job status with the scheduler.
192+
# CLI flag: -blockbuilder.sync-interval
193+
[sync_interval: <duration> | default = 30s]
194+
195+
# Address of the scheduler in the format described here:
196+
# https://github.com/grpc/grpc/blob/master/doc/naming.md
197+
# CLI flag: -blockbuilder.scheduler-address
198+
[scheduler_address: <string> | default = ""]
199+
200+
# The grpc_client block configures the gRPC client used to communicate between
201+
# a client and server component in Loki.
202+
# The CLI flags prefix for this block configuration is:
203+
# blockbuilder.scheduler-grpc-client.
204+
[scheduler_grpc_client_config: <grpc_client>]
205+
191206
block_scheduler:
192207
# Consumer group used by block scheduler to track the last consumed offset.
193208
# CLI flag: -block-scheduler.consumer-group
@@ -2632,6 +2647,7 @@ The `gcs_storage_config` block configures the connection to Google Cloud Storage
26322647
The `grpc_client` block configures the gRPC client used to communicate between a client and server component in Loki. The supported CLI flags `<prefix>` used to reference this configuration block are:
26332648

26342649
- `bigtable`
2650+
- `blockbuilder.scheduler-grpc-client.`
26352651
- `bloom-build.builder.grpc`
26362652
- `bloom-gateway-client.grpc`
26372653
- `boltdb.shipper.index-gateway-client.grpc`

0 commit comments

Comments
 (0)