Skip to content

feat(blockbuilder): priority queue for job dispatching #15245

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 7 commits into from
Dec 4, 2024
Merged

feat(blockbuilder): priority queue for job dispatching #15245

Changes from 1 commit
Commits
Show all changes
7 commits
Select commit Hold shift + click to select a range
fd79b56
priority queue & circular buffer impl
owen-d Dec 3, 2024
f7c10b4
deterministic job ordering in time range planner
owen-d Dec 3, 2024
2d4ab8b
[wip] priority for planning jobs
owen-d Dec 3, 2024
b7150cc
[wip] priority for planning jobs
owen-d Dec 3, 2024
2ecc114
lint
owen-d Dec 4, 2024
4218c7c
Merge remote-tracking branch 'upstream/main' into block-scheduler-que…
owen-d Dec 4, 2024
c4e764d
pr feedback
owen-d Dec 4, 2024
File filter

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
deterministic job ordering in time range planner
  • Loading branch information
@owen-d
owen-d committed Dec 3, 2024
commit f7c10b43ddaac8f2cdba8499e73c56464e816b35
6 changes: 6 additions & 0 deletions pkg/blockbuilder/scheduler/strategy.go
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2,6 +2,7 @@ package scheduler

import (
"context"
"sort"
"time"

"github.com/go-kit/log"
Expand Down Expand Up @@ -138,5 +139,10 @@ func (p *TimeRangePlanner) Plan(ctx context.Context) ([]types.Job, error) {
})
}

// Sort jobs by partition number to ensure consistent ordering
sort.Slice(jobs, func(i, j int) bool {
return jobs[i].Partition < jobs[j].Partition
})

return jobs, nil
}