Skip to content

feat(wal): Benchmark and improve WAL writes using Reset. #13272

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 34 commits into from
Jun 24, 2024
Merged

feat(wal): Benchmark and improve WAL writes using Reset. #13272

Changes from 1 commit
Commits
Show all changes
34 commits
Select commit Hold shift + click to select a range
0e5aa15
wip
cyriltovena May 16, 2024
2ef5c3c
wip
cyriltovena May 16, 2024
d68a08d
wip
cyriltovena May 28, 2024
144bb9c
add some doc and vision
cyriltovena May 30, 2024
5f8cf08
move compressed len to chunk
cyriltovena May 30, 2024
f32c755
work on the chunk encoding
cyriltovena May 31, 2024
19bbd76
missing changes
cyriltovena May 31, 2024
9e1d5b1
working on fixes and tests
cyriltovena May 31, 2024
c8b792f
add more tests and found a bug with dod
cyriltovena Jun 2, 2024
749acf7
fix(wal): Use varint encoding for ts_2_dod in WAL format
cyriltovena Jun 3, 2024
7590f55
refactor(wal): Remove unnecessary code in writeChunk function
cyriltovena Jun 3, 2024
7991408
chore: Refactor ChunkReader to improve performance and memory usage
cyriltovena Jun 3, 2024
38fcad4
chore: Add more realistic tests and benchmarks
cyriltovena Jun 3, 2024
bdf389f
refactor: Update index writer to support in memory buffer.
cyriltovena Jun 5, 2024
296daee
pausing work I need a new index different than the current work
cyriltovena Jun 7, 2024
d1cfcae
Add a special in memory index for the wal package
cyriltovena Jun 10, 2024
37ea6d6
Finalize writing and start reading index
cyriltovena Jun 10, 2024
d649646
Add offset/start to chunk ref
cyriltovena Jun 10, 2024
fd1dbd8
wip
cyriltovena Jun 13, 2024
b49d2ba
refactor(wal): Implement SeriesIter.
cyriltovena Jun 16, 2024
f575efb
fix(wal): Fixes snappy block offsets counting.
cyriltovena Jun 17, 2024
071ee04
chore: update format doc to reflect latest changes
cyriltovena Jun 18, 2024
6227361
chore: lint
cyriltovena Jun 18, 2024
f625252
refactor: Removes changes not required.
cyriltovena Jun 18, 2024
32b1d2c
chore: format
cyriltovena Jun 18, 2024
d3f179e
feat(wal): Add sizing information to writer and reader.
cyriltovena Jun 19, 2024
57ad53b
Merge remote-tracking branch 'upstream/main' into wal-sizing
cyriltovena Jun 19, 2024
d7dc2b1
Merge remote-tracking branch 'upstream/main' into wal-sizing
cyriltovena Jun 19, 2024
95c1015
lint
cyriltovena Jun 20, 2024
b6ba673
ensure stable test
cyriltovena Jun 20, 2024
3700f3e
feat(wal): Benchmark and improve WAL writes using Reset.
cyriltovena Jun 20, 2024
ad52803
lint
cyriltovena Jun 20, 2024
6f9489c
Review feedback
cyriltovena Jun 20, 2024
b6263ef
Merge remote-tracking branch 'origin/main' into wal-write-benchmark
benclive Jun 24, 2024
File filter

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Merge remote-tracking branch 'upstream/main' into wal-sizing
  • Loading branch information
@cyriltovena
cyriltovena committed Jun 19, 2024
commit 57ad53b994809d4e2735d48b2b9711168724bdba

This merge commit was added into this branch cleanly.

There are no new changes to show, but you can still view the diff.