Skip to content

feat(compactor HS): add support for applying storage updates after finishing processing of deletion manifest #18294

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 4 commits into
base: main
Choose a base branch
from
Open

feat(compactor HS): add support for applying storage updates after finishing processing of deletion manifest #18294

wants to merge 4 commits into from
+975 −304

Conversation

sandeepsukhani
Copy link
Contributor

What this PR does / why we need it:

  1. Renames indexUpdates to storageUpdates since it also includes a list of chunks to delete from storage.
  2. Adds provision for applying storage updates after finishing processing of a deletion manifest.
  3. Adds manifest post-processing operation, which includes marking delete requests as processed and removing all the files related to the manifest from object storage.

Checklist

  • Tests updated
@sandeepsukhani
rename index updates to storage updates because it not only updates t…
53527f7 
…he index but also deletes the chunks from the storage
@sandeepsukhani sandeepsukhani requested a review from a team as a code owner July 1, 2025 11:24
@sandeepsukhani sandeepsukhani force-pushed the compactor-hs-apply-deletion-storage-updates branch from 13071e3 to 1f5971d Compare July 1, 2025 12:22
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
size/XXL
1 participant
@sandeepsukhani