The purpose of this issue is to update this PR to allow chunked rerank to be done for third-party integrations. The main list to target is: