-
Notifications
You must be signed in to change notification settings - Fork 25.8k
Closed
Labels
:StorageEngine/Data streamsData streams and their lifecyclesData streams and their lifecycles>featureTeam:Data Management (obsolete)DO NOT USE. This team no longer exists.DO NOT USE. This team no longer exists.
Description
Instead of dropping documents that have failed ingestion due to an exception during pipeline execution or indexing, it should be possible to store the failed document.
High-level options where to store the failed documents:
- In a dedicated data stream
- Within the same data stream, in dedicated failure backing indices
- Within the same index, only storing the _source and with an indicator that these reflect failed documents
Reactions are currently unavailable
Metadata
Metadata
Labels
:StorageEngine/Data streamsData streams and their lifecyclesData streams and their lifecycles>featureTeam:Data Management (obsolete)DO NOT USE. This team no longer exists.DO NOT USE. This team no longer exists.