You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@iggy.apache.org by "diegomrsantos (via GitHub)" <gi...@apache.org> on 2026/09/20 15:24:38 UTC

[I] connectors: preserve failed records throughout the sink pipeline [iggy]

diegomrsantos opened a new issue, #4235:
URL: https://github.com/apache/iggy/issues/4235

   Parent tracker: #4232.
   
   Carry record outcomes through decoding, transformation, serialization, and sink delivery so that a successful call for the remaining records cannot silently acknowledge records dropped earlier in the pipeline.
   
   Acceptance criteria:
   
   - Unexpected failures leave the affected source records unresolved and block checkpoints from passing them.
   - Configured filtering is represented and counted separately from errors.
   - Error information crosses the plugin boundary without collapsing every failure into an indistinguishable status.
   - Retry ownership and limits are explicit, including retries already performed by plugins. Exhaustion pauses or stops affected work with an actionable error and preserves replay.
   - Failure handling bounds pending work and does not abandon records already covered by a checkpoint.
   - Any supported dead-letter policy confirms delivery to that destination before resolving the source record. Without such a policy, permanent record failures remain visible and unresolved.
   - Tests exercise failures at each stage and verify the saved checkpoint and destination results.
   
   Depends on A and uses B. Extend the accounting introduced by #4152 while preserving the original input record's outcome.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@iggy.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] connectors: preserve failed records throughout the sink pipeline [iggy]

Posted by "numinnex (via GitHub) via commits" <co...@iggy.apache.org>.
numinnex closed issue #4235: connectors: preserve failed records throughout the sink pipeline
URL: https://github.com/apache/iggy/issues/4235


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@iggy.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org