You are viewing a plain text version of this content. The canonical link for it is here.

Posted to github@beam.apache.org by GitBox <gi...@apache.org> on 2022/06/03 16:22:28 UTC

[GitHub] [beam] kennknowles opened a new issue, #18122: Improve UnboundedSourceShard structure

kennknowles opened a new issue, #18122:
URL: https://github.com/apache/beam/issues/18122

   Use the 'OneOf' of "Active Reader" and "Optional<Checkpoint\>", to make it obvious how to obtain and use a reader.
   
   Maintain an ordered list of checkpoints that have not been finalized for a shard. Checkpoints that can be resumed from can also be finalized, but otherwise the two are unrelated. This also improves ease of never multi-finalizing a checkpoint. This gets more complicated with retries, but must be considered with the associated work required to make UnboundedReadEvaluatorFactory handle retries properly.
   
   Imported from Jira [BEAM-1659](https://issues.apache.org/jira/browse/BEAM-1659). Original Jira may contain additional context.
   Reported by: tgroh.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org