You are viewing a plain text version of this content. The canonical link for it is here.

Posted to github@beam.apache.org by GitBox <gi...@apache.org> on 2022/08/12 05:20:34 UTC

[GitHub] [beam] nickcaballero opened a new issue, #22707: [Bug]: KinesisIO.Read can't be reconfigured using PipelineOptions when loading from Flink savepoint

nickcaballero opened a new issue, #22707:
URL: https://github.com/apache/beam/issues/22707

   ### What happened?
   
   The underlying UnboundedSource of KinesisIO.Read, KinesisSource, can't be re-configured via PipelineOptions once it's serialized in a Flink checkpoint. Specifically the retry and watermark behaviors, which may need to be adjusted in the lifetime of the application, cannot be modified if loading from a savepoint.
   
   Ideally, the `WatermarkPolicyFactory` and `RateLimitPolicyFactory` would accept the PipelineOptions. The PipelineOptions are already provided to `org.apache.beam.sdk.io.kinesis.KinesisSource#createReader` and should be propagated.
   
   ### Issue Priority
   
   Priority: 2
   
   ### Issue Component
   
   Component: io-java-kinesis


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org