You are viewing a plain text version of this content. The canonical link for it is here.

Posted to github@beam.apache.org by GitBox <gi...@apache.org> on 2020/05/29 18:12:05 UTC

[GitHub] [beam] lukecwik commented on pull request #11864: [BEAM-10051] Scope instruction data.

lukecwik commented on pull request #11864:
URL: https://github.com/apache/beam/pull/11864#issuecomment-636112344


   `Initial data arrives and instruction never creates a reader` and `Initial data arrives after instruction ends` should eventually allow progress via a timeout on how long we expect this data to sit there without an active bundle. Anything on the order of 10s of seconds seems like plenty of time since we expect the ProcessBundle instruction to be in the control stream already (albeit possibly stuck in a network buffer or so). The SDK just needs to record the id in memory and if it ever sees a bundle for such an id, it would fail it immediately since it had dropped the data already.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org