You are viewing a plain text version of this content. The canonical link for it is here.

Posted to github@beam.apache.org by "mosche (via GitHub)" <gi...@apache.org> on 2023/04/17 08:25:11 UTC

[GitHub] [beam] mosche commented on issue #26041: [Bug]: Unable to create exactly-once Flink pipeline with stream source and file sink

mosche commented on issue #26041:
URL: https://github.com/apache/beam/issues/26041#issuecomment-1510917426

   > When using standard file-naming policy, I get files like out-2023-03-29T22-45-00.000Z-2023-03-29T22-46-00.000Z-00000-of-00004.parquet. I've noticed that, after a restart, some of the window files are replaced, which causes records to be lost.
   
   Just confirming, without taking any additional actions there's a risk of data loss here?
   If so, this should be P1.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org