You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by GitBox <gi...@apache.org> on 2019/01/17 12:28:56 UTC

[GitHub] aljoscha commented on issue #7519: FLINK-11378 - Allow writing to Hadoop compatible Filesystems via Hado…

aljoscha commented on issue #7519: FLINK-11378 - Allow writing to Hadoop compatible Filesystems via Hado…
URL: https://github.com/apache/flink/pull/7519#issuecomment-455155075
 
 
   @martijnvdgrift Can you confirm that GCS is not eventually consistent? This check was introduced because some file systems that are implemented as a HCFS are eventually consistent (such as S3). This will lead to problems because the `HadoopRecoverableWriter` assumes non-eventual consistency.
   
   I would like to not remove this check completely but instead introduce a whitelist of filesystems that we know work correctly with this writer. What do you think?

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services