You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2022/09/19 00:47:10 UTC

[GitHub] [hudi] asankadarshana007 commented on issue #6686: Apache Hudi Consistency issues with glue and marketplace connector

asankadarshana007 commented on issue #6686:
URL: https://github.com/apache/hudi/issues/6686#issuecomment-1250429188

   Hey @xushiyan - thank you for your reply. At the time when I initially started developing these jobs (a long time back with the previous version of hudi connector - 0.5.x), I wasn't aware of the fact that s3 has strong consistency. I assumed it was eventual consistency. I can change the hudi config value to `'hoodie.consistency.check.enabled': 'false'` and test. But do you assume it might have a connection to this error ? I assume with `'hoodie.consistency.check.enabled': 'true'`, hudi would try to make sure that all files are available - as an extra check ? 
   I have raised a support ticket with AWS. But it could take sometime to get some resolution out of them 😓 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org