You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2021/06/20 12:10:57 UTC

[GitHub] [hudi] garyli1019 commented on pull request #3093: [HUDI-2031] JVM occasionally crashes during compaction when spark speculative execution is enabled

garyli1019 commented on pull request #3093:
URL: https://github.com/apache/hudi/pull/3093#issuecomment-864544552


   > Change looks reasonable. let me think bit more around the scenarios before merging this.
   > 
   > Anyway we can write a unit test around this scenario?
   
   We found compaction and COW table might produce dirty parquet files when speculation was on.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org