You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2020/05/04 10:40:03 UTC

[GitHub] [incubator-hudi] harshi2506 commented on issue #1552: Time taken for upserting hudi table is increasing with increase in number of partitions

harshi2506 commented on issue #1552:
URL: https://github.com/apache/incubator-hudi/issues/1552#issuecomment-623389443


   > fighting
   
   
   
   > #### BUG status
   > bug	status	way
   > upsert long time first time	fixed	upgrate version (0.5.0 to master)
   > FileStatusExt: Metadata Entry doesn't exist	fixed	using a whole new base path
   > java.io.FileNotFoundException: No such file or directory	fiexed	but don't know the root cause
   > 17 minutes lag between HoodieActiveTimeline and CleanActionExecutor	fighting	xxx
   
   Hi @lamber-ken , few changes to the bug status report
   
   bug | status | way
   -- | -- | --
   upsert long time first time | fixed | upgrate version (0.5.0 to master)
   FileStatusExt: Metadata Entry doesn't exist | fixed | By enabling EMRFS on EMR cluster or by using hoodie file   consistency config
   java.io.FileNotFoundException: No such file   or directory | fixed | By enabling EMRFS on EMR cluster or by using hoodie file   consistency config("hoodie.consistency.check.enabled"   -> "true")
   17 minutes lag between HoodieActiveTimeline   and CleanActionExecutor | fighting | xxx
   
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org