You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2021/05/26 12:45:09 UTC

[GitHub] [hudi] PavelPetukhov commented on issue #2888: [SUPPORT] Hudi spark submit job crashes at some point after eating all memory available

PavelPetukhov commented on issue #2888:
URL: https://github.com/apache/hudi/issues/2888#issuecomment-848738615


   Hi, 
   
   We changed to
   --hoodie-conf hoodie.upsert.shuffle.parallelism=50
   --hoodie-conf hoodie.insert.shuffle.parallelism=50
   --hoodie-conf hoodie.delete.shuffle.parallelism=50
   --hoodie-conf hoodie.bulkinsert.shuffle.parallelism=50
   
   and moved to UPSERT instead
   
   But still facing the same issue


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org