You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2022/10/30 10:42:54 UTC

[GitHub] [hudi] xushiyan commented on issue #5054: [SUPPORT] Hudi Failing with out of memory issue on Glue with >300 Mio. Records

xushiyan commented on issue #5054:
URL: https://github.com/apache/hudi/issues/5054#issuecomment-1296209424

   This is a memory tuning issue with Glue ETL spark job, which is a managed service from AWS. The spark job configs are internally managed by the service, which is opaque to users. The best approach is to open AWS support case. [The connector](https://aws.amazon.com/marketplace/pp/prodview-6rofemcq6erku) is recently upgraded to 0.10.1; may also worth a try. 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org