You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2022/04/28 16:46:21 UTC

[GitHub] [hudi] Neuw84 commented on issue #5456: [SUPPORT] HoodieDeltaStreamer - Spark master shouldn't have a default option (AWS Glue)

Neuw84 commented on issue #5456:
URL: https://github.com/apache/hudi/issues/5456#issuecomment-1112433258

   Hi @yihua, 
   
   The thing is that no default value should be in that class in order to be able to inherit to whatever the master is in serverless Spark engines such as AWS Glue where the master is not known. The idea is to remove that default value (```local[2] ```), add an option to build a Java Spark Context without the default value and change the documentation in the ´´´cli´´´ options. 
   
   Is a small change, but that will enable to use the DeltaStreamer in managed environments such as AWS Glue. Will open the Jira ticket and work on it, it is a small change that will enable me on further contributions if possible :) 
   
   Thanks 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org