You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2020/07/17 13:14:48 UTC

[GitHub] [hudi] rajgowtham24 commented on issue #1835: [SUPPORT] HoodieDeltaStreamer with Json as Source

rajgowtham24 commented on issue #1835:
URL: https://github.com/apache/hudi/issues/1835#issuecomment-660100564


   Thanks Balaji for the reply, actually i have spinned up aws emr v5.30.1 along with Hudi and using the same for code execution. I'm loading only one version of hudi into spark. Verified the same in application log file as well. 
   
   
   20/07/17 13:06:04 INFO SparkUI: Bound SparkUI to 0.0.0.0, and started at http://ip-10-80-69-179.eu-west-1.compute.internal:4041
   20/07/17 13:06:04 INFO SparkContext: Added JAR file:/usr/lib/hudi/hudi-utilities-bundle.jar at spark://ip-10-80-69-179.eu-west-1.compute.internal:37251/jars/hudi-utilities-bundle.jar with timestamp 1594991164091
   20/07/17 13:06:04 INFO Utils: Using initial executors = 100, max of spark.dynamicAllocation.initialExecutors, spark.dynamicAllocation.minExecutors and spark.executor.instances
   
   Let me know if i need to take a look into anything apart from the above for the setup issue.
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org