You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2019/09/02 23:26:58 UTC

[GitHub] [incubator-hudi] vinothchandar commented on issue #869: Hudi Spark error when spark bundle jar is added to spark's classpath

vinothchandar commented on issue #869: Hudi Spark error when spark bundle jar is added to spark's classpath
URL: https://github.com/apache/incubator-hudi/issues/869#issuecomment-527257031
 
 
   @umehrot2 a much much thinned versions of the bundles are now in #873 . Could you give that a quick shot? 
   
   > Configure spark.jars property in to the jars /../hudi-spark-bundle-0.5.0-SNAPSHOT.jar,/../spark-avro_2.11-4.0.0.jar
   
   Is dropping jars into spark's own jars folder the recommended way of installing datasources? On the flip side, what are the downsides to configuring `spark.jars` for the EMR spark installation? That seems like a cleaner approach. Is the problem that when user jobs do `--jars` this setting gets overridden? 
   
   
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services