[jira] [Created] (HUDI-824) Register hudi-spark package with spark packages repo for easier usage of Hudi

["Nishith Agarwal (Jira)" <ji...@apache.org>]

Nishith Agarwal created HUDI-824:
------------------------------------

             Summary: Register hudi-spark package with spark packages repo for easier usage of Hudi
                 Key: HUDI-824
                 URL: https://issues.apache.org/jira/browse/HUDI-824
             Project: Apache Hudi (incubating)
          Issue Type: Bug
          Components: Spark Integration
            Reporter: Nishith Agarwal


At the moment, to be able to use Hudi with spark, users have to do the following : 

 

{{spark-2.4.4-bin-hadoop2.7/bin/spark-shell \
  --jars `ls packaging/hudi-spark-bundle/target/hudi-spark-bundle_2.11-*.*.*-SNAPSHOT.jar` \
  --conf 'spark.serializer=org.apache.spark.serializer.KryoSerializer'}}

{{}}

{{Ideally, we want to be able to use Hudi as follows :}}

 

{{spark-2.4.4-bin-hadoop2.7/bin/spark-shell \ --packages org.apache.hudi:hudi-spark-bundle:<version> \
  --conf 'spark.serializer=org.apache.spark.serializer.KryoSerializer'}}{{}}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)