You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Nishith Agarwal (Jira)" <ji...@apache.org> on 2020/04/21 20:00:13 UTC
[jira] [Assigned] (HUDI-824) Register hudi-spark package with spark
packages repo for easier usage of Hudi
[ https://issues.apache.org/jira/browse/HUDI-824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Nishith Agarwal reassigned HUDI-824:
------------------------------------
Assignee: Vinoth Govindarajan
> Register hudi-spark package with spark packages repo for easier usage of Hudi
> -----------------------------------------------------------------------------
>
> Key: HUDI-824
> URL: https://issues.apache.org/jira/browse/HUDI-824
> Project: Apache Hudi (incubating)
> Issue Type: Bug
> Components: Spark Integration
> Reporter: Nishith Agarwal
> Assignee: Vinoth Govindarajan
> Priority: Minor
>
> At the moment, to be able to use Hudi with spark, users have to do the following :
>
> {{spark-2.4.4-bin-hadoop2.7/bin/spark-shell \
> --jars `ls packaging/hudi-spark-bundle/target/hudi-spark-bundle_2.11-*.*.*-SNAPSHOT.jar` \
> --conf 'spark.serializer=org.apache.spark.serializer.KryoSerializer'}}
> {{}}
> {{Ideally, we want to be able to use Hudi as follows :}}
>
> {{spark-2.4.4-bin-hadoop2.7/bin/spark-shell \ --packages org.apache.hudi:hudi-spark-bundle:<version> \
> --conf 'spark.serializer=org.apache.spark.serializer.KryoSerializer'}}{{}}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)