You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Nishith Agarwal (Jira)" <ji...@apache.org> on 2020/04/21 20:01:00 UTC
[jira] [Commented] (HUDI-824) Register hudi-spark package with
spark packages repo for easier usage of Hudi
[ https://issues.apache.org/jira/browse/HUDI-824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17089020#comment-17089020 ]
Nishith Agarwal commented on HUDI-824:
--------------------------------------
[~vino] Assigning this to you like we discussed
> Register hudi-spark package with spark packages repo for easier usage of Hudi
> -----------------------------------------------------------------------------
>
> Key: HUDI-824
> URL: https://issues.apache.org/jira/browse/HUDI-824
> Project: Apache Hudi (incubating)
> Issue Type: Bug
> Components: Spark Integration
> Reporter: Nishith Agarwal
> Assignee: Vinoth Govindarajan
> Priority: Minor
>
> At the moment, to be able to use Hudi with spark, users have to do the following :
>
> {{spark-2.4.4-bin-hadoop2.7/bin/spark-shell \
> --jars `ls packaging/hudi-spark-bundle/target/hudi-spark-bundle_2.11-*.*.*-SNAPSHOT.jar` \
> --conf 'spark.serializer=org.apache.spark.serializer.KryoSerializer'}}
> {{}}
> {{Ideally, we want to be able to use Hudi as follows :}}
>
> {{spark-2.4.4-bin-hadoop2.7/bin/spark-shell \ --packages org.apache.hudi:hudi-spark-bundle:<version> \
> --conf 'spark.serializer=org.apache.spark.serializer.KryoSerializer'}}{{}}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)