You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "BALAJI VARADARAJAN (Jira)" <ji...@apache.org> on 2019/09/17 21:06:00 UTC
[jira] [Resolved] (HUDI-254) Provide mechanism for installing
hudi-spark-bundle onto an existing spark installation
[ https://issues.apache.org/jira/browse/HUDI-254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
BALAJI VARADARAJAN resolved HUDI-254.
-------------------------------------
Resolution: Fixed
> Provide mechanism for installing hudi-spark-bundle onto an existing spark installation
> --------------------------------------------------------------------------------------
>
> Key: HUDI-254
> URL: https://issues.apache.org/jira/browse/HUDI-254
> Project: Apache Hudi (incubating)
> Issue Type: Improvement
> Components: Spark datasource, SparkSQL Support
> Reporter: Vinoth Chandar
> Assignee: Vinoth Chandar
> Priority: Major
> Fix For: 0.5.0
>
> Time Spent: 20m
> Remaining Estimate: 0h
>
> A lot of discussions around this kicked off from [https://github.com/apache/incubator-hudi/issues/869]
> Breaking down into phases, when we drop the hudi-spark-bundle*.jar onto the `jars` folder
>
> a) Writing data via Hudi datasource should work
> b) Spark datasource reads should work
>
> c) a + Hive Sync should work
> d) SparkSQL on Hive synced table works
>
> Start with Spark 2.3 (current demo setup) and then proceed to 2.4 and iron out issues.
>
--
This message was sent by Atlassian Jira
(v8.3.2#803003)