You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Vinoth Chandar (Jira)" <ji...@apache.org> on 2019/09/17 00:21:00 UTC
[jira] [Updated] (HUDI-254) Provide mechanism for installing
hudi-spark-bundle onto an existing spark installation
[ https://issues.apache.org/jira/browse/HUDI-254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vinoth Chandar updated HUDI-254:
--------------------------------
Description:
A lot of discussions around this kicked off from [https://github.com/apache/incubator-hudi/issues/869]
Breaking down into phases, when we drop the hudi-spark-bundle*.jar onto the `jars` folder
a) Writing data via Hudi datasource should work
b) a + Hive Sync should work
c) Spark datasource reads should work
d) SparkSQL on Hive synced table works
Start with Spark 2.4 and then proceed to 2.3 and iron out issues.
was:
A lot of discussions around this kicked off from [https://github.com/apache/incubator-hudi/issues/869]
<WIP> problem statement .
> Provide mechanism for installing hudi-spark-bundle onto an existing spark installation
> --------------------------------------------------------------------------------------
>
> Key: HUDI-254
> URL: https://issues.apache.org/jira/browse/HUDI-254
> Project: Apache Hudi (incubating)
> Issue Type: Improvement
> Components: Spark datasource, SparkSQL Support
> Reporter: Vinoth Chandar
> Assignee: Vinoth Chandar
> Priority: Major
>
> A lot of discussions around this kicked off from [https://github.com/apache/incubator-hudi/issues/869]
> Breaking down into phases, when we drop the hudi-spark-bundle*.jar onto the `jars` folder
>
> a) Writing data via Hudi datasource should work
> b) a + Hive Sync should work
> c) Spark datasource reads should work
> d) SparkSQL on Hive synced table works
>
> Start with Spark 2.4 and then proceed to 2.3 and iron out issues.
>
--
This message was sent by Atlassian Jira
(v8.3.2#803003)