You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Vinoth Chandar (Jira)" <ji...@apache.org> on 2020/10/02 21:37:00 UTC
[jira] [Commented] (HUDI-1297) [Umbrella] Revamp Spark Datasource
support using Spark 3 APIs
[ https://issues.apache.org/jira/browse/HUDI-1297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17206529#comment-17206529 ]
Vinoth Chandar commented on HUDI-1297:
--------------------------------------
yes. thats happening as we speak. support for 3.0
> [Umbrella] Revamp Spark Datasource support using Spark 3 APIs
> -------------------------------------------------------------
>
> Key: HUDI-1297
> URL: https://issues.apache.org/jira/browse/HUDI-1297
> Project: Apache Hudi
> Issue Type: Improvement
> Components: Spark Integration
> Reporter: Vinoth Chandar
> Assignee: Vinoth Chandar
> Priority: Major
> Fix For: 0.7.0
>
>
> Yet to be fully scoped out
> But high level, we want to
> * Add SQL support for MERGE, DELETE etc
> * First class support for streaming reads/writes via structured streaming
> * Row based reader/writers all the way
> * Support for File/Partition pruning using Hudi metadata tables
--
This message was sent by Atlassian Jira
(v8.3.4#803005)