You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Vinoth Chandar (Jira)" <ji...@apache.org> on 2020/09/23 02:46:00 UTC

[jira] [Created] (HUDI-1297) [Umbrella] Revamp Spark Datasource support using Spark 3 APIs

Vinoth Chandar created HUDI-1297:
------------------------------------

             Summary: [Umbrella] Revamp Spark Datasource support using Spark 3 APIs
                 Key: HUDI-1297
                 URL: https://issues.apache.org/jira/browse/HUDI-1297
             Project: Apache Hudi
          Issue Type: Improvement
          Components: Spark Integration
            Reporter: Vinoth Chandar
            Assignee: Vinoth Chandar
             Fix For: 0.7.0


Yet to be fully scoped out

But high level, we want to 
 * Add SQL support for MERGE, DELETE etc
 * First class support for streaming reads/writes via structured streaming
 * Row based reader/writers all the way
 * Support for File/Partition pruning using Hudi metadata tables



--
This message was sent by Atlassian Jira
(v8.3.4#803005)