You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Vinoth Chandar (Jira)" <ji...@apache.org> on 2021/10/04 13:28:00 UTC
[jira] [Updated] (HUDI-1297) [Umbrella] Revamp Spark Datasource
support using Spark 3 APIs
[ https://issues.apache.org/jira/browse/HUDI-1297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vinoth Chandar updated HUDI-1297:
---------------------------------
Fix Version/s: (was: 0.10.0)
> [Umbrella] Revamp Spark Datasource support using Spark 3 APIs
> -------------------------------------------------------------
>
> Key: HUDI-1297
> URL: https://issues.apache.org/jira/browse/HUDI-1297
> Project: Apache Hudi
> Issue Type: Improvement
> Components: Spark Integration
> Affects Versions: 0.9.0
> Reporter: Vinoth Chandar
> Assignee: Vinoth Chandar
> Priority: Critical
> Labels: hudi-umbrellas
>
> Yet to be fully scoped out
> But high level, we want to
> * First class support for streaming reads/writes via structured streaming
> * Row based reader/writers all the way
> * Support for File/Partition pruning using Hudi metadata tables
--
This message was sent by Atlassian Jira
(v8.3.4#803005)