You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Vinoth Chandar (Jira)" <ji...@apache.org> on 2021/10/06 14:04:00 UTC

[jira] [Updated] (HUDI-868) [UMBRELLA] Insert Overwrite API

     [ https://issues.apache.org/jira/browse/HUDI-868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Vinoth Chandar updated HUDI-868:
--------------------------------
    Fix Version/s:     (was: 0.10.0)

> [UMBRELLA] Insert Overwrite API
> -------------------------------
>
>                 Key: HUDI-868
>                 URL: https://issues.apache.org/jira/browse/HUDI-868
>             Project: Apache Hudi
>          Issue Type: New Feature
>    Affects Versions: 0.9.0
>            Reporter: satish
>            Assignee: satish
>            Priority: Major
>              Labels: hudi-umbrellas
>
> Usecases:
> - Tables where the majority of records change every cycle. So it is likely efficient to write new data instead of doing upserts.
> -  Operational tasks to fix a specific corrupted partition. We can do 'insert overwrite'  on that partition with records from the source. This can be much faster than restore and replay for some data sources.
> The functionality will be similar to hive definition of 'insert overwite'. But, doing this in Hoodie will provide better isolation between writer and readers. I can share possible implementation choices and some nuances if the community thinks this is a useful feature to add. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)