You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2023/04/25 03:53:00 UTC

[jira] [Updated] (HUDI-6136) Add idempotency support to spark datasource writes

     [ https://issues.apache.org/jira/browse/HUDI-6136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

ASF GitHub Bot updated HUDI-6136:
---------------------------------
    Labels: pull-request-available  (was: )

> Add idempotency support to spark datasource writes
> --------------------------------------------------
>
>                 Key: HUDI-6136
>                 URL: https://issues.apache.org/jira/browse/HUDI-6136
>             Project: Apache Hudi
>          Issue Type: Improvement
>          Components: writer-core
>            Reporter: sivabalan narayanan
>            Priority: Major
>              Labels: pull-request-available
>
> Would be good to add idempotency support to spark data-source writes. Essentially, if the same batch is ingested again to hudi, hudi should skip them. 
>  



--
This message was sent by Atlassian Jira
(v8.20.10#820010)