You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "satish (Jira)" <ji...@apache.org> on 2020/04/08 18:15:00 UTC
[jira] [Updated] (HUDI-771) Add HoodieWriteClient config to throw
error on partial failures
[ https://issues.apache.org/jira/browse/HUDI-771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
satish updated HUDI-771:
------------------------
Description:
Introduce new config "hoodie.write.tolerate.failure.percentage". During upsert, if number of errors is greater than configured percent, throw error instead of returning WriteStatus that tracks success/failures. By default, this percent can be set to 100 for backward compatibility.
This is to help "low volume" tables where its efficient to just rewrite all records instead of trying to figure out records that failed to upsert. These clients can set the config to 0 percent. Also, provides a way to fail fast.
was:
Introduce new config "hoodie.write.tolerate.failure.percentage". During upsert, if number of errors is greater than configured percent, throw error instead of returning WriteStatus that tracks success/failures. By default, this percent can be set to 100 for backward compatibility.
This is to help "low volume" tables where its efficient to just rewrite all records instead of trying to figure out records that failed to upsert. These clients can set the config to 0 percent.
> Add HoodieWriteClient config to throw error on partial failures
> ---------------------------------------------------------------
>
> Key: HUDI-771
> URL: https://issues.apache.org/jira/browse/HUDI-771
> Project: Apache Hudi (incubating)
> Issue Type: Improvement
> Reporter: satish
> Assignee: satish
> Priority: Minor
>
> Introduce new config "hoodie.write.tolerate.failure.percentage". During upsert, if number of errors is greater than configured percent, throw error instead of returning WriteStatus that tracks success/failures. By default, this percent can be set to 100 for backward compatibility.
> This is to help "low volume" tables where its efficient to just rewrite all records instead of trying to figure out records that failed to upsert. These clients can set the config to 0 percent. Also, provides a way to fail fast.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)