You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Lokesh Jain (Jira)" <ji...@apache.org> on 2023/02/22 11:22:00 UTC
[jira] [Updated] (HUDI-5813) Add Error table support for error events
[ https://issues.apache.org/jira/browse/HUDI-5813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Lokesh Jain updated HUDI-5813:
------------------------------
Description:
This PR adds capability for adding source conversion error events to error table .
*Approach* :
- Track error events in `SourceFormatAdapter`
- Track error events from `WriteStatus`
- Added new WriteClient for error table `BaseErrorTableWriter`
- If commit to error table fails then throw error so that delta sync fails .
was:
This PR adds capability for adding source conversion error events to quarantine table .
*Approach* :
- Track error events in `SourceFormatAdapter`
- Track error events from `WriteStatus`
- Added new WriteClient for quarantine table `BaseQuarantineTableWriter`
- If commit to quarantine table fails then throw error so that delta sync fails .
> Add Error table support for error events
> ----------------------------------------
>
> Key: HUDI-5813
> URL: https://issues.apache.org/jira/browse/HUDI-5813
> Project: Apache Hudi
> Issue Type: Bug
> Reporter: Lokesh Jain
> Assignee: Lokesh Jain
> Priority: Major
> Labels: pull-request-available
>
> This PR adds capability for adding source conversion error events to error table .
> *Approach* :
> - Track error events in `SourceFormatAdapter`
> - Track error events from `WriteStatus`
> - Added new WriteClient for error table `BaseErrorTableWriter`
> - If commit to error table fails then throw error so that delta sync fails .
--
This message was sent by Atlassian Jira
(v8.20.10#820010)