[jira] [Commented] (HUDI-648) Implement error log/table for Datasource/DeltaStreamer/WriteClient/Compaction writes

["ASF GitHub Bot (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HUDI-648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17409999#comment-17409999 ] 

ASF GitHub Bot commented on HUDI-648:
-------------------------------------

pratyakshsharma commented on a change in pull request #3312:
URL: https://github.com/apache/hudi/pull/3312#discussion_r702302452



##########
File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/AbstractHoodieWriteClient.java
##########
@@ -315,6 +315,17 @@ public void rollbackFailedBootstrap() {
    */
   public abstract O insert(I records, final String instantTime);
 
+  /**
+   * Inserts the given Error HoodieRecords, into the table. This API is intended to be used for normal writes.
+   * <p>
+   * This API is intended to be used to write wrong records.
+   *
+   * @param records Error HoodieRecords to insert
+   * @param instantTime Instant time of the commit
+   * @return Collection of WriteStatus to inspect errors and counts
+   */
+  public abstract O insertError(I records, final String instantTime);

Review comment:
       So this api inserts error records into a separate error table or the regular Hudi table? The java doc seems to be misleading. Can we mention into the error table?




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


> Implement error log/table for Datasource/DeltaStreamer/WriteClient/Compaction writes
> ------------------------------------------------------------------------------------
>
>                 Key: HUDI-648
>                 URL: https://issues.apache.org/jira/browse/HUDI-648
>             Project: Apache Hudi
>          Issue Type: New Feature
>          Components: DeltaStreamer, Spark Integration, Writer Core
>            Reporter: Vinoth Chandar
>            Assignee: liujinhui
>            Priority: Major
>              Labels: pull-request-available, sev:normal, user-support-issues
>         Attachments: image-2021-03-03-11-40-21-083.png
>
>
> We would like a way to hand the erroring records from writing or compaction back to the users, in a separate table or log. This needs to work generically across all the different writer paths.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)