You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "liujinhui (Jira)" <ji...@apache.org> on 2020/09/08 09:32:00 UTC

[jira] [Commented] (HUDI-1269) Make whether the failure of sync hudi data to hive affects hudi ingest process configurable

    [ https://issues.apache.org/jira/browse/HUDI-1269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17192072#comment-17192072 ] 

liujinhui commented on HUDI-1269:
---------------------------------

I am interested in hive related issues, may i take this ?[~wangxianghu]

> Make whether the failure of sync hudi data to hive affects hudi ingest process configurable
> -------------------------------------------------------------------------------------------
>
>                 Key: HUDI-1269
>                 URL: https://issues.apache.org/jira/browse/HUDI-1269
>             Project: Apache Hudi
>          Issue Type: New Feature
>          Components: Hive Integration
>            Reporter: wangxianghu
>            Assignee: liujinhui
>            Priority: Major
>             Fix For: 0.6.1
>
>
> Currently, In an ETL pipeline(eg, kafka -> hudi -> hive), If the process of hudi to hive failed, the job is still running.
> I think we can add a switch to control the job behavior(fail or keep running) when kafka to hudi is ok, while hudi to hive failed, leave the choice to user. since ingesting data to hudi and sync to hive is a complete task in some scenes.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)