You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Nishith Agarwal (Jira)" <ji...@apache.org> on 2020/04/30 23:43:00 UTC

[jira] [Created] (HUDI-856) Supporting multiple insert/upsert operations before commit()

Nishith Agarwal created HUDI-856:
------------------------------------

             Summary: Supporting multiple insert/upsert operations before commit()
                 Key: HUDI-856
                 URL: https://issues.apache.org/jira/browse/HUDI-856
             Project: Apache Hudi (incubating)
          Issue Type: Bug
          Components: Common Core
            Reporter: Nishith Agarwal


The HoodieWriteClient api's are designed such that we can have the following operations  : 

 

1) startCommit()

2) perform operations (upsert, insert)

3) commit()

In the past, Hudi used to be able to support multiple operations for insert, upsert before commiting. With MOR inflight data (for rollbacks) and the new state machine for timeline metadata this does not work. Opening this ticket to discuss what's the best suggested way of using these APIs

[~varadarb] [~vinoth]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)