You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "pengzhiwei (Jira)" <ji...@apache.org> on 2020/11/30 13:20:00 UTC

[jira] [Created] (HUDI-1424) Write Type changed to BULK_INSERT when set ENABLE_ROW_WRITER_OPT_KEY=true

pengzhiwei created HUDI-1424:
--------------------------------

             Summary: Write Type changed to BULK_INSERT when set ENABLE_ROW_WRITER_OPT_KEY=true
                 Key: HUDI-1424
                 URL: https://issues.apache.org/jira/browse/HUDI-1424
             Project: Apache Hudi
          Issue Type: Bug
          Components: Spark Integration
            Reporter: pengzhiwei
             Fix For: 0.6.1
         Attachments: image-2020-11-30-21-17-29-247.png

I write data to hudi with UPSERT mode, when set ENABLE_ROW_WRITER_OPT_KEY=true, the write type will change to BULK_INSERT. This can be very confusing to users.

This was caused by the  if-test condition  in HoodieSparkSqlWriter#write as follow:

!image-2020-11-30-21-17-29-247.png|width=1343,height=242!

There is a lack of judgment on the write type,which make all of the write type change to bulk write.

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)