[I] [BUG] When writing large amounts, primary keys are duplicated [hudi]

["waywtdcc (via GitHub)" <gi...@apache.org>]

waywtdcc opened a new issue, #11024:
URL: https://github.com/apache/hudi/issues/11024

   When writing large amounts(2GB), primary keys are duplicated；
   
   
   CREATE TABLE cc_test.hudi_perf_2g (
     id BIGINT NOT NULL,
     data1 STRING,
     data2 STRING,
     data3 STRING,
     data4 STRING,
     data5 STRING,
     data6 STRING,
     data7 STRING,
     data8 STRING,
     data9 STRING,
     data10 STRING,
     data11 STRING,
     data12 STRING,
     data13 STRING,
     data14 STRING,
     data15 STRING,
     data16 STRING,
     data17 STRING,
     data18 STRING,
     data19 STRING,
     data20 STRING,
     ts timestamp)
   USING hudi
   TBLPROPERTIES (
     'primaryKey' = 'id',
     'write.precombine.field' = 'ts',
     'table.type' = 'COPY_ON_WRITE');
   
    insert into  cc_test.hudi_perf_2g
    select *,now()
    from cc_test.gen_data_2g;


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] [BUG] When writing large amounts, primary keys are duplicated [hudi]

["waywtdcc (via GitHub)" <gi...@apache.org>]

waywtdcc closed issue #11024: [BUG] When writing large amounts, primary keys are duplicated
URL: https://github.com/apache/hudi/issues/11024


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org