[GitHub] [incubator-paimon] JingsongLi opened a new pull request, #1259: [core] Introduce sequence group to partial update

["JingsongLi (via GitHub)" <gi...@apache.org>]

JingsongLi opened a new pull request, #1259:
URL: https://github.com/apache/incubator-paimon/pull/1259

   <!-- Please specify the module before the PR name: [core] ... or [flink] ... -->
   
   ### Purpose
   
   <!-- What is the purpose of the change, or the associated issue -->
   
   A sequence-field may not solve the disorder problem of partial-update tables with multiple stream updates, because the sequence-field may be overwritten by the latest data of another stream during multi-stream update.
   
   So we introduce sequence group mechanism for partial-update tables. It can solve:
   
   1. Disorder during multi-stream update. Each stream defines its own sequence-groups.
   2. A true partial-update, not just a non-null update.
   
   
   ### Tests
   
   Both UT & IT
   
   <!-- List UT and IT cases to verify this change -->
   
   ### API and Format
   
   ```
   CREATE TABLE T (
       k INT,
       a INT,
       b INT,
       g_1 INT,
       c INT,
       d INT,
       g_2 INT,
       PRIMARY KEY (k) NOT ENFORCED
   ) WITH (
       'merge-engine'='partial-update',
       'fields.g_1.sequence-group'='a,b',
       'fields.g_2.sequence-group'='c,d'
   );
   ```
   <!-- Does this change affect API or storage format -->
   
   ### Documentation
   
   Yes
   
   <!-- Does this change introduce a new feature -->
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-paimon] JingsongLi merged pull request #1259: [core] Introduce sequence group to partial update

["JingsongLi (via GitHub)" <gi...@apache.org>]

JingsongLi merged PR #1259:
URL: https://github.com/apache/incubator-paimon/pull/1259


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org