You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@paimon.apache.org by "Aitozi (via GitHub)" <gi...@apache.org> on 2023/11/02 05:32:17 UTC

[I] [Feature] Support to specify the aggregate fields for the partial-update merge engine [incubator-paimon]

Aitozi opened a new issue, #2242:
URL: https://github.com/apache/incubator-paimon/issues/2242

   ### Search before asking
   
   - [X] I searched in the [issues](https://github.com/apache/incubator-paimon/issues) and found nothing similar.
   
   
   ### Motivation
   
   Currently, the aggregation and partial-upadate are individual merge engine. And the partial-update will use `last_value_not_null`  
    aggregation semantic for the field not in sequence group, and `last_value` for the field in the sequence group.
   
   We can also support user set the aggregation function for the fields in partial-update merge engine. 
   This will benefit the case:  
   When merging multiple rows for the primary key into a wide table, user can set the aggregate strategy for the different field eg: sum/first_value/max ... 
   
   ### Solution
   
   Introduce fieldAggregators for the `PartialUpdateMergeFunction` and unify the current merge solution
   
   ### Anything else?
   
   _No response_
   
   ### Are you willing to submit a PR?
   
   - [X] I'm willing to submit a PR!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] [Feature] Support to specify the aggregate fields for the partial-update merge engine [incubator-paimon]

Posted by "JingsongLi (via GitHub)" <gi...@apache.org>.
JingsongLi closed issue #2242: [Feature] Support to specify the aggregate fields for the partial-update merge engine
URL: https://github.com/apache/incubator-paimon/issues/2242


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org