You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Udit Mehrotra (Jira)" <ji...@apache.org> on 2021/08/25 09:34:00 UTC

[jira] [Updated] (HUDI-1936) Introduce a optional property for conditional upsert

     [ https://issues.apache.org/jira/browse/HUDI-1936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Udit Mehrotra updated HUDI-1936:
--------------------------------
    Fix Version/s:     (was: 0.9.0)
                   0.10.0

> Introduce a optional property for conditional upsert 
> -----------------------------------------------------
>
>                 Key: HUDI-1936
>                 URL: https://issues.apache.org/jira/browse/HUDI-1936
>             Project: Apache Hudi
>          Issue Type: New Feature
>          Components: Common Core, Compaction
>            Reporter: Biswajit mohapatra
>            Assignee: Biswajit mohapatra
>            Priority: Minor
>              Labels: features, pull-request-available
>             Fix For: 0.10.0
>
>
> If anyone wants to use custom upsert logic then they have to override the Latest avro payload class which is only possible in java or scala . 
> Python developers have no such option . 
> Will be introducing a new payload class and a new key which can work in java , scala and python 
> This class will be responsible for custom upsert logic and a new key hoodie.update.key which will accept the columns which only need to be updated 
>  
> "hoodie.update.keys": "admission_date,name",  #comma seperated key 
> "hoodie.datasource.write.payload.class": "com.hudiUpsert.hudiCustomUpsert" #custom upsert key 
>  
> so this will only update the column admission_date and name in the target table 
>  
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)