You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Udit Mehrotra (Jira)" <ji...@apache.org> on 2021/08/25 09:34:00 UTC
[jira] [Updated] (HUDI-1936) Introduce a optional property for
conditional upsert
[ https://issues.apache.org/jira/browse/HUDI-1936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Udit Mehrotra updated HUDI-1936:
--------------------------------
Fix Version/s: (was: 0.9.0)
0.10.0
> Introduce a optional property for conditional upsert
> -----------------------------------------------------
>
> Key: HUDI-1936
> URL: https://issues.apache.org/jira/browse/HUDI-1936
> Project: Apache Hudi
> Issue Type: New Feature
> Components: Common Core, Compaction
> Reporter: Biswajit mohapatra
> Assignee: Biswajit mohapatra
> Priority: Minor
> Labels: features, pull-request-available
> Fix For: 0.10.0
>
>
> If anyone wants to use custom upsert logic then they have to override the Latest avro payload class which is only possible in java or scala .
> Python developers have no such option .
> Will be introducing a new payload class and a new key which can work in java , scala and python
> This class will be responsible for custom upsert logic and a new key hoodie.update.key which will accept the columns which only need to be updated
>
> "hoodie.update.keys": "admission_date,name", #comma seperated key
> "hoodie.datasource.write.payload.class": "com.hudiUpsert.hudiCustomUpsert" #custom upsert key
>
> so this will only update the column admission_date and name in the target table
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)