You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2021/08/08 20:19:00 UTC

[jira] [Commented] (HUDI-1936) Introduce a optional property for conditional upsert

    [ https://issues.apache.org/jira/browse/HUDI-1936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17395598#comment-17395598 ] 

ASF GitHub Bot commented on HUDI-1936:
--------------------------------------

hudi-bot edited a comment on pull request #3035:
URL: https://github.com/apache/hudi/pull/3035#issuecomment-862017744


   <!--
   Meta data
   {
     "version" : 1,
     "metaDataEntries" : [ {
       "hash" : "26dadb6627c90c9f06e66fba0b8bd24e5579665f",
       "status" : "FAILURE",
       "url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=209",
       "triggerID" : "26dadb6627c90c9f06e66fba0b8bd24e5579665f",
       "triggerType" : "PUSH"
     } ]
   }-->
   ## CI report:
   
   * 26dadb6627c90c9f06e66fba0b8bd24e5579665f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=209) 
   
   <details>
   <summary>Bot commands</summary>
     The @flinkbot bot supports the following commands:
   
    - `@flinkbot run travis` re-run the last Travis build
    - `@flinkbot run azure` re-run the last Azure build
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


> Introduce a optional property for conditional upsert 
> -----------------------------------------------------
>
>                 Key: HUDI-1936
>                 URL: https://issues.apache.org/jira/browse/HUDI-1936
>             Project: Apache Hudi
>          Issue Type: New Feature
>          Components: Common Core, Compaction
>            Reporter: Biswajit mohapatra
>            Assignee: Biswajit mohapatra
>            Priority: Minor
>              Labels: features, pull-request-available
>             Fix For: 0.9.0
>
>
> If anyone wants to use custom upsert logic then they have to override the Latest avro payload class which is only possible in java or scala . 
> Python developers have no such option . 
> Will be introducing a new payload class and a new key which can work in java , scala and python 
> This class will be responsible for custom upsert logic and a new key hoodie.update.key which will accept the columns which only need to be updated 
>  
> "hoodie.update.keys": "admission_date,name",  #comma seperated key 
> "hoodie.datasource.write.payload.class": "com.hudiUpsert.hudiCustomUpsert" #custom upsert key 
>  
> so this will only update the column admission_date and name in the target table 
>  
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)