You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "sivabalan narayanan (Jira)" <ji...@apache.org> on 2021/12/14 19:36:00 UTC

[jira] [Assigned] (HUDI-3018) Flag if user df has "_hoodie_is_deleted" field with diff data type other than boolean.

     [ https://issues.apache.org/jira/browse/HUDI-3018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

sivabalan narayanan reassigned HUDI-3018:
-----------------------------------------

    Assignee: sivabalan narayanan

> Flag if user df has "_hoodie_is_deleted" field with diff data type other than boolean. 
> ---------------------------------------------------------------------------------------
>
>                 Key: HUDI-3018
>                 URL: https://issues.apache.org/jira/browse/HUDI-3018
>             Project: Apache Hudi
>          Issue Type: Improvement
>          Components: Usability
>            Reporter: sivabalan narayanan
>            Assignee: sivabalan narayanan
>            Priority: Major
>
> as of now, hudi interprets a special column named "_hoodie_is_deleted" and if set to true, the record is considered a delete else an update or an insert. this is not a reserved column as such. For eg, user dataframe can have a column named "_hoodie_is_deleted" whose data type is random string. 
>  
> Add validations to hudi to ensure that this columns' data type is boolean if present in the df. 
>  



--
This message was sent by Atlassian Jira
(v8.20.1#820001)