[jira] [Assigned] (HUDI-1508) Partition update with global index in MOR tables resulting in duplicate values during read optimized queries

["Raymond Xu (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HUDI-1508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Raymond Xu reassigned HUDI-1508:
--------------------------------

    Assignee: Raymond Xu

> Partition update with global index in MOR tables resulting in duplicate values during read optimized queries
> ------------------------------------------------------------------------------------------------------------
>
>                 Key: HUDI-1508
>                 URL: https://issues.apache.org/jira/browse/HUDI-1508
>             Project: Apache Hudi
>          Issue Type: Bug
>          Components: index
>            Reporter: Ryan Pifer
>            Assignee: Raymond Xu
>            Priority: Major
>              Labels: blocker, release-blocker
>
> The way Hudi handles updating partition path is by locating the existing record and performing a delete on the previous partition and performing insert on new partition. In the case of Merge-on-Read tables the delete operation, and any update operation, is added as a log file. However since an insert occurs in the new partition the record is added in a parquet file. Querying using `QUERY_TYPE_READ_OPTIMIZED_OPT_VAL` fetches only parquet files and now we have the case where 2 records for given primary key are present



--
This message was sent by Atlassian Jira
(v8.20.10#820010)