You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Sagar Sumit (Jira)" <ji...@apache.org> on 2024/12/17 02:44:00 UTC
[jira] [Commented] (HUDI-8518) Seondary index should work with all merge modes
[ https://issues.apache.org/jira/browse/HUDI-8518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17906238#comment-17906238 ]
Sagar Sumit commented on HUDI-8518:
-----------------------------------
Wrote a test to repro the issue with EVENT_TIME_ORDERING. Updates and deletes of SI are working correctly. Yet to test CUSTOM merge mode.
Dev branch - https://github.com/codope/hudi/tree/hudi-8518-si-merge-modes
> Seondary index should work with all merge modes
> -----------------------------------------------
>
> Key: HUDI-8518
> URL: https://issues.apache.org/jira/browse/HUDI-8518
> Project: Apache Hudi
> Issue Type: Sub-task
> Reporter: Sagar Sumit
> Assignee: Sagar Sumit
> Priority: Blocker
> Fix For: 1.0.1
>
> Original Estimate: 20h
> Remaining Estimate: 20h
>
> Currently, secondary index just looks at the file slices part of the commit metadata, assuming that the index must be correct for previous versions. This all works good with overwrite with latest payload. But, if someone is using custom payload, then index records should be prepared while looking at all file slices merged for a filegroup according to the custom payload.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)