Re: [I] Record Index is not working with iNSERT_OVERWRITE_TABLE [hudi]

["nsivabalan (via GitHub)" <gi...@apache.org>]

nsivabalan commented on issue #16361:
URL: https://github.com/apache/hudi/issues/16361#issuecomment-4795592467

   This appears to have been fixed by [HUDI-6443](https://issues.apache.org/jira/browse/HUDI-6443) / [PR #9055](https://github.com/apache/hudi/pull/9055) (commit `6d3311c`, merged July 2023), which added explicit handling for `INSERT_OVERWRITE`, `INSERT_OVERWRITE_TABLE`, and `DELETE_PARTITION` operations in the record-level index update path. In current master, `HoodieBackedTableMetadataWriter#getRecordIndexAdditionalUpserts` (around line 2353) loads existing records from the replaced file groups and anti-joins them against the new write statuses to delete stale RLI entries on overwrite. The functional test base `RecordLevelIndexTestBase` exercises `INSERT_OVERWRITE_OPERATION_OPT_VAL` as well.
   
   If you can still reproduce this on a recent release (>=0.14.0), please share the table version, Hudi version, and the exact write configs / SQL — happy to reopen with a concrete repro. Otherwise this can likely be closed as a duplicate of #10445.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org