You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "nsivabalan (via GitHub)" <gi...@apache.org> on 2026/06/25 02:59:12 UTC

Re: [I] Consistent hashing index resizing for Flink Engine [hudi]

nsivabalan commented on issue #15449:
URL: https://github.com/apache/hudi/issues/15449#issuecomment-4795427030

   This improvement (HUDI-4896) appears to have been delivered. Flink consistent hashing index resizing was implemented via:
   
   - HUDI-6326 — Flink write supports consistent bucket index (`42e6fff89434`)
   - HUDI-6328 — Flink support generate resize plan for consistent bucket index (`dbc0b433425f`), adds `FlinkConsistentBucketClusteringPlanStrategy`
   - HUDI-6329 — Adjust the partitioner automatically for flink consistent hashing index (`e8b1ddd708bc`)
   - HUDI-9228 — RowData writing for MOR with consistent hashing (`9cd1b610ffe2`)
   
   Resize is exercised end-to-end by `ITTestFlinkConsistentHashingClustering`. Note that bucket split is supported, but bucket merge is intentionally disabled in `FlinkConsistentBucketClusteringPlanStrategy#isBucketClusteringMergeEnabled()` to avoid multiple Flink write subtasks writing to the same file group.
   
   If there is a specific failure mode still being observed (e.g., a regression in resize on a particular Flink version, or a desire to enable merge), please add details and a repro; otherwise this issue can likely be closed.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org