You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "alexr17 (via GitHub)" <gi...@apache.org> on 2026/01/09 21:25:27 UTC

[I] Performance bug in DatasetBulkInsertOverwriteCommitActionExecutor with unpartitioned table [hudi]

alexr17 opened a new issue, #17820:
URL: https://github.com/apache/hudi/issues/17820

   ### Bug Description
   
   **What happened:**
   getPartitionToReplacedFileIds is doing expensive .distinct() call to get partition ids for unpartitioned table.
   **What you expected:**
   no need to do this when the table is unpartitioned
   **Steps to reproduce:**
   perform bulk insert with insert overwrite on unpartitioned table
   
   ### Environment
   
   **Hudi version:**
   **Query engine:** Spark
   **Relevant configs:**
   
   
   ### Logs and Stack Trace
   
   _No response_


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] Performance bug in DatasetBulkInsertOverwriteCommitActionExecutor with unpartitioned table [hudi]

Posted by "deepakpanda93 (via GitHub)" <gi...@apache.org>.
deepakpanda93 commented on issue #17820:
URL: https://github.com/apache/hudi/issues/17820#issuecomment-5355768170

   Thanks for reporting this.
   
   This looks addressed by #17821 (*fix: make insert overwrite with bulk insert more performant on unpartitioned tab*, merged 2026-01-14).
   
   It is included in release-1.2.0 (2026-05-23).
   
   Closing on that basis - please reopen or comment if you still see the behaviour on a build containing that change.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] Performance bug in DatasetBulkInsertOverwriteCommitActionExecutor with unpartitioned table [hudi]

Posted by "deepakpanda93 (via GitHub)" <gi...@apache.org>.
deepakpanda93 closed issue #17820: Performance bug in DatasetBulkInsertOverwriteCommitActionExecutor with unpartitioned table
URL: https://github.com/apache/hudi/issues/17820


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org