You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "parisni (via GitHub)" <gi...@apache.org> on 2023/06/28 14:57:20 UTC

[GitHub] [hudi] parisni commented on pull request #6815: [HUDI-4937] Fix `HoodieTable` injecting non-reusable `HoodieBackedTableMetadata` aggressively flushing MT readers

parisni commented on PR #6815:
URL: https://github.com/apache/hudi/pull/6815#issuecomment-1611601815

   hi @nsivabalan ! is this supposed to be integrated in 0.14 ? As of 0.13.1, cleaning w/ MDT still is incredibly slow in this context:
   -  huge number of partitions >= 100k
   - huge number of affected partitions >=10k OR incremental cleaning not kicks in b/c no files to clean at all
   
   We recently had a cleaning job w/ MDT running for 24h while dropping the MDT the job ended in few minutes.
   
   Thanks


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org