You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Danny Chen (Jira)" <ji...@apache.org> on 2022/02/24 04:00:00 UTC
[jira] [Commented] (HUDI-3488) The flink small file list should exclude file slices with pending compaction
[ https://issues.apache.org/jira/browse/HUDI-3488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17497156#comment-17497156 ]
Danny Chen commented on HUDI-3488:
----------------------------------
Fixed via master branch: 3102cf7bbb8f81bc5cc92a01b4f65061c945deea
> The flink small file list should exclude file slices with pending compaction
> ----------------------------------------------------------------------------
>
> Key: HUDI-3488
> URL: https://issues.apache.org/jira/browse/HUDI-3488
> Project: Apache Hudi
> Issue Type: Improvement
> Reporter: yanenze
> Priority: Blocker
> Labels: flink, hudi, pull-request-available
> Fix For: 0.11.0
>
>
> when we use async-compaction files with flink, bucketAssigner find small file list , is lost the file which is in pendingCompaction, so the total size only caculate the (log file size * compressratio (0.35))
--
This message was sent by Atlassian Jira
(v8.20.1#820001)