You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Danny Chen (Jira)" <ji...@apache.org> on 2022/02/24 06:46:00 UTC

[jira] [Comment Edited] (HUDI-3488) The flink small file list should exclude file slices with pending compaction

    [ https://issues.apache.org/jira/browse/HUDI-3488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17497156#comment-17497156 ] 

Danny Chen edited comment on HUDI-3488 at 2/24/22, 6:45 AM:
------------------------------------------------------------

Fixed via master branch: 943b99775b7b0cf4340a9af76b6dd235cf91e350


was (Author: danny0405):
Fixed via master branch: 3102cf7bbb8f81bc5cc92a01b4f65061c945deea

> The flink small file list should exclude file slices with pending compaction
> ----------------------------------------------------------------------------
>
>                 Key: HUDI-3488
>                 URL: https://issues.apache.org/jira/browse/HUDI-3488
>             Project: Apache Hudi
>          Issue Type: Improvement
>            Reporter: yanenze
>            Priority: Blocker
>              Labels: flink, hudi, pull-request-available
>             Fix For: 0.11.0
>
>
> when we use async-compaction files with flink, bucketAssigner find small file list , is lost the file which is in pendingCompaction, so the total size only caculate the (log file size * compressratio (0.35))



--
This message was sent by Atlassian Jira
(v8.20.1#820001)