You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "Jingsong Lee (Jira)" <ji...@apache.org> on 2022/06/19 10:46:00 UTC

[jira] [Assigned] (FLINK-27696) Add bin-pack strategy to split the whole bucket data files into several small splits for append-only table.

     [ https://issues.apache.org/jira/browse/FLINK-27696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jingsong Lee reassigned FLINK-27696:
------------------------------------

    Assignee: Jingsong Lee

> Add bin-pack strategy to split the whole bucket data files into several small splits for append-only table.
> -----------------------------------------------------------------------------------------------------------
>
>                 Key: FLINK-27696
>                 URL: https://issues.apache.org/jira/browse/FLINK-27696
>             Project: Flink
>          Issue Type: Sub-task
>            Reporter: Zheng Hu
>            Assignee: Jingsong Lee
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: table-store-0.2.0
>
>
> For append-only table,  we don't have to assign each task with a whole bucket data files. Instead,  we can use some algorithm ( such as bin-packing) to split the whole bucket data files into multiple fragments  to improve the job parallelism.



--
This message was sent by Atlassian Jira
(v8.20.7#820007)