You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "Kurt Young (Jira)" <ji...@apache.org> on 2019/12/03 02:04:00 UTC

[jira] [Commented] (FLINK-14860) Provide a new InputSplitAssigner that consider page cache utilization ratio

    [ https://issues.apache.org/jira/browse/FLINK-14860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16986512#comment-16986512 ] 

Kurt Young commented on FLINK-14860:
------------------------------------

Shall we move this to milestone 2?

> Provide a new InputSplitAssigner that consider page cache utilization ratio
> ---------------------------------------------------------------------------
>
>                 Key: FLINK-14860
>                 URL: https://issues.apache.org/jira/browse/FLINK-14860
>             Project: Flink
>          Issue Type: Sub-task
>          Components: Table SQL / Runtime
>            Reporter: Jingsong Lee
>            Priority: Major
>
> At present, only the need of localization is considered in LocatableInputSplitAssigner, but there is a problem of random floating among three copies of split (HDFS has three copies for files), which leads to excessive use of cache. Therefore, we also need to make it possible to schedule three copies in a clear order on the basis of localization.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)