You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "Jingsong Lee (Jira)" <ji...@apache.org> on 2019/11/19 14:19:00 UTC

[jira] [Created] (FLINK-14860) Provide a new InputSplitAssigner that consider page cache utilization ratio

Jingsong Lee created FLINK-14860:
------------------------------------

             Summary: Provide a new InputSplitAssigner that consider page cache utilization ratio
                 Key: FLINK-14860
                 URL: https://issues.apache.org/jira/browse/FLINK-14860
             Project: Flink
          Issue Type: New Feature
          Components: Table SQL / Runtime
            Reporter: Jingsong Lee


At present, only the need of localization is considered in LocatableInputSplitAssigner, but there is a problem of random floating among three copies of split (HDFS has three copies for files), which leads to excessive use of cache. Therefore, we also need to make it possible to schedule three copies in a clear order on the basis of localization.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)