You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Maximilian Michels (JIRA)" <ji...@apache.org> on 2015/06/19 14:36:00 UTC

[jira] [Updated] (FLINK-1404) Add support to cache intermediate results

     [ https://issues.apache.org/jira/browse/FLINK-1404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Maximilian Michels updated FLINK-1404:
--------------------------------------
    Issue Type: Sub-task  (was: Improvement)
        Parent: FLINK-2250

> Add support to cache intermediate results
> -----------------------------------------
>
>                 Key: FLINK-1404
>                 URL: https://issues.apache.org/jira/browse/FLINK-1404
>             Project: Flink
>          Issue Type: Sub-task
>          Components: Distributed Runtime
>            Reporter: Ufuk Celebi
>            Assignee: Maximilian Michels
>
> With blocking intermediate results (FLINK-1350) and proper partition state management (FLINK-1359) it is necessary to allow the network buffer pool to request eviction of historic intermediate results when not enough buffers are available. With the currently available pipelined intermediate partitions this is not an issue, because buffer pools can be released as soon as a partition is consumed.
> We need to be able to trigger the recycling of buffers held by historic intermediate results when not enough buffers are available for new local pools.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)