You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "Nico Kruber (JIRA)" <ji...@apache.org> on 2018/04/25 13:46:00 UTC

[jira] [Created] (FLINK-9253) Make buffer count per InputGate always #channels*buffersPerChannel + ExclusiveBuffers

Nico Kruber created FLINK-9253:
----------------------------------

             Summary: Make buffer count per InputGate always #channels*buffersPerChannel + ExclusiveBuffers
                 Key: FLINK-9253
                 URL: https://issues.apache.org/jira/browse/FLINK-9253
             Project: Flink
          Issue Type: Sub-task
          Components: Network
    Affects Versions: 1.5.0, 1.6.0
            Reporter: Nico Kruber
            Assignee: Nico Kruber
             Fix For: 1.5.0


The credit-based flow control path assigns exclusive buffers only to remote channels (which makes sense since local channels don't use any own buffers). However, this is a bit intransparent with respect to how much data may be in buffers since this depends on the actual schedule of the job and not the job graph.

By adapting the floating buffers to use a maximum of {{#channels*buffersPerChannel + floatingBuffersPerGate - #exclusiveBuffers}}, we would be channel-type agnostic and keep the old behaviour.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)