You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@flink.apache.org by "Maximilian Michels (JIRA)" <ji...@apache.org> on 2015/12/07 11:11:11 UTC

[jira] [Created] (FLINK-3127) Measure backpressure in Flink jobs

Maximilian Michels created FLINK-3127:
-----------------------------------------

             Summary: Measure backpressure in Flink jobs
                 Key: FLINK-3127
                 URL: https://issues.apache.org/jira/browse/FLINK-3127
             Project: Flink
          Issue Type: Improvement
          Components: Streaming, TaskManager, Webfrontend
    Affects Versions: 0.10.1, 0.10.0
            Reporter: Maximilian Michels
             Fix For: 1.0.0


Multiple users have asked for a simple way to display the backpressure in a Flink job. Backpressure could be determined by monitoring throughput and allocated network buffers at the task managers.

Subsequently, a reliable measure of backpressue could be used to adjust the read behavior of sources, e.g. adjust the offset of the Kafka consumer.

Also, the web frontend should display the backpressure measure to allow users to find bottlenecks in there jobs.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)