You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "Stephan Ewen (JIRA)" <ji...@apache.org> on 2016/02/19 22:17:18 UTC

[jira] [Created] (FLINK-3456) Backpressure Monitoring does not work for Kafka Sources

Stephan Ewen created FLINK-3456:
-----------------------------------

             Summary: Backpressure Monitoring does not work for Kafka Sources
                 Key: FLINK-3456
                 URL: https://issues.apache.org/jira/browse/FLINK-3456
             Project: Flink
          Issue Type: Bug
          Components: Distributed Runtime
    Affects Versions: 1.0.0
            Reporter: Stephan Ewen


For sources that run with Kafka 0.8, the main thread is not the thread that processes elements and pushes them into the network. The Kafka fetcher threads actually emit elements to the SourceContext.

Because the backpressure sampler samples the main thread, it does not correctly handle Kafka Sources.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)