You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "Jiayi Liao (JIRA)" <ji...@apache.org> on 2018/08/31 06:28:00 UTC

[jira] [Closed] (FLINK-9178) Add rate control for kafka source

     [ https://issues.apache.org/jira/browse/FLINK-9178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jiayi Liao closed FLINK-9178.
-----------------------------
    Resolution: Not A Problem

Actually we have back pressure control to limit the rate, I misunderstood this problem before.

> Add rate control for kafka source
> ---------------------------------
>
>                 Key: FLINK-9178
>                 URL: https://issues.apache.org/jira/browse/FLINK-9178
>             Project: Flink
>          Issue Type: Improvement
>          Components: Kafka Connector
>            Reporter: Jiayi Liao
>            Assignee: Tarush Grover
>            Priority: Major
>
> When I want to run the flink program from the earliest offset in Kafka, it'll be very easy to cause OOM if there are too much data, because of too many HeapMemorySegment in NetworkBufferPool.
> Maybe we should have some settings to control the rate of the receiving data?



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)