You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Josh Lemer (JIRA)" <ji...@apache.org> on 2018/05/17 17:55:00 UTC
[jira] [Created] (FLINK-9396) Allow streaming sources (especially
Files, Kafka) to set max queued input elements
Josh Lemer created FLINK-9396:
---------------------------------
Summary: Allow streaming sources (especially Files, Kafka) to set max queued input elements
Key: FLINK-9396
URL: https://issues.apache.org/jira/browse/FLINK-9396
Project: Flink
Issue Type: Task
Components: DataStream API
Reporter: Josh Lemer
In some applications, there can be situations where a file source queues up so many files, that when it is time for a checkpoint to start, the checkpoint takes way too long. It would be nice if we could limit the total queued files to read to some number, to place an upper bound on how long checkpoints take.
See http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Fwd-Decrease-initial-source-read-speed-td20207.html for previous questions about this.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)