You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by "Behrang Saeedzadeh (JIRA)" <ji...@apache.org> on 2017/09/03 14:20:00 UTC
[jira] [Created] (KAFKA-5828) Allow explicitly setting polling
interval for Kafka connectors
Behrang Saeedzadeh created KAFKA-5828:
-----------------------------------------
Summary: Allow explicitly setting polling interval for Kafka connectors
Key: KAFKA-5828
URL: https://issues.apache.org/jira/browse/KAFKA-5828
Project: Kafka
Issue Type: Improvement
Components: KafkaConnect
Reporter: Behrang Saeedzadeh
I have a Kafka cluster deployed in our internal data center and a Kafka Connect server deployed in AWS that gets data records from a topic on the Kafka cluster and writes them into a Kinesis stream.
We want to ensure that our Kafka connect server does not saturate the available bandwidth between our internal data center and AWS.
Using {{max.partition.fetch.bytes}} we can limit the upper bound of data that can be fetched in each poll call. If we can also configure the poll interval, then we can limit how much data is transferred per partition per second.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)