You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Juho Autio (JIRA)" <ji...@apache.org> on 2018/05/11 08:24:00 UTC
[jira] [Updated] (FLINK-9334) Docs to have a code snippet of Kafka
partition discovery
[ https://issues.apache.org/jira/browse/FLINK-9334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Juho Autio updated FLINK-9334:
------------------------------
Description:
Tzu-Li (Gordon) said:
{quote}Yes, it might be helpful to have a code snippet to demonstrate the configuration for partition discovery.
{quote}
----
*Background*
The docs correctly say:
{quote}To enable it, set a non-negative value for +flink.partition-discovery.interval-millis+ in the _provided properties config_
{quote}
So it should be set in the Properties that are passed in the constructor of FlinkKafkaConsumer.
I had somehow assumed that this should go to flink-conf.yaml (maybe because it starts with "flink."?), and obviously the FlinkKafkaConsumer doesn't read that.
A piece of example code might've helped me avoid this mistake.
This was discussed on the user mailing list:
[http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Kafka-Consumers-Partition-Discovery-doesn-t-work-tp19129p19484.html]
was:
Tzu-Li (Gordon) said:
{quote}
Yes, it might be helpful to have a code snippet to demonstrate the configuration for partition discovery.
{quote}
The docs correctly say:
{quote}
To enable it, set a non-negative value for +flink.partition-discovery.interval-millis+ in the _provided properties config_
{quote}
So it should be set in the Properties that are passed in the constructor of FlinkKafkaConsumer.
I had somehow assumed that this should go to flink-conf.yaml (maybe because it starts with "flink."?), and obviously the FlinkKafkaConsumer doesn't read that.
A piece of example code might've helped me avoid this mistake.
This was discussed on the user mailing list:
http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Kafka-Consumers-Partition-Discovery-doesn-t-work-tp19129p19484.html
> Docs to have a code snippet of Kafka partition discovery
> --------------------------------------------------------
>
> Key: FLINK-9334
> URL: https://issues.apache.org/jira/browse/FLINK-9334
> Project: Flink
> Issue Type: Improvement
> Reporter: Juho Autio
> Priority: Major
>
> Tzu-Li (Gordon) said:
> {quote}Yes, it might be helpful to have a code snippet to demonstrate the configuration for partition discovery.
> {quote}
>
> ----
> *Background*
>
> The docs correctly say:
>
> {quote}To enable it, set a non-negative value for +flink.partition-discovery.interval-millis+ in the _provided properties config_
> {quote}
>
> So it should be set in the Properties that are passed in the constructor of FlinkKafkaConsumer.
>
> I had somehow assumed that this should go to flink-conf.yaml (maybe because it starts with "flink."?), and obviously the FlinkKafkaConsumer doesn't read that.
>
> A piece of example code might've helped me avoid this mistake.
>
> This was discussed on the user mailing list:
> [http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Kafka-Consumers-Partition-Discovery-doesn-t-work-tp19129p19484.html]
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)