You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@flink.apache.org by Avi Levi <av...@bluevoyant.com> on 2018/12/24 18:19:33 UTC

getting Timeout expired while fetching topic metadata

Hi all,
very new to flink so my apology if it seems trivial.
We deployed flink on gcloud
I am trying to connect to kafka but keep getting this error:
*org.apache.kafka.common.errors.TimeoutException: Timeout expired while
fetching topic metadata*
this how my properties look like
val consumerProperties: Properties = {
    val p = new Properties()
    p.setProperty("bootstrap.servers", kafkaBootStrapServers)
    p.setProperty("group.id", groupId)
    p.setProperty("client.id", s"queue-consumer-${randomUUID().toString}")

p.setProperty("ssl.keystore.location","/usr/path_to/kafka_ssl_client.keystore.jks"))
    p.setProperty("ssl.keystore.password",  "some password")
    p.setProperty("ssl.truststore.location",
"/usr/path_to/kafka_ssl_client.keystore.jks")
    p.setProperty("ssl.truststore.password", "some password")
    p
  }

please advise

Thanks
Avi

Re: getting Timeout expired while fetching topic metadata

Posted by Avi Levi <av...@bluevoyant.com>.

Thanks Miki,
we had a bug in the certs. however the property you suggested gave as
better logs so it really cleared things. THANKS !!!

On Mon, Dec 24, 2018 at 8:45 PM miki haiat <mi...@gmail.com> wrote:

> Hi Avi,
> Can you try to add this properties
>
>  props.put(CommonClientConfigs.SECURITY_PROTOCOL_CONFIG, "SSL");
>
> Thanks,
> Miki
>
> On Mon, Dec 24, 2018 at 8:19 PM Avi Levi <av...@bluevoyant.com> wrote:
>
>> Hi all,
>> very new to flink so my apology if it seems trivial.
>> We deployed flink on gcloud
>> I am trying to connect to kafka but keep getting this error:
>> *org.apache.kafka.common.errors.TimeoutException: Timeout expired while
>> fetching topic metadata*
>> this how my properties look like
>> val consumerProperties: Properties = {
>>     val p = new Properties()
>>     p.setProperty("bootstrap.servers", kafkaBootStrapServers)
>>     p.setProperty("group.id", groupId)
>>     p.setProperty("client.id",
>> s"queue-consumer-${randomUUID().toString}")
>>
>> p.setProperty("ssl.keystore.location","/usr/path_to/kafka_ssl_client.keystore.jks"))
>>     p.setProperty("ssl.keystore.password",  "some password")
>>     p.setProperty("ssl.truststore.location",
>> "/usr/path_to/kafka_ssl_client.keystore.jks")
>>     p.setProperty("ssl.truststore.password", "some password")
>>     p
>>   }
>>
>> please advise
>>
>> Thanks
>> Avi
>>
>

Re: getting Timeout expired while fetching topic metadata

Posted by miki haiat <mi...@gmail.com>.

Hi Avi,
Can you try to add this properties

 props.put(CommonClientConfigs.SECURITY_PROTOCOL_CONFIG, "SSL");

Thanks,
Miki

On Mon, Dec 24, 2018 at 8:19 PM Avi Levi <av...@bluevoyant.com> wrote:

> Hi all,
> very new to flink so my apology if it seems trivial.
> We deployed flink on gcloud
> I am trying to connect to kafka but keep getting this error:
> *org.apache.kafka.common.errors.TimeoutException: Timeout expired while
> fetching topic metadata*
> this how my properties look like
> val consumerProperties: Properties = {
>     val p = new Properties()
>     p.setProperty("bootstrap.servers", kafkaBootStrapServers)
>     p.setProperty("group.id", groupId)
>     p.setProperty("client.id", s"queue-consumer-${randomUUID().toString}")
>
> p.setProperty("ssl.keystore.location","/usr/path_to/kafka_ssl_client.keystore.jks"))
>     p.setProperty("ssl.keystore.password",  "some password")
>     p.setProperty("ssl.truststore.location",
> "/usr/path_to/kafka_ssl_client.keystore.jks")
>     p.setProperty("ssl.truststore.password", "some password")
>     p
>   }
>
> please advise
>
> Thanks
> Avi
>