You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Stanislav Kozlovski (JIRA)" <ji...@apache.org> on 2018/09/06 15:15:01 UTC

[jira] [Commented] (KAFKA-7373) GetOffsetShell doesn't work when SSL authentication is enabled

    [ https://issues.apache.org/jira/browse/KAFKA-7373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16605905#comment-16605905 ] 

Stanislav Kozlovski commented on KAFKA-7373:
--------------------------------------------

I get another error with Kafka trunk
{code:java}
Exception in thread "main" java.lang.OutOfMemoryError: Java heap space at java.base/java.nio.HeapByteBuffer.<init>(HeapByteBuffer.java:68) at java.base/java.nio.ByteBuffer.allocate(ByteBuffer.java:341) at org.apache.kafka.common.memory.MemoryPool$1.tryAllocate(MemoryPool.java:30) at org.apache.kafka.common.network.NetworkReceive.readFrom(NetworkReceive.java:112) at org.apache.kafka.common.network.KafkaChannel.receive(KafkaChannel.java:360) at org.apache.kafka.common.network.KafkaChannel.read(KafkaChannel.java:321) at org.apache.kafka.common.network.Selector.attemptRead(Selector.java:609) at org.apache.kafka.common.network.Selector.pollSelectionKeys(Selector.java:541) at org.apache.kafka.common.network.Selector.poll(Selector.java:467) at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:510) at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:265) at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:236) at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:215) at org.apache.kafka.clients.consumer.internals.Fetcher.getTopicMetadata(Fetcher.java:272) at org.apache.kafka.clients.consumer.internals.Fetcher.getAllTopicMetadata(Fetcher.java:255) at org.apache.kafka.clients.consumer.KafkaConsumer.listTopics(KafkaConsumer.java:1799) at org.apache.kafka.clients.consumer.KafkaConsumer.listTopics(KafkaConsumer.java:1777) at kafka.tools.GetOffsetShell$.listPartitionInfos(GetOffsetShell.scala:156) at kafka.tools.GetOffsetShell$.main(GetOffsetShell.scala:110) at kafka.tools.GetOffsetShell.main(GetOffsetShell.scala)
{code}

I'm going to implement the passing of a config file approach

> GetOffsetShell doesn't work when SSL authentication is enabled
> --------------------------------------------------------------
>
>                 Key: KAFKA-7373
>                 URL: https://issues.apache.org/jira/browse/KAFKA-7373
>             Project: Kafka
>          Issue Type: Bug
>    Affects Versions: 2.0.0
>            Reporter: Andy Bryant
>            Assignee: Stanislav Kozlovski
>            Priority: Major
>
> GetOffsetShell doesn't provide a mechanism to provide additional configuration for the underlying KafkaConsumer as does the `ConsoleConsumer`. Passing SSL config as system properties doesn't propagate to the consumer either.
> {code:java}
> 10:47 $ ./kafka-run-class.sh kafka.tools.GetOffsetShell --broker-list ${BROKER_LIST} --topic cld-dev-sor-crods-crodsdba_contact
> Exception in thread "main" org.apache.kafka.common.errors.TimeoutException: Timeout expired while fetching topic metadata{code}
> Editing {{GetOffsetShell.scala}} to include the SSL properties in the KafkaConsumer configuration resolved the issue.
> Providing {{consumer-property}} and {{consumer-config}} configuration options for {{kafka-run-class-sh}} or creating a separate run script for offsets and using these properties in {{GetOffsetShell.scala}} seems like a good solution.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)