You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by "Guozhang Wang (JIRA)" <ji...@apache.org> on 2015/02/05 01:39:37 UTC
[jira] [Commented] (KAFKA-1760) Implement new consumer client
[ https://issues.apache.org/jira/browse/KAFKA-1760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306324#comment-14306324 ]
Guozhang Wang commented on KAFKA-1760:
--------------------------------------
OK, the first one observed so far is that the consumer metadata responses does not actually help update the metadata due to some protocol bug:
In the below example, although the returned node id is 1, it is read as -2147483648 as always (and Node.toString did not print the id since it is < 0), and later responses with node id 2 will not change consumer's coordinator destination.
{code}
[2015-02-04 12:43:46,251] TRACE [KafkaApi-1] Sending consumer metadata ConsumerMetadataResponse(Some(id:1,host:localhost,port:46148),0,27) for correlation id 27 to client consumer-1. (kafka.server.KafkaApis:36)
[2015-02-04 12:43:46,252] TRACE Processor id 1 selection time = 4558827 ns (kafka.network.Processor:36)
[2015-02-04 12:43:46,252] TRACE Socket server received response to send, registering for write: Response(1,Request(1,sun.nio.ch.SelectionKeyImpl@4bd15081,null,1423082626245,/127.0.0.1:51454),kafka.network.BoundedByteBufferSend@40aaecb5,SendAction) (kafka.network.Processor:36)
[2015-02-04 12:43:46,252] TRACE Processor id 1 selection time = 18275 ns (kafka.network.Processor:36)
[2015-02-04 12:43:46,252] TRACE 29 bytes written to /127.0.0.1:51454 using key sun.nio.ch.SelectionKeyImpl@4bd15081 (kafka.network.Processor:36)
[2015-02-04 12:43:46,253] TRACE Completed request:Name: ConsumerMetadataRequest; Version: 0; CorrelationId: 27; ClientId: consumer-1; Group: my-test from client /127.0.0.1:51454;totalTime:7,requestQueueTime:2,localTime:5,remoteTime:0,responseQueueTime:0,sendTime:0 (kafka.request.logger:85)
[2015-02-04 12:43:46,253] TRACE Finished writing, registering for read on connection /127.0.0.1:51454 (kafka.network.Processor:36)
[2015-02-04 12:43:46,253] DEBUG Found consumer co-ordinator: Node(localhost, 46148) (org.apache.kafka.clients.consumer.KafkaConsumer:1259)
[2015-02-04 12:43:46,253] DEBUG Initiating connection to node -2147483648 at localhost:46148. (org.apache.kafka.clients.NetworkClient:484)
{code}
> Implement new consumer client
> -----------------------------
>
> Key: KAFKA-1760
> URL: https://issues.apache.org/jira/browse/KAFKA-1760
> Project: Kafka
> Issue Type: Sub-task
> Components: consumer
> Reporter: Jay Kreps
> Assignee: Jay Kreps
> Fix For: 0.8.3
>
> Attachments: KAFKA-1760.patch, KAFKA-1760_2015-01-11_16:57:15.patch, KAFKA-1760_2015-01-18_19:10:13.patch, KAFKA-1760_2015-01-21_08:42:20.patch, KAFKA-1760_2015-01-22_10:03:26.patch, KAFKA-1760_2015-01-22_20:21:56.patch, KAFKA-1760_2015-01-23_13:13:00.patch, KAFKA-1760_2015-01-29_03:20:20.patch
>
>
> Implement a consumer client.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)