You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by "Emanuele Cesena (JIRA)" <ji...@apache.org> on 2016/10/27 00:06:58 UTC

[jira] [Created] (KAFKA-4350) Can't mirror from Kafka 0.9 to Kafka 0.10.1

Emanuele Cesena created KAFKA-4350:
--------------------------------------

             Summary: Can't mirror from Kafka 0.9 to Kafka 0.10.1
                 Key: KAFKA-4350
                 URL: https://issues.apache.org/jira/browse/KAFKA-4350
             Project: Kafka
          Issue Type: Bug
            Reporter: Emanuele Cesena


I'm running 2 clusters: K9 with Kafka 0.9 and K10 with Kafka 0.10.1.

In K10, I've set up mirror maker to clone a topic from K9 to K10.
Mirror maker immediately fails while starting, any suggestion? Following error message and configs.

Error message:
{{
[2016-10-26 23:54:01,663] FATAL [mirrormaker-thread-0] Mirror maker thread failure due to  (kafka.tools.MirrorMaker$MirrorMakerThread)
org.apache.kafka.common.protocol.types.SchemaException: Error reading field 'cluster_id': Error reading string of length 418, only 43 bytes available
        at org.apache.kafka.common.protocol.types.Schema.read(Schema.java:73)
        at org.apache.kafka.clients.NetworkClient.parseResponse(NetworkClient.java:380)
        at org.apache.kafka.clients.NetworkClient.handleCompletedReceives(NetworkClient.java:449)
        at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:269)
        at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:232)
        at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:180)
        at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureCoordinatorReady(AbstractCoordinator.java:193)
        at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.poll(ConsumerCoordinator.java:248)
        at org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:1013)
        at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:979)
        at kafka.tools.MirrorMaker$MirrorMakerNewConsumer.receive(MirrorMaker.scala:582)
        at kafka.tools.MirrorMaker$MirrorMakerThread.run(MirrorMaker.scala:431)
[2016-10-26 23:54:01,679] FATAL [mirrormaker-thread-0] Mirror maker thread exited abnormally, stopping the whole mirror maker. (kafka.tools.MirrorMaker$MirrorMakerThread)
}}

Consumer:
{{
group.id=mirrormaker001
client.id=mirrormaker001
bootstrap.servers=...K9...
security.protocol=PLAINTEXT
auto.offset.reset=earliest
}}
(note that I first run without client.id, then tried adding a client.id because -- same error in both cases)

Producer:
{{
bootstrap.servers=...K10...
security.protocol=PLAINTEXT
}}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)