You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Bharadwaj Bhimavarapu (Jira)" <ji...@apache.org> on 2021/03/08 22:08:00 UTC

[jira] [Updated] (KAFKA-12438) MirrorMaker 2: Not able to make it work for kerberized clusters ( bothe source and target are kerberized )

     [ https://issues.apache.org/jira/browse/KAFKA-12438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Bharadwaj Bhimavarapu updated KAFKA-12438:
------------------------------------------
    Issue Type: Wish  (was: Bug)

> MirrorMaker 2: Not able to make it work for kerberized clusters ( bothe source and target are kerberized ) 
> -----------------------------------------------------------------------------------------------------------
>
>                 Key: KAFKA-12438
>                 URL: https://issues.apache.org/jira/browse/KAFKA-12438
>             Project: Kafka
>          Issue Type: Wish
>          Components: mirrormaker
>            Reporter: Bharadwaj Bhimavarapu
>            Priority: Minor
>
> I was trying to replicate data between  kerberized clusters and i se belwo errors . I was not able to find any documentation around it . 
>  
> Error :-
>  
> [2021-03-08 15:42:19,595] ERROR Stopping due to error (org.apache.kafka.connect.mirror.MirrorMaker:304)
> org.apache.kafka.connect.errors.ConnectException: Failed to connect to and describe Kafka cluster. Check worker's broker connection and security properties.
>  at org.apache.kafka.connect.util.ConnectUtils.lookupKafkaClusterId(ConnectUtils.java:70)
>  at org.apache.kafka.connect.util.ConnectUtils.lookupKafkaClusterId(ConnectUtils.java:51)
>  at org.apache.kafka.connect.mirror.MirrorMaker.addHerder(MirrorMaker.java:235)
>  at org.apache.kafka.connect.mirror.MirrorMaker.lambda$new$1(MirrorMaker.java:136)
>  at java.lang.Iterable.forEach(Iterable.java:75)
>  at org.apache.kafka.connect.mirror.MirrorMaker.<init>(MirrorMaker.java:136)
>  at org.apache.kafka.connect.mirror.MirrorMaker.<init>(MirrorMaker.java:148)
>  at org.apache.kafka.connect.mirror.MirrorMaker.main(MirrorMaker.java:291)
> Caused by: java.util.concurrent.ExecutionException: org.apache.kafka.common.errors.TimeoutException: Call(callName=listNodes, deadlineMs=1615236139583, tries=1, nextAllowedTryMs=1615236139684) timed out at 1615236139584 after 1 attempt(s)
>  at org.apache.kafka.common.internals.KafkaFutureImpl.wrapAndThrow(KafkaFutureImpl.java:45)
>  at org.apache.kafka.common.internals.KafkaFutureImpl.access$000(KafkaFutureImpl.java:32)
>  at org.apache.kafka.common.internals.KafkaFutureImpl$SingleWaiter.await(KafkaFutureImpl.java:89)
>  at org.apache.kafka.common.internals.KafkaFutureImpl.get(KafkaFutureImpl.java:260)
>  at org.apache.kafka.connect.util.ConnectUtils.lookupKafkaClusterId(ConnectUtils.java:64)
>  ... 7 more
> Caused by: org.apache.kafka.common.errors.TimeoutException: Call(callName=listNodes, deadlineMs=1615236139583, tries=1, nextAllowedTryMs=1615236139684) timed out at 1615236139584 after 1 attempt(s)
> Caused by: org.apache.kafka.common.errors.TimeoutException: Timed out waiting for a node assignment. Call: listNodes
>  
>  
> Properties :-
> # Kafka datacenters.
> clusters = source, target
> source.bootstrap.servers = xxx:9092,xxx:9092
> target.bootstrap.servers = yyy:9092,yyy:9092
> # Source and target cluster configurations.
> source.config.storage.replication.factor = 1
> target.config.storage.replication.factor = 1
> source.offset.storage.replication.factor = 1
> target.offset.storage.replication.factor = 1
> source.status.storage.replication.factor = 1
> target.status.storage.replication.factor = 1
> source->target.enabled = true
> target->source.enabled = false
> # Mirror maker configurations.
> offset-syncs.topic.replication.factor = 1
> heartbeats.topic.replication.factor = 1
> checkpoints.topic.replication.factor = 1
> topics = .*
> groups = .*
> tasks.max = 1
> replication.factor = 1
> refresh.topics.enabled = false
> sync.topic.configs.enabled = true
> refresh.topics.interval.seconds = 30
> topics.blacklist = .*[\-\.]internal, .*\.replica, __consumer_offsets
> groups.blacklist = console-consumer-.*, connect-.*, __.*
> # Enable heartbeats and checkpoints.
> source->target.emit.heartbeats.enabled = true
> source->target.emit.checkpoints.enabled = true
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)