You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by "Chris Egerton (Jira)" <ji...@apache.org> on 2022/04/14 00:38:00 UTC
[jira] [Resolved] (KAFKA-13808) Mirrormaker2 stop sync data when modify topic partition in "Running a dedicated MirrorMaker cluster" mode
[ https://issues.apache.org/jira/browse/KAFKA-13808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Chris Egerton resolved KAFKA-13808.
-----------------------------------
Resolution: Duplicate
> Mirrormaker2 stop sync data when modify topic partition in "Running a dedicated MirrorMaker cluster" mode
> ----------------------------------------------------------------------------------------------------------
>
> Key: KAFKA-13808
> URL: https://issues.apache.org/jira/browse/KAFKA-13808
> Project: Kafka
> Issue Type: Bug
> Components: KafkaConnect, mirrormaker
> Affects Versions: 3.1.0, 2.6.3, 2.7.2, 2.8.1, 3.0.0, 3.0.1
> Reporter: YANGLiiN
> Priority: Major
>
> When use the mirrormaker2 with the "Running a dedicated MirrorMaker cluster" mode by 3 nodes, once we modify the topic partition , then the mm2 stop sync data with the following ERROR :
>
> [2022-02-18 10:26:19,410] ERROR Error forwarding REST request (org.apache.kafka.connect.runtime.rest.RestClient)
> java.lang.IllegalArgumentException: Invalid URI host: null (authority: null)
> at org.eclipse.jetty.client.HttpClient.checkHost(HttpClient.java:521)
> at org.eclipse.jetty.client.HttpClient.newHttpRequest(HttpClient.java:506)
> at org.eclipse.jetty.client.HttpClient.newRequest(HttpClient.java:464)
> at org.eclipse.jetty.client.HttpClient.newRequest(HttpClient.java:453)
> at org.apache.kafka.connect.runtime.rest.RestClient.httpRequest(RestClient.java:107)
> at org.apache.kafka.connect.runtime.distributed.DistributedHerder.lambda$reconfigureConnector$32(DistributedHerder.java:1607)
> at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
> at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
> at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
> at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
> at java.base/java.lang.Thread.run(Thread.java:829)
> [2022-02-18 10:26:19,416] ERROR [Worker clientId=connect-1, groupId=sync2022] Request to leader to reconfigure connector tasks failed (org.apache.kafka.connect.runtime.distributed.DistributedHerder)
> org.apache.kafka.connect.runtime.rest.errors.ConnectRestException: Error trying to forward REST request: Invalid URI host: null (authority: null)
> at org.apache.kafka.connect.runtime.rest.RestClient.httpRequest(RestClient.java:147)
> at org.apache.kafka.connect.runtime.distributed.DistributedHerder.lambda$reconfigureConnector$32(DistributedHerder.java:1607)
> at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
> at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
> at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
> at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
> at java.base/java.lang.Thread.run(Thread.java:829)
> Caused by: java.lang.IllegalArgumentException: Invalid URI host: null (authority: null)
> at org.eclipse.jetty.client.HttpClient.checkHost(HttpClient.java:521)
> at org.eclipse.jetty.client.HttpClient.newHttpRequest(HttpClient.java:506)
> at org.eclipse.jetty.client.HttpClient.newRequest(HttpClient.java:464)
> at org.eclipse.jetty.client.HttpClient.newRequest(HttpClient.java:453)
> at org.apache.kafka.connect.runtime.rest.RestClient.httpRequest(RestClient.java:107)
> ... 6 more
>
> the root cause is the connect doesn't process the mm2 add the 'NOTUSED' url on the slave node
> see [https://github.com/apache/kafka/blob/trunk/connect/mirror/src/main/java/org/apache/kafka/connect/mirror/MirrorMaker.java#L122]
>
> we should add the "NOTUSED" logic below the code
> [https://github.com/apache/kafka/blob/trunk/connect/runtime/src/main/java/org/apache/kafka/connect/runtime/distributed/DistributedHerder.java#L1593-L1599]
>
> {code:java}
> if (leaderUrl.startsWith("NOTUSED")) {
> configBackingStore.putTaskConfigs(connName, rawTaskProps);
> cb.onCompletion(null, null);
> return;
> }
> {code}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)