You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by "Fred (刘福才)" <li...@inspur.com> on 2017/01/09 09:19:07 UTC

a question about kafka connect

Hi,I have a question。When using connect-distributed, I start some
connectors those push the data to ES from kafka. But there are many errors
in the log,why are these errors and how to solve the problem?

       Thinks!

 

 

[2017-01-09 16:24:30,645] INFO Sink task WorkerSinkTask{id=es4kafa1112-0}
finished initialization and start
(org.apache.kafka.connect.runtime.WorkerSinkTask:208)

[2017-01-09 16:24:30,668] ERROR Task es4kafa1113-0 threw an uncaught and
unrecoverable exception (org.apache.kafka.connect.runtime.WorkerTask:142)

org.apache.kafka.common.errors.WakeupException

      at
org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.maybeTrigg
erWakeup(ConsumerNetworkClient.java:367)

      at
org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.clientPoll
(ConsumerNetworkClient.java:361)

      at
org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(Consu
merNetworkClient.java:224)

      at
org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(Consu
merNetworkClient.java:192)

      at
org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(Consu
merNetworkClient.java:163)

      at
org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.commitOffset
sSync(ConsumerCoordinator.java:426)

      at
org.apache.kafka.clients.consumer.KafkaConsumer.commitSync(KafkaConsumer.jav
a:1059)

      at
org.apache.kafka.connect.runtime.WorkerSinkTask.doCommitSync(WorkerSinkTask.
java:244)

      at
org.apache.kafka.connect.runtime.WorkerSinkTask.doCommit(WorkerSinkTask.java
:263)

      at
org.apache.kafka.connect.runtime.WorkerSinkTask.commitOffsets(WorkerSinkTask
.java:304)

      at
org.apache.kafka.connect.runtime.WorkerSinkTask.closePartitions(WorkerSinkTa
sk.java:432)

      at
org.apache.kafka.connect.runtime.WorkerSinkTask.execute(WorkerSinkTask.java:
146)

      at
org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:140)

      at
org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:175)

      at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)

      at java.util.concurrent.FutureTask.run(FutureTask.java:266)

      at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:11
42)

      at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:6
17)

      at java.lang.Thread.run(Thread.java:745)

[2017-01-09 16:24:30,672] ERROR Task is being killed and will not recover
until manually restarted (org.apache.kafka.connect.runtime.WorkerTask:143)

[2017-01-09 16:24:30,747] INFO Discovered coordinator
idap-agent-179.idap.com:6667 (id: 2147482645 rack: null) for group
connect-es4kafa1112.
(org.apache.kafka.clients.consumer.internals.AbstractCoordinator:505)

[2017-01-09 16:24:30,748] INFO Revoking previously assigned partitions []
for group connect-es4kafa1112
(org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:292)

[2017-01-09 16:24:30,748] INFO (Re-)joining group connect-es4kafa1112
(org.apache.kafka.clients.consumer.internals.AbstractCoordinator:326)

[2017-01-09 16:24:30,840] INFO Successfully joined group connect-es4kafa1112
with generation 1
(org.apache.kafka.clients.consumer.internals.AbstractCoordinator:434)