You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@openwhisk.apache.org by GitBox <gi...@apache.org> on 2021/06/25 10:25:24 UTC
[GitHub] [openwhisk] catchabhisek opened a new issue #5136: Kafka unable to connect to zookeeper
catchabhisek opened a new issue #5136:
URL: https://github.com/apache/openwhisk/issues/5136
While running the open whisk deployment, I am facing the below issue:
`TASK [kafka : wait until the kafka server started up] ***************************************************************************************
Friday 25 June 2021 15:45:28 +0530 (0:00:03.970) 0:00:11.063 ***********
FAILED - RETRYING: wait until the kafka server started up (10 retries left).
FAILED - RETRYING: wait until the kafka server started up (9 retries left).
FAILED - RETRYING: wait until the kafka server started up (8 retries left).
FAILED - RETRYING: wait until the kafka server started up (7 retries left).
FAILED - RETRYING: wait until the kafka server started up (6 retries left).
FAILED - RETRYING: wait until the kafka server started up (5 retries left).
FAILED - RETRYING: wait until the kafka server started up (4 retries left).
FAILED - RETRYING: wait until the kafka server started up (3 retries left).
FAILED - RETRYING: wait until the kafka server started up (2 retries left).
FAILED - RETRYING: wait until the kafka server started up (1 retries left).
fatal: [kafka0]: FAILED! => {"attempts": 10, "changed": true, "cmd": "(echo dump; sleep 1) | nc 172.17.0.1 2181 | grep /brokers/ids/0", "delta": "0:00:01.002449", "end": "2021-06-25 15:46:30.803958", "msg": "non-zero return code", "rc": 1, "start": "2021-06-25 15:46:29.801509", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []}`
Hardware Specifications:
- OS: Ubuntu 20.04
- Processor: Intel
- docker version: 20.10
- Using an HTTP proxy
Troubleshooting Done so far:
I have analyze the kafka logs, I see that the connection to the zookeeper is getting timedout.
`2021-06-25T10:22:07.282518662Z [2021-06-25 10:22:07,282] INFO Initiating client connection, connectString=172.17.0.1:2181 sessionTimeout=18000 watcher=kafka.zookeeper.ZooKeeperClient$ZooKeeperClientWatcher$@4f18837a (org.apache.zookeeper.ZooKeeper)
2021-06-25T10:22:07.285406422Z [2021-06-25 10:22:07,285] INFO jute.maxbuffer value is 4194304 Bytes (org.apache.zookeeper.ClientCnxnSocket)
2021-06-25T10:22:07.289195469Z [2021-06-25 10:22:07,289] INFO zookeeper.request.timeout value is 0. feature enabled= (org.apache.zookeeper.ClientCnxn)
2021-06-25T10:22:07.290256337Z [2021-06-25 10:22:07,290] INFO [ZooKeeperClient Kafka server] Waiting until connected. (kafka.zookeeper.ZooKeeperClient)
2021-06-25T10:22:07.293818144Z [2021-06-25 10:22:07,293] INFO Opening socket connection to server 172.17.0.1/172.17.0.1:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn)
2021-06-25T10:22:25.292608836Z [2021-06-25 10:22:25,292] INFO [ZooKeeperClient Kafka server] Closing. (kafka.zookeeper.ZooKeeperClient)
2021-06-25T10:22:25.296956526Z [2021-06-25 10:22:25,296] WARN Client session timed out, have not heard from server in 18007ms for sessionid 0x0 (org.apache.zookeeper.ClientCnxn)
2021-06-25T10:22:25.404547171Z [2021-06-25 10:22:25,404] INFO Session: 0x0 closed (org.apache.zookeeper.ZooKeeper)
2021-06-25T10:22:25.405012527Z [2021-06-25 10:22:25,404] INFO EventThread shut down for session: 0x0 (org.apache.zookeeper.ClientCnxn)
2021-06-25T10:22:25.405893393Z [2021-06-25 10:22:25,405] INFO [ZooKeeperClient Kafka server] Closed. (kafka.zookeeper.ZooKeeperClient)
2021-06-25T10:22:25.408912083Z [2021-06-25 10:22:25,407] ERROR Fatal error during KafkaServer startup. Prepare to shutdown (kafka.server.KafkaServer)
2021-06-25T10:22:25.408920264Z kafka.zookeeper.ZooKeeperClientTimeoutException: Timed out waiting for connection while in state: CONNECTING
2021-06-25T10:22:25.408942232Z at kafka.zookeeper.ZooKeeperClient.waitUntilConnected(ZooKeeperClient.scala:262)
2021-06-25T10:22:25.408944485Z at kafka.zookeeper.ZooKeeperClient.<init>(ZooKeeperClient.scala:119)
2021-06-25T10:22:25.408946520Z at kafka.zk.KafkaZkClient$.apply(KafkaZkClient.scala:1881)
2021-06-25T10:22:25.408948404Z at kafka.server.KafkaServer.createZkClient$1(KafkaServer.scala:441)
2021-06-25T10:22:25.408950178Z at kafka.server.KafkaServer.initZkClient(KafkaServer.scala:466)
2021-06-25T10:22:25.408966804Z at kafka.server.KafkaServer.startup(KafkaServer.scala:233)
2021-06-25T10:22:25.408968567Z at kafka.server.KafkaServerStartable.startup(KafkaServerStartable.scala:44)
2021-06-25T10:22:25.408970305Z at kafka.Kafka$.main(Kafka.scala:82)
2021-06-25T10:22:25.408972003Z at kafka.Kafka.main(Kafka.scala)
2021-06-25T10:22:25.409416140Z [2021-06-25 10:22:25,409] INFO shutting down (kafka.server.KafkaServer)
2021-06-25T10:22:25.412583174Z [2021-06-25 10:22:25,412] INFO App info kafka.server for 0 unregistered (org.apache.kafka.common.utils.AppInfoParser)
2021-06-25T10:22:25.412919634Z [2021-06-25 10:22:25,412] INFO shut down completed (kafka.server.KafkaServer)
2021-06-25T10:22:25.413358389Z [2021-06-25 10:22:25,413] ERROR Exiting Kafka. (kafka.server.KafkaServerStartable)
2021-06-25T10:22:25.414048992Z [2021-06-25 10:22:25,413] INFO shutting down (kafka.server.KafkaServer)`
When i tried to connect to zookeeper from the host machine, i was able to do so.
`'abhishek@dell-Vostro-3888-sgx:~/faas/openwhisk/ansible$ telnet 172.17.0.1 2181
Trying 172.17.0.1...
Connected to 172.17.0.1.
Escape character is '^]'.
^CConnection closed by foreign host.`
Can anyone help me with the issue?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [openwhisk] catchabhisek commented on issue #5136: Controller 0 not able to come up
Posted by GitBox <gi...@apache.org>.
catchabhisek commented on issue #5136:
URL: https://github.com/apache/openwhisk/issues/5136#issuecomment-869273351
The issue was with the firewall, fixed it
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@openwhisk.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [openwhisk] catchabhisek closed issue #5136: Controller 0 not able to come up
Posted by GitBox <gi...@apache.org>.
catchabhisek closed issue #5136:
URL: https://github.com/apache/openwhisk/issues/5136
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@openwhisk.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org