You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@dolphinscheduler.apache.org by GitBox <gi...@apache.org> on 2021/01/08 13:18:59 UTC
[GitHub] [incubator-dolphinscheduler] berlinsaint opened a new issue #4408: [Bug][Module Name] Connect to zookeeper slow than before when upgrade to 1.3.4release
berlinsaint opened a new issue #4408:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/4408
After upgraded to the 1.3.4-release , when connecting to zk, it will cost more time than before,
```
2021-01-08 21:13:56.851 INFO 58512 --- [ main] org.apache.zookeeper.ZooKeeper : Client environment:java.io.tmpdir=/var/folders/gv/h9n62tf977x6c1v5hhdm8ksw0000gn/T/
2021-01-08 21:13:56.851 INFO 58512 --- [ main] org.apache.zookeeper.ZooKeeper : Client environment:java.compiler=<NA>
2021-01-08 21:13:56.851 INFO 58512 --- [ main] org.apache.zookeeper.ZooKeeper : Client environment:os.name=Mac OS X
2021-01-08 21:13:56.851 INFO 58512 --- [ main] org.apache.zookeeper.ZooKeeper : Client environment:os.arch=x86_64
2021-01-08 21:13:56.851 INFO 58512 --- [ main] org.apache.zookeeper.ZooKeeper : Client environment:os.version=10.16
2021-01-08 21:13:56.851 INFO 58512 --- [ main] org.apache.zookeeper.ZooKeeper : Client environment:user.name=yangyanbo
2021-01-08 21:13:56.851 INFO 58512 --- [ main] org.apache.zookeeper.ZooKeeper : Client environment:user.home=/Users/yangyanbo
2021-01-08 21:13:56.851 INFO 58512 --- [ main] org.apache.zookeeper.ZooKeeper : Client environment:user.dir=/Users/yangyanbo/projects/cetc-cloud/code/cmp-scheduler
2021-01-08 21:13:56.852 INFO 58512 --- [ main] org.apache.zookeeper.ZooKeeper : Initiating client connection, connectString=10.3.4.11:2181 sessionTimeout=60000 watcher=org.apache.curator.ConnectionState@3d620a1
2021-01-08 21:13:56.868 INFO 58512 --- [ main] o.a.c.f.imps.CuratorFrameworkImpl : Default schema
2021-01-08 21:14:56.877 INFO 58512 --- [10.3.4.11:2181)] org.apache.zookeeper.ClientCnxn : Opening socket connection to server 10.3.4.11/10.3.4.11:2181. Will not attempt to authenticate using SASL (unknown error)
2021-01-08 21:14:56.942 INFO 58512 --- [10.3.4.11:2181)] org.apache.zookeeper.ClientCnxn : Socket connection established to 10.3.4.11/10.3.4.11:2181, initiating session
2021-01-08 21:14:56.988 INFO 58512 --- [10.3.4.11:2181)] org.apache.zookeeper.ClientCnxn : Session establishment complete on server 10.3.4.11/10.3.4.11:2181, sessionid = 0x1086abb38fb0001, negotiated timeout = 40000
2021-01-08 21:14:56.996 INFO 58512 --- [ain-EventThread] o.a.c.f.state.ConnectionStateManager : State change: CONNECTED
2021-01-08 21:14:57.002 INFO 58512 --- [ main] o.a.d.s.zk.ZookeeperCachedOperator : add listener to zk path: /dolphinscheduler
2021-01-08 21:14:57.306 INFO 58512 --- [ main] o.a.d.service.zk.ZookeeperOperator : zookeeper registry center init, server lists is: 10.3.4.11:2181.
2021-01-08 21:14:57.306 INFO 58512 --- [ main] o.a.c.f.imps.CuratorFrameworkImpl : Starting
2021-01-08 21:14:57.307 INFO 58512 --- [ main] org.apache.zookeeper.ZooKeeper : Initiating client connection, connectString=10.3.4.11:2181 sessionTimeout=60000 watcher=org.apache.curator.ConnectionState@3d615b2e
2021-01-08 21:14:57.307 INFO 58512 --- [ main] o.a.c.f.imps.CuratorFrameworkImpl : Default schema
2021-01-08 21:15:57.316 INFO 58512 --- [10.3.4.11:2181)] org.apache.zookeeper.ClientCnxn : Opening socket connection to server 10.3.4.11/10.3.4.11:2181. Will not attempt to authenticate using SASL (unknown error)
2021-01-08 21:15:57.352 INFO 58512 --- [10.3.4.11:2181)] org.apache.zookeeper.ClientCnxn : Socket connection established to 10.3.4.11/10.3.4.11:2181, initiating session
2021-01-08 21:15:57.390 INFO 58512 --- [10.3.4.11:2181)] org.apache.zookeeper.ClientCnxn : Session establishment complete on server 10.3.4.11/10.3.4.11:2181, sessionid = 0x1086abb38fb0003, negotiated timeout = 40000
2021-01-08 21:15:57.390 INFO 58512 --- [ain-EventThread] o.a.c.f.state.ConnectionStateManager : State change: CONNECTED
2021-01-08 21:15:57.390 INFO 58512 --- [ main] o.a.d.s.zk.ZookeeperCachedOperator : add listener to zk path: /dolphinscheduler
2021-01-08 21:15:57.407 INFO 58512 --- [ main] o.a.d.service.zk.ZookeeperOperator : zookeeper registry center init, server lists is: 10.3.4.11:2181.
2021-01-08 21:15:57.408 INFO 58512 --- [ main] o.a.c.f.imps.CuratorFrameworkImpl : Starting
2021-01-08 21:15:57.408 INFO 58512 --- [ main] org.apache.zookeeper.ZooKeeper : Initiating client connection, connectString=10.3.4.11:2181 sessionTimeout=60000 watcher=org.apache.curator.ConnectionState@2ed9f6f8
2021-01-08 21:15:57.409 INFO 58512 --- [ main] o.a.c.f.imps.CuratorFrameworkImpl : Default schema
2021-01-08 21:16:57.417 INFO 58512 --- [10.3.4.11:2181)] org.apache.zookeeper.ClientCnxn : Opening socket connection to server 10.3.4.11/10.3.4.11:2181. Will not attempt to authenticate using SASL (unknown error)
2021-01-08 21:16:57.452 INFO 58512 --- [10.3.4.11:2181)] org.apache.zookeeper.ClientCnxn : Socket connection established to 10.3.4.11/10.3.4.11:2181, initiating session
2021-01-08 21:16:57.490 INFO 58512 --- [10.3.4.11:2181)] org.apache.zookeeper.ClientCnxn : Session establishment complete on server 10.3.4.11/10.3.4.11:2181, sessionid = 0x1086abb38fb0005, negotiated timeout = 40000
2021-01-08 21:16:57.490 INFO 58512 --- [ain-EventThread] o.a.c.f.state.ConnectionStateManager : State change: CONNECTED
2021-01-08 21:16:58.127 INFO 58512 --- [ main] d.s.w.p.DocumentationPluginsBootstrapper : Context refreshed
2021-01-08 21:16:58.140 INFO 58512 --- [ main] d.s.w.p.DocumentationPluginsBootstrapper : Found 1 custom documentation plugin(s)
2021-01-08 21:16:58.188 INFO 58512 --- [ main] s.d.s.w.s.ApiListingReferenceScanner : Scanning for api listing references
2021-01-08 21:16:58.503 INFO 58512 --- [ main] .d.s.w.r.o.CachingOperationNameGenerator : Generating unique operation named: viewTreeUsingGET_1
2021-01-08 21:16:58.669 INFO 58512 --- [ main] o.e.j.s.h.ContextHandler.application : Initializing Spring DispatcherServlet 'dispatcherServlet'
2021-01-08 21:16:58.689 INFO 58512 --- [ main] org.mortbay.log : Logging to Logger[org.mortbay.log] via org.mortbay.log.Slf4jLog
2021-01-08 21:16:58.750 INFO 58512 --- [ main] o.e.jetty.server.AbstractConnector : Started ServerConnector@4aa3fc9a{HTTP/1.1,[http/1.1]}{0.0.0.0:12345}
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] berlinsaint edited a comment on issue #4408: [Bug][API SERVER CLIENT] Connect to zookeeper slow than before when upgrade to 1.3.4release
Posted by GitBox <gi...@apache.org>.
berlinsaint edited a comment on issue #4408:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/4408#issuecomment-757079383
> is this API Server runtime log?
yes, and as you see , you can find it will cost 2 or 3 minitues to start (21:13:56 to 21:16:58);
api, master , client , all need to connect zk, and their have the same slowly behavior when upgrade to 1.3.4release;
Another way , i aslo change zk version , but not use;(3.4.10 -3.4.14)
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] dailidong commented on issue #4408: [Bug][API SERVER CLIENT] Connect to zookeeper slow than before when upgrade to 1.3.4release
Posted by GitBox <gi...@apache.org>.
dailidong commented on issue #4408:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/4408#issuecomment-756792470
is this API Server runtime log?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] berlinsaint commented on issue #4408: [Bug][API SERVER CLIENT] Connect to zookeeper slow than before when upgrade to 1.3.4release
Posted by GitBox <gi...@apache.org>.
berlinsaint commented on issue #4408:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/4408#issuecomment-757079383
> is this API Server runtime log?
yes, and as you see , you can find it will coost 2 or 3 minitues to start (21:13:56 to 21:16:58);
api, master , client , all need to connect zk, and their have the same slowly behavior when upgrade to 1.3.4release;
Another way , i aslo change zk version , but not use;(3.4.10 -3.4.14)
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] CalvinKirs commented on issue #4408: [Bug][API SERVER CLIENT] Connect to zookeeper slow than before when upgrade to 1.3.4release
Posted by GitBox <gi...@apache.org>.
CalvinKirs commented on issue #4408:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/4408#issuecomment-757578205
> > is this API Server runtime log?
>
> yes, and as you see , you can find it will cost 2 or 3 minitues to start (21:13:56 to 21:16:58);
> api, master , client , all need to connect zk, and their have the same slowly behavior when upgrade to 1.3.4release;
>
> Another way , i aslo change zk version , but not use;(3.4.10 -3.4.14)
What I want to know is, are you still so slow to connect to zk through other means? (May need to determine whether it is the cause of the network)
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] berlinsaint edited a comment on issue #4408: [Bug][API SERVER CLIENT] Connect to zookeeper slow than before when upgrade to 1.3.4release
Posted by GitBox <gi...@apache.org>.
berlinsaint edited a comment on issue #4408:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/4408#issuecomment-757079383
> is this API Server runtime log?
yes, and as you see , you can find it will cost 2 or 3 minitues to start (21:13:56 to 21:16:58);
api, master , client , all need to connect zk, and their have the same slowly behavior when upgrade to 1.3.4release;
Another way , i aslo change zk version , but not use;(3.4.10 -3.4.14)
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] berlinsaint commented on issue #4408: [Bug][API SERVER CLIENT] Connect to zookeeper slow than before when upgrade to 1.3.4release
Posted by GitBox <gi...@apache.org>.
berlinsaint commented on issue #4408:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/4408#issuecomment-757079383
> is this API Server runtime log?
yes, and as you see , you can find it will coost 2 or 3 minitues to start (21:13:56 to 21:16:58);
api, master , client , all need to connect zk, and their have the same slowly behavior when upgrade to 1.3.4release;
Another way , i aslo change zk version , but not use;(3.4.10 -3.4.14)
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-dolphinscheduler] dailidong commented on issue #4408: [Bug][API SERVER CLIENT] Connect to zookeeper slow than before when upgrade to 1.3.4release
Posted by GitBox <gi...@apache.org>.
dailidong commented on issue #4408:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/4408#issuecomment-756792470
is this API Server runtime log?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org