You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pulsar.apache.org by GitBox <gi...@apache.org> on 2020/11/22 05:48:02 UTC
[GitHub] [pulsar] jiangmincong opened a new issue #8666: java client Metadata is not available for client consumption
jiangmincong opened a new issue #8666:
URL: https://github.com/apache/pulsar/issues/8666
**Describe the bug**
A clear and concise description of what the bug is.
WARN | [pulsar-client-io-1-1] | [persistent://tenant/namespace/topic] failed to get Partitioned metadata : writeAddress(..) failed: Broken pipe | org.apache.pulsar.client.impl.BinaryProtoLookupService (BinaryProtoLookupService.java:197)
java.util.concurrent.CompletionException: org.apache.pulsar.shade.io.netty.channel.unix.Errors$NativeIoException: writeAddress(..) failed: Broken pipe
at java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:292)
at java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:308)
at java.util.concurrent.CompletableFuture.uniAccept(CompletableFuture.java:647)
at java.util.concurrent.CompletableFuture$UniAccept.tryFire(CompletableFuture.java:632)
at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:474)
at java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:1977)
at org.apache.pulsar.client.impl.ClientCnx.lambda$newLookup$15(ClientCnx.java:655)
at org.apache.pulsar.shade.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:577)
at org.apache.pulsar.shade.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:551)
at org.apache.pulsar.shade.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:490)
at org.apache.pulsar.shade.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:615)
at org.apache.pulsar.shade.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:608)
at org.apache.pulsar.shade.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:117)
at org.apache.pulsar.shade.io.netty.util.internal.PromiseNotificationUtil.tryFailure(PromiseNotificationUtil.java:64)
at org.apache.pulsar.shade.io.netty.channel.ChannelOutboundBuffer.safeFail(ChannelOutboundBuffer.java:723)
at org.apache.pulsar.shade.io.netty.channel.ChannelOutboundBuffer.remove0(ChannelOutboundBuffer.java:308)
at org.apache.pulsar.shade.io.netty.channel.ChannelOutboundBuffer.failFlushed(ChannelOutboundBuffer.java:660)
at org.apache.pulsar.shade.io.netty.channel.AbstractChannel$AbstractUnsafe.close(AbstractChannel.java:740)
at org.apache.pulsar.shade.io.netty.channel.AbstractChannel$AbstractUnsafe.flush0(AbstractChannel.java:942)
at org.apache.pulsar.shade.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.flush0(AbstractEpollChannel.java:519)
at org.apache.pulsar.shade.io.netty.channel.AbstractChannel$AbstractUnsafe.flush(AbstractChannel.java:897)
at org.apache.pulsar.shade.io.netty.channel.DefaultChannelPipeline$HeadContext.flush(DefaultChannelPipeline.java:1372)
at org.apache.pulsar.shade.io.netty.channel.AbstractChannelHandlerContext.invokeFlush0(AbstractChannelHandlerContext.java:750)
at org.apache.pulsar.shade.io.netty.channel.AbstractChannelHandlerContext.invokeFlush(AbstractChannelHandlerContext.java:742)
at org.apache.pulsar.shade.io.netty.channel.AbstractChannelHandlerContext.flush(AbstractChannelHandlerContext.java:728)
at org.apache.pulsar.shade.io.netty.channel.ChannelOutboundHandlerAdapter.flush(ChannelOutboundHandlerAdapter.java:125)
at org.apache.pulsar.shade.io.netty.channel.AbstractChannelHandlerContext.invokeFlush0(AbstractChannelHandlerContext.java:750)
at org.apache.pulsar.shade.io.netty.channel.AbstractChannelHandlerContext.invokeWriteAndFlush(AbstractChannelHandlerContext.java:765)
at org.apache.pulsar.shade.io.netty.channel.AbstractChannelHandlerContext$WriteTask.run(AbstractChannelHandlerContext.java:1104)
at org.apache.pulsar.shade.io.netty.util.concurrent.AbstractEventExecutor.safeExecute(AbstractEventExecutor.java:164)
at org.apache.pulsar.shade.io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:472)
at org.apache.pulsar.shade.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:384)
at org.apache.pulsar.shade.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at org.apache.pulsar.shade.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at org.apache.pulsar.shade.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.pulsar.shade.io.netty.channel.unix.Errors$NativeIoException: writeAddress(..) failed: Broken pipe
**To Reproduce**
Steps to reproduce the behavior:
1. Go to '...'
2. Click on '....'
3. Scroll down to '....'
4. See error
**Expected behavior**
A clear and concise description of what you expected to happen.
**Screenshots**
If applicable, add screenshots to help explain your problem.
**Desktop (please complete the following information):**
- OS: [e.g. iOS]
apache pulsar version 2.6.1
**Additional context**
Add any other context about the problem here.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] jiangmincong closed issue #8666: java client Metadata is not available for client consumption
Posted by GitBox <gi...@apache.org>.
jiangmincong closed issue #8666:
URL: https://github.com/apache/pulsar/issues/8666
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] jiazhai commented on issue #8666: java client Metadata is not available for client consumption
Posted by GitBox <gi...@apache.org>.
jiazhai commented on issue #8666:
URL: https://github.com/apache/pulsar/issues/8666#issuecomment-732633684
@jiangmincong Would you please provide more detailed steps of how to reproduce this issue? It seems that the client and server are not connected well.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] jiangmincong commented on issue #8666: java client Metadata is not available for client consumption
Posted by GitBox <gi...@apache.org>.
jiangmincong commented on issue #8666:
URL: https://github.com/apache/pulsar/issues/8666#issuecomment-809948184
This exception occurs when there are two different versions (2.5.0/2.6.1) of client consumption or production data at the same time. After replacing the topic, this exception does not appear. I will close this issue.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] jiangmincong commented on issue #8666: java client Metadata is not available for client consumption
Posted by GitBox <gi...@apache.org>.
jiangmincong commented on issue #8666:
URL: https://github.com/apache/pulsar/issues/8666#issuecomment-732687622
Hi, My program only appeared after running for about 2 days, and then I restarted the program. Currently, this does not happen. Below is the log information I obtained from the broker server.
broker logļ¼
14:10:05.174 [pulsar-web-42-75] INFO org.eclipse.jetty.server.RequestLog - 192.168.1.171 - - [21/Nov/2020:14:10:05 +0800] "GET /metrics HTTP/1.1" 302 0 "-" "Prometheus/2.18.0" 1
14:10:05.188 [prometheus-stats-43-1] INFO org.eclipse.jetty.server.RequestLog - 192.168.1.171 - - [21/Nov/2020:14:10:05 +0800] "GET /metrics/ HTTP/1.1" 200 96280 "http://bigdata-hostname-001:8080/metrics" "Prometheus/2.18.0" 14
14:10:09.197 [pulsar-ordered-OrderedExecutor-4-0-EventThread] INFO org.apache.pulsar.zookeeper.ZooKeeperDataCache - [State:CONNECTED Timeout:30000 sessionid:0x804029ad72c04ee local:/192.168.1.171:55324 remoteserver:bigdata-hostname-008/192.168.1.178:2181 lastZxid:4297775804 xid:373262 sent:373262 recv:444525 queuedpkts:0 pendingresp:0 queuedevents:0] Received ZooKeeper watch event: WatchedEvent state:SyncConnected type:NodeDataChanged path:/loadbalance/brokers/bigdata-hostname-005:8080
14:10:14.213 [pulsar-ordered-OrderedExecutor-4-0-EventThread] INFO org.apache.pulsar.zookeeper.ZooKeeperDataCache - [State:CONNECTED Timeout:30000 sessionid:0x804029ad72c04ee local:/192.168.1.171:55324 remoteserver:bigdata-hostname-008/192.168.1.178:2181 lastZxid:4297775805 xid:373287 sent:373287 recv:444551 queuedpkts:0 pendingresp:0 queuedevents:0] Received ZooKeeper watch event: WatchedEvent state:SyncConnected type:NodeDataChanged path:/loadbalance/brokers/bigdata-hostname-018:8080
14:10:26.719 [pulsar-ordered-OrderedExecutor-4-0-EventThread] INFO org.apache.pulsar.zookeeper.ZooKeeperDataCache - [State:CONNECTED Timeout:30000 sessionid:0x804029ad72c04ee local:/192.168.1.171:55324 remoteserver:bigdata-hostname-008/192.168.1.178:2181 lastZxid:4297775806 xid:373293 sent:373293 recv:444558 queuedpkts:0 pendingresp:0 queuedevents:0] Received ZooKeeper watch event: WatchedEvent state:SyncConnected type:NodeDataChanged path:/loadbalance/brokers/bigdata-hostname-025:8080
14:10:34.384 [pulsar-ordered-OrderedExecutor-4-0-EventThread] INFO org.apache.pulsar.zookeeper.ZooKeeperDataCache - [State:CONNECTED Timeout:30000 sessionid:0x804029ad72c04ee local:/192.168.1.171:55324 remoteserver:bigdata-hostname-008/192.168.1.178:2181 lastZxid:4297775807 xid:373296 sent:373296 recv:444562 queuedpkts:0 pendingresp:0 queuedevents:0] Received ZooKeeper watch event: WatchedEvent state:SyncConnected type:NodeDataChanged path:/loadbalance/brokers/bigdata-hostname-019:8080
14:10:40.101 [pulsar-ordered-OrderedExecutor-4-0-EventThread] INFO org.apache.pulsar.zookeeper.ZooKeeperDataCache - [State:CONNECTED Timeout:30000 sessionid:0x804029ad72c04ee local:/192.168.1.171:55324 remoteserver:bigdata-hostname-008/192.168.1.178:2181 lastZxid:4297775808 xid:373299 sent:373299 recv:444566 queuedpkts:0 pendingresp:0 queuedevents:0] Received ZooKeeper watch event: WatchedEvent state:SyncConnected type:NodeDataChanged path:/loadbalance/brokers/bigdata-hostname-027:8080
14:10:43.934 [pulsar-ordered-OrderedExecutor-4-0-EventThread] INFO org.apache.pulsar.zookeeper.ZooKeeperDataCache - [State:CONNECTED Timeout:30000 sessionid:0x804029ad72c04ee local:/192.168.1.171:55324 remoteserver:bigdata-hostname-008/192.168.1.178:2181 lastZxid:4297775809 xid:373321 sent:373321 recv:444589 queuedpkts:0 pendingresp:0 queuedevents:0] Received ZooKeeper watch event: WatchedEvent state:SyncConnected type:NodeDataChanged path:/loadbalance/brokers/bigdata-hostname-024:8080
14:10:49.207 [pulsar-ordered-OrderedExecutor-4-0-EventThread] INFO org.apache.pulsar.zookeeper.ZooKeeperDataCache - [State:CONNECTED Timeout:30000 sessionid:0x804029ad72c04ee local:/192.168.1.171:55324 remoteserver:bigdata-hostname-008/192.168.1.178:2181 lastZxid:4297775810 xid:373324 sent:373324 recv:444593 queuedpkts:0 pendingresp:0 queuedevents:0] Received ZooKeeper watch event: WatchedEvent state:SyncConnected type:NodeDataChanged path:/loadbalance/brokers/bigdata-hostname-018:8080
14:10:51.715 [pulsar-ordered-OrderedExecutor-4-0-EventThread] INFO org.apache.pulsar.zookeeper.ZooKeeperDataCache - [State:CONNECTED Timeout:30000 sessionid:0x804029ad72c04ee local:/192.168.1.171:55324 remoteserver:bigdata-hostname-008/192.168.1.178:2181 lastZxid:4297775811 xid:373325 sent:373325 recv:444595 queuedpkts:0 pendingresp:0 queuedevents:0] Received ZooKeeper watch event: WatchedEvent state:SyncConnected type:NodeDataChanged path:/loadbalance/brokers/bigdata-hostname-025:8080
14:10:56.420 [pulsar-ordered-OrderedExecutor-4-0-EventThread] INFO org.apache.pulsar.zookeeper.ZooKeeperDataCache - [State:CONNECTED Timeout:30000 sessionid:0x804029ad72c04ee local:/192.168.1.171:55324 remoteserver:bigdata-hostname-008/192.168.1.178:2181 lastZxid:4297775812 xid:373328 sent:373328 recv:444599 queuedpkts:0 pendingresp:0 queuedevents:0] Received ZooKeeper watch event: WatchedEvent state:SyncConnected type:NodeDataChanged path:/loadbalance/brokers/bigdata-hostname-026:8080
14:10:59.372 [pulsar-ordered-OrderedExecutor-4-0-EventThread] INFO org.apache.pulsar.zookeeper.ZooKeeperDataCache - [State:CONNECTED Timeout:30000 sessionid:0x804029ad72c04ee local:/192.168.1.171:55324 remoteserver:bigdata-hostname-008/192.168.1.178:2181 lastZxid:4297775813 xid:373329 sent:373329 recv:444601 queuedpkts:0 pendingresp:0 queuedevents:0] Received ZooKeeper watch event: WatchedEvent state:SyncConnected type:NodeDataChanged path:/loadbalance/brokers/bigdata-hostname-019:8080
14:10:59.786 [pulsar-ordered-OrderedExecutor-4-0-EventThread] INFO org.apache.pulsar.zookeeper.ZooKeeperDataCache - [State:CONNECTED Timeout:30000 sessionid:0x804029ad72c04ee local:/192.168.1.171:55324 remoteserver:bigdata-hostname-008/192.168.1.178:2181 lastZxid:4297775814 xid:373330 sent:373330 recv:444603 queuedpkts:0 pendingresp:0 queuedevents:0] Received ZooKeeper watch event: WatchedEvent state:SyncConnected type:NodeDataChanged path:/loadbalance/brokers/bigdata-hostname-020:8080
14:11:01.415 [pulsar-ordered-OrderedExecutor-4-0-EventThread] INFO org.apache.pulsar.zookeeper.ZooKeeperDataCache - [State:CONNECTED Timeout:30000 sessionid:0x804029ad72c04ee local:/192.168.1.171:55324 remoteserver:bigdata-hostname-008/192.168.1.178:2181 lastZxid:4297775815 xid:373332 sent:373332 recv:444606 queuedpkts:0 pendingresp:0 queuedevents:0] Received ZooKeeper watch event: WatchedEvent state:SyncConnected type:NodeDataChanged path:/loadbalance/brokers/bigdata-hostname-026:8080
14:11:03.440 [pulsar-io-23-18] WARN org.apache.pulsar.broker.service.ServerCnx - [/192.168.1.124:33516] Got exception io.netty.channel.unix.Errors$NativeIoException: readAddress(..) failed: Connection reset by peer
14:11:03.441 [pulsar-io-23-18] INFO org.apache.pulsar.broker.service.ServerCnx - Closed connection from /192.168.1.124:33516
14:11:03.441 [pulsar-io-23-18] INFO org.apache.pulsar.broker.service.persistent.PersistentDispatcherMultipleConsumers - Removed consumer Consumer{subscription=PersistentSubscription{topic=persistent://persistent://tenant/namespace/topic-partition-25, name=tydic-subscription-flink-2}, consumerId=25, consumerName=d179f, address=/192.168.1.124:33516} with pending 452 acks
14:11:03.775 [pulsar-io-23-31] WARN org.apache.pulsar.broker.service.ServerCnx - [/192.168.1.125:40918] Got exception io.netty.channel.unix.Errors$NativeIoException: readAddress(..) failed: Connection reset by peer
14:11:03.775 [pulsar-io-23-31] INFO org.apache.pulsar.broker.service.ServerCnx - Closed connection from /192.168.1.125:40918
14:11:03.775 [pulsar-io-23-31] INFO org.apache.pulsar.broker.service.persistent.PersistentDispatcherMultipleConsumers - Removed consumer Consumer{subscription=PersistentSubscription{topic=persistent://persistent://tenant/namespace/topic-partition-25, name=tydic-subscription-flink-2}, consumerId=25, consumerName=ddf7d, address=/192.168.1.125:40918} with pending 466 acks
14:11:03.842 [pulsar-io-23-33] WARN org.apache.pulsar.broker.service.ServerCnx - [/192.168.1.136:53824] Got exception io.netty.channel.unix.Errors$NativeIoException: readAddress(..) failed: Connection reset by peer
14:11:03.842 [pulsar-io-23-33] INFO org.apache.pulsar.broker.service.ServerCnx - Closed connection from /192.168.1.136:53824
14:11:03.842 [pulsar-io-23-33] INFO org.apache.pulsar.broker.service.persistent.PersistentDispatcherMultipleConsumers - Removed consumer Consumer{subscription=PersistentSubscription{topic=persistent://persistent://tenant/namespace/topic-partition-25, name=tydic-subscription-flink-2}, consumerId=25, consumerName=5f084, address=/192.168.1.136:53824} with pending 482 acks
14:11:03.904 [pulsar-io-23-22] WARN org.apache.pulsar.broker.service.ServerCnx - [/192.168.1.112:60492] Got exception io.netty.channel.unix.Errors$NativeIoException: writevAddresses(..) failed: Connection reset by peer
14:11:03.904 [pulsar-io-23-22] INFO org.apache.pulsar.broker.service.ServerCnx - Closed connection from /192.168.1.112:60492
14:11:03.904 [pulsar-io-23-22] INFO org.apache.pulsar.broker.service.persistent.PersistentDispatcherMultipleConsumers - Removed consumer Consumer{subscription=PersistentSubscription{topic=persistent://persistent://tenant/namespace/topic-partition-25, name=tydic-subscription-flink-2}, consumerId=25, consumerName=e59cf, address=/192.168.1.112:60492} with pending 496 acks
14:11:03.914 [pulsar-io-23-35] WARN org.apache.pulsar.broker.service.ServerCnx - [/192.168.1.128:38378] Got exception io.netty.channel.unix.Errors$NativeIoException: readAddress(..) failed: Connection reset by peer
14:11:03.914 [pulsar-io-23-35] INFO org.apache.pulsar.broker.service.ServerCnx - Closed connection from /192.168.1.128:38378
14:11:03.914 [pulsar-io-23-35] INFO org.apache.pulsar.broker.service.persistent.PersistentDispatcherMultipleConsumers - Removed consumer Consumer{subscription=PersistentSubscription{topic=persistent://persistent://tenant/namespace/topic-partition-25, name=tydic-subscription-flink-2}, consumerId=25, consumerName=7b9ef, address=/192.168.1.128:38378} with pending 508 acks
14:11:03.939 [pulsar-ordered-OrderedExecutor-4-0-EventThread] INFO org.apache.pulsar.zookeeper.ZooKeeperDataCache - [State:CONNECTED Timeout:30000 sessionid:0x804029ad72c04ee local:/192.168.1.171:55324 remoteserver:bigdata-hostname-008/192.168.1.178:2181 lastZxid:4297775816 xid:373333 sent:373333 recv:444608 queuedpkts:0 pendingresp:0 queuedevents:0] Received ZooKeeper watch event: WatchedEvent state:SyncConnected type:NodeDataChanged path:/loadbalance/brokers/bigdata-hostname-024:8080
14:11:03.948 [pulsar-io-23-2] WARN org.apache.pulsar.broker.service.ServerCnx - [/192.168.1.109:40194] Got exception io.netty.channel.unix.Errors$NativeIoException: readAddress(..) failed: Connection reset by peer
14:11:03.948 [pulsar-io-23-2] INFO org.apache.pulsar.broker.service.ServerCnx - Closed connection from /192.168.1.109:40194
14:11:03.948 [pulsar-io-23-2] INFO org.apache.pulsar.broker.service.persistent.PersistentDispatcherMultipleConsumers - Removed consumer Consumer{subscription=PersistentSubscription{topic=persistent://persistent://tenant/namespace/topic-partition-25, name=tydic-subscription-flink-2}, consumerId=25, consumerName=a0e48, address=/192.168.1.109:40194} with pending 522 acks
14:11:03.951 [pulsar-io-23-1] WARN org.apache.pulsar.broker.service.ServerCnx - [/192.168.1.100:38198] Got exception io.netty.channel.unix.Errors$NativeIoException: readAddress(..) failed: Connection reset by peer
14:11:03.951 [pulsar-io-23-1] INFO org.apache.pulsar.broker.service.ServerCnx - Closed connection from /192.168.1.100:38198
14:11:03.951 [pulsar-io-23-1] INFO org.apache.pulsar.broker.service.persistent.PersistentDispatcherMultipleConsumers - Removed consumer Consumer{subscription=PersistentSubscription{topic=persistent://persistent://tenant/namespace/topic-partition-25, name=tydic-subscription-flink-2}, consumerId=25, consumerName=8307e, address=/192.168.1.100:38198} with pending 547 acks
14:11:04.028 [pulsar-io-23-91] WARN org.apache.pulsar.broker.service.ServerCnx - [/192.168.1.97:50924] Got exception io.netty.channel.unix.Errors$NativeIoException: writevAddresses(..) failed: Connection reset by peer
14:11:04.028 [pulsar-io-23-91] INFO org.apache.pulsar.broker.service.ServerCnx - Closed connection from /192.168.1.97:50924
14:11:04.028 [pulsar-io-23-91] INFO org.apache.pulsar.broker.service.persistent.PersistentDispatcherMultipleConsumers - Removed consumer Consumer{subscription=PersistentSubscription{topic=persistent://persistent://tenant/namespace/topic-partition-25, name=tydic-subscription-flink-2}, consumerId=25, consumerName=b4e5a, address=/192.168.1.97:50924} with pending 610 acks
14:11:04.052 [pulsar-io-23-13] WARN org.apache.pulsar.broker.service.ServerCnx - [/192.168.1.113:37472] Got exception io.netty.channel.unix.Errors$NativeIoException: writevAddresses(..) failed: Connection reset by peer
14:11:04.052 [pulsar-io-23-13] INFO org.apache.pulsar.broker.service.ServerCnx - Closed connection from /192.168.1.113:37472
14:11:04.052 [pulsar-io-23-13] INFO org.apache.pulsar.broker.service.persistent.PersistentDispatcherMultipleConsumers - Removed consumer Consumer{subscription=PersistentSubscription{topic=persistent://persistent://tenant/namespace/topic-partition-25, name=tydic-subscription-flink-2}, consumerId=25, consumerName=9e4cb, address=/192.168.1.113:37472} with pending 702 acks
14:11:04.058 [pulsar-io-23-25] WARN org.apache.pulsar.broker.service.ServerCnx - [/192.168.1.83:52636] Got exception io.netty.channel.unix.Errors$NativeIoException: writevAddresses(..) failed: Connection reset by peer
14:11:04.058 [pulsar-io-23-26] WARN org.apache.pulsar.broker.service.ServerCnx - [/192.168.1.83:52662] Got exception io.netty.channel.unix.Errors$NativeIoException: writevAddresses(..) failed: Connection reset by peer
14:11:04.058 [pulsar-io-23-25] INFO org.apache.pulsar.broker.service.ServerCnx - Closed connection from /192.168.1.83:52636
14:11:04.058 [pulsar-io-23-25] INFO org.apache.pulsar.broker.service.persistent.PersistentDispatcherMultipleConsumers - Removed consumer Consumer{subscription=PersistentSubscription{topic=persistent://persistent://tenant/namespace/topic-partition-25, name=tydic-subscription-flink-2}, consumerId=25, consumerName=2aba8, address=/192.168.1.83:52636} with pending 694 acks
14:11:04.058 [pulsar-io-23-26] INFO org.apache.pulsar.broker.service.ServerCnx - Closed connection from /192.168.1.83:52662
14:11:04.059 [pulsar-io-23-26] INFO org.apache.pulsar.broker.service.persistent.PersistentDispatcherMultipleConsumers - Removed consumer Consumer{subscription=PersistentSubscription{topic=persistent://persistent://tenant/namespace/topic-partition-25, name=tydic-subscription-flink-2}, consumerId=25, consumerName=a6069, address=/192.168.1.83:52662} with pending 701 acks
14:11:04.061 [pulsar-io-23-17] WARN org.apache.pulsar.broker.service.ServerCnx - [/192.168.1.116:33540] Got exception io.netty.channel.unix.Errors$NativeIoException: writevAddresses(..) failed: Connection reset by peer
14:11:04.062 [pulsar-io-23-17] INFO org.apache.pulsar.broker.service.ServerCnx - Closed connection from /192.168.1.116:33540
14:11:04.062 [pulsar-io-23-17] INFO org.apache.pulsar.broker.service.persistent.PersistentDispatcherMultipleConsumers - Removed consumer Consumer{subscription=PersistentSubscription{topic=persistent://persistent://tenant/namespace/topic-partition-25, name=tydic-subscription-flink-2}, consumerId=25, consumerName=96a78, address=/192.168.1.116:33540} with pending 569 acks
14:11:04.126 [pulsar-io-23-20] WARN org.apache.pulsar.broker.service.ServerCnx - [/192.168.1.95:36336] Got exception io.netty.channel.unix.Errors$NativeIoException: writevAddresses(..) failed: Connection reset by peer
14:11:04.126 [pulsar-io-23-21] WARN org.apache.pulsar.broker.service.ServerCnx - [/192.168.1.95:36356] Got exception io.netty.channel.unix.Errors$NativeIoException: writevAddresses(..) failed: Connection reset by peer
14:11:04.126 [pulsar-io-23-20] INFO org.apache.pulsar.broker.service.ServerCnx - Closed connection from /192.168.1.95:36336
14:11:04.126 [pulsar-io-23-21] INFO org.apache.pulsar.broker.service.ServerCnx - Closed connection from /192.168.1.95:36356
14:11:04.126 [pulsar-io-23-20] INFO org.apache.pulsar.broker.service.persistent.PersistentDispatcherMultipleConsumers - Removed consumer Consumer{subscription=PersistentSubscription{topic=persistent://persistent://tenant/namespace/topic-partition-25, name=tydic-subscription-flink-2}, consumerId=25, consumerName=f15ae, address=/192.168.1.95:36336} with pending 575 acks
14:11:04.127 [pulsar-io-23-21] INFO org.apache.pulsar.broker.service.persistent.PersistentDispatcherMultipleConsumers - Removed consumer Consumer{subscription=PersistentSubscription{topic=persistent://persistent://tenant/namespace/topic-partition-25, name=tydic-subscription-flink-2}, consumerId=25, consumerName=2333d, address=/192.168.1.95:36356} with pending 577 acks
14:11:04.214 [pulsar-io-23-30] WARN org.apache.pulsar.broker.service.ServerCnx - [/192.168.1.99:49302] Got exception io.netty.channel.unix.Errors$NativeIoException: writevAddresses(..) failed: Connection reset by peer
14:11:04.214 [pulsar-io-23-30] INFO org.apache.pulsar.broker.service.ServerCnx - Closed connection from /192.168.1.99:49302
14:11:04.214 [pulsar-io-23-30] INFO org.apache.pulsar.broker.service.persistent.PersistentDispatcherMultipleConsumers - Removed consumer Consumer{subscription=PersistentSubscription{topic=persistent://persistent://tenant/namespace/topic-partition-25, name=tydic-subscription-flink-2}, consumerId=25, consumerName=2539c, address=/192.168.1.99:49302} with pending 593 acks
14:11:04.240 [pulsar-io-23-27] WARN org.apache.pulsar.broker.service.ServerCnx - [/192.168.1.120:38422] Got exception io.netty.channel.unix.Errors$NativeIoException: writevAddresses(..) failed: Connection reset by peer
14:11:04.241 [pulsar-io-23-27] INFO org.apache.pulsar.broker.service.ServerCnx - Closed connection from /192.168.1.120:38422
14:11:04.241 [pulsar-io-23-27] INFO org.apache.pulsar.broker.service.persistent.PersistentDispatcherMultipleConsumers - Removed consumer Consumer{subscription=PersistentSubscription{topic=persistent://persistent://tenant/namespace/topic-partition-25, name=tydic-subscription-flink-2}, consumerId=25, consumerName=4a8b3, address=/192.168.1.120:38422} with pending 569 acks
14:11:04.470 [pulsar-io-23-19] WARN org.apache.pulsar.broker.service.ServerCnx - [/192.168.1.135:42024] Got exception io.netty.channel.unix.Errors$NativeIoException: writevAddresses(..) failed: Connection reset by peer
14:11:04.470 [pulsar-io-23-19] INFO org.apache.pulsar.broker.service.ServerCnx - Closed connection from /192.168.1.135:42024
14:11:04.471 [pulsar-io-23-19] INFO org.apache.pulsar.broker.service.persistent.PersistentDispatcherMultipleConsumers - Removed consumer Consumer{subscription=PersistentSubscription{topic=persistent://persistent://tenant/namespace/topic-partition-25, name=tydic-subscription-flink-2}, consumerId=25, consumerName=561fe, address=/192.168.1.135:42024} with pending 614 acks
14:11:04.533 [pulsar-io-23-39] WARN org.apache.pulsar.broker.service.ServerCnx - [/192.168.1.89:37844] Got exception io.netty.channel.unix.Errors$NativeIoException: writevAddresses(..) failed: Connection reset by peer
14:11:04.534 [pulsar-io-23-40] WARN org.apache.pulsar.broker.service.ServerCnx - [/192.168.1.89:37888] Got exception io.netty.channel.unix.Errors$NativeIoException: writevAddresses(..) failed: Connection reset by peer
14:11:04.535 [pulsar-io-23-40] INFO org.apache.pulsar.broker.service.ServerCnx - Closed connection from /192.168.1.89:37888
14:11:04.535 [pulsar-io-23-40] INFO org.apache.pulsar.broker.service.persistent.PersistentDispatcherMultipleConsumers - Removed consumer Consumer{subscription=PersistentSubscription{topic=persistent://persistent://tenant/namespace/topic-partition-25, name=tydic-subscription-flink-2}, consumerId=25, consumerName=e21bc, address=/192.168.1.89:37888} with pending 767 acks
14:11:04.535 [pulsar-io-23-39] INFO org.apache.pulsar.broker.service.ServerCnx - Closed connection from /192.168.1.89:37844
14:11:04.535 [pulsar-io-23-39] INFO org.apache.pulsar.broker.service.persistent.PersistentDispatcherMultipleConsumers - Removed consumer Consumer{subscription=PersistentSubscription{topic=persistent://persistent://tenant/namespace/topic-partition-25, name=tydic-subscription-flink-2}, consumerId=25, consumerName=63b66, address=/192.168.1.89:37844} with pending 771 acks
14:11:04.536 [pulsar-io-23-23] WARN org.apache.pulsar.broker.service.ServerCnx - [/192.168.1.115:49760] Got exception io.netty.channel.unix.Errors$NativeIoException: writevAddresses(..) failed: Connection reset by peer
14:11:04.537 [pulsar-io-23-24] WARN org.apache.pulsar.broker.service.ServerCnx - [/192.168.1.115:49804] Got exception io.netty.channel.unix.Errors$NativeIoException: writevAddresses(..) failed: Connection reset by peer
14:11:04.537 [pulsar-io-23-23] INFO org.apache.pulsar.broker.service.ServerCnx - Closed connection from /192.168.1.115:49760
14:11:04.538 [pulsar-io-23-23] INFO org.apache.pulsar.broker.service.persistent.PersistentDispatcherMultipleConsumers - Removed consumer Consumer{subscription=PersistentSubscription{topic=persistent://persistent://tenant/namespace/topic-partition-25, name=tydic-subscription-flink-2}, consumerId=25, consumerName=80b69, address=/192.168.1.115:49760} with pending 717 acks
14:11:04.538 [pulsar-io-23-24] INFO org.apache.pulsar.broker.service.ServerCnx - Closed connection from /192.168.1.115:49804
14:11:04.539 [pulsar-io-23-24] INFO org.apache.pulsar.broker.service.persistent.PersistentDispatcherMultipleConsumers - Removed consumer Consumer{subscription=PersistentSubscription{topic=persistent://persistent://tenant/namespace/topic-partition-25, name=tydic-subscription-flink-2}, consumerId=25, consumerName=df7bd, address=/192.168.1.115:49804} with pending 707 acks
14:11:04.540 [pulsar-io-23-75] INFO org.apache.pulsar.broker.service.ServerCnx - Closed connection from /192.168.1.175:47438
14:11:04.542 [pulsar-io-23-14] WARN org.apache.pulsar.broker.service.ServerCnx - [/192.168.1.93:34716] Got exception io.netty.channel.unix.Errors$NativeIoException: writevAddresses(..) failed: Connection reset by peer
14:11:04.542 [pulsar-io-23-14] INFO org.apache.pulsar.broker.service.ServerCnx - Closed connection from /192.168.1.93:34716
14:11:04.542 [pulsar-io-23-14] INFO org.apache.pulsar.broker.service.persistent.PersistentDispatcherMultipleConsumers - Removed consumer Consumer{subscription=PersistentSubscription{topic=persistent://persistent://tenant/namespace/topic-partition-25, name=tydic-subscription-flink-2}, consumerId=25, consumerName=54137, address=/192.168.1.93:34716} with pending 634 acks
14:11:04.575 [pulsar-io-23-34] WARN org.apache.pulsar.broker.service.ServerCnx - [/192.168.1.93:34760] Got exception io.netty.channel.unix.Errors$NativeIoException: writevAddresses(..) failed: Connection reset by peer
14:11:04.576 [pulsar-io-23-34] INFO org.apache.pulsar.broker.service.ServerCnx - Closed connection from /192.168.1.93:34760
14:11:04.577 [pulsar-io-23-34] INFO org.apache.pulsar.broker.service.persistent.PersistentDispatcherMultipleConsumers - Removed consumer Consumer{subscription=PersistentSubscription{topic=persistent://persistent://tenant/namespace/topic-partition-25, name=tydic-subscription-flink-2}, consumerId=25, consumerName=c311c, address=/192.168.1.93:34760} with pending 654 acks
14:11:04.707 [pulsar-io-23-16] WARN org.apache.pulsar.broker.service.ServerCnx - [/192.168.1.86:41214] Got exception io.netty.channel.unix.Errors$NativeIoException: writevAddresses(..) failed: Connection reset by peer
14:11:04.708 [pulsar-io-23-16] INFO org.apache.pulsar.broker.service.ServerCnx - Closed connection from /192.168.1.86:41214
14:11:04.709 [pulsar-io-23-16] INFO org.apache.pulsar.broker.service.persistent.PersistentDispatcherMultipleConsumers - Removed consumer Consumer{subscription=PersistentSubscription{topic=persistent://persistent://tenant/namespace/topic-partition-25, name=tydic-subscription-flink-2}, consumerId=25, consumerName=8f14e, address=/192.168.1.86:41214} with pending 662 acks
14:11:04.712 [pulsar-io-23-36] WARN org.apache.pulsar.broker.service.ServerCnx - [/192.168.1.140:44764] Got exception io.netty.channel.unix.Errors$NativeIoException: writevAddresses(..) failed: Connection reset by peer
14:11:04.712 [pulsar-io-23-37] WARN org.apache.pulsar.broker.service.ServerCnx - [/192.168.1.140:44766] Got exception io.netty.channel.unix.Errors$NativeIoException: writevAddresses(..) failed: Connection reset by peer
14:11:04.713 [pulsar-io-23-37] INFO org.apache.pulsar.broker.service.ServerCnx - Closed connection from /192.168.1.140:44766
14:11:04.713 [pulsar-io-23-36] INFO org.apache.pulsar.broker.service.ServerCnx - Closed connection from /192.168.1.140:44764
14:11:04.714 [pulsar-io-23-37] INFO org.apache.pulsar.broker.service.persistent.PersistentDispatcherMultipleConsumers - Removed consumer Consumer{subscription=PersistentSubscription{topic=persistent://persistent://tenant/namespace/topic-partition-25, name=tydic-subscription-flink-2}, consumerId=25, consumerName=c76b0, address=/192.168.1.140:44766} with pending 671 acks
14:11:04.716 [pulsar-io-23-36] INFO org.apache.pulsar.broker.service.persistent.PersistentDispatcherMultipleConsumers - Removed consumer Consumer{subscription=PersistentSubscription{topic=persistent://persistent://tenant/namespace/topic-partition-25, name=tydic-subscription-flink-2}, consumerId=25, consumerName=0a82c, address=/192.168.1.140:44764} with pending 665 acks
14:11:04.779 [pulsar-msg-expiry-monitor-26-1] INFO org.apache.pulsar.broker.service.persistent.PersistentMessageExpiryMonitor - [persistent://persistent://tenant/namespace/topic-partition-25][tydic-subscription-flink-2] Starting message expiry check, ttl= 7200 seconds
14:11:04.845 [pulsar-io-23-8] WARN org.apache.pulsar.broker.service.ServerCnx - [/192.168.1.135:41980] Got exception io.netty.channel.unix.Errors$NativeIoException: writevAddresses(..) failed: Connection reset by peer
14:11:04.847 [pulsar-io-23-8] INFO org.apache.pulsar.broker.service.ServerCnx - Closed connection from /192.168.1.135:41980
14:11:04.848 [pulsar-io-23-8] INFO org.apache.pulsar.broker.service.persistent.PersistentDispatcherMultipleConsumers - Removed consumer Consumer{subscription=PersistentSubscription{topic=persistent://persistent://tenant/namespace/topic-partition-25, name=tydic-subscription-flink-2}, consumerId=25, consumerName=cbb3a, address=/192.168.1.135:41980} with pending 675 acks
14:11:04.862 [pulsar-io-23-38] WARN org.apache.pulsar.broker.service.ServerCnx - [/192.168.1.129:45626] Got exception io.netty.channel.unix.Errors$NativeIoException: writevAddresses(..) failed: Connection reset by peer
14:11:04.863 [pulsar-io-23-38] INFO org.apache.pulsar.broker.service.ServerCnx - Closed connection from /192.168.1.129:45626
14:11:04.864 [pulsar-io-23-38] INFO org.apache.pulsar.broker.service.persistent.PersistentDispatcherMultipleConsumers - Removed consumer Consumer{subscription=PersistentSubscription{topic=persistent://persistent://tenant/namespace/topic-partition-25, name=tydic-subscription-flink-2}, consumerId=25, consumerName=0cec2, address=/192.168.1.129:45626} with pending 719 acks
14:11:04.884 [pulsar-io-23-28] WARN org.apache.pulsar.broker.service.ServerCnx - [/192.168.1.84:45936] Got exception io.netty.channel.unix.Errors$NativeIoException: writevAddresses(..) failed: Connection reset by peer
14:11:04.886 [pulsar-io-23-28] INFO org.apache.pulsar.broker.service.ServerCnx - Closed connection from /192.168.1.84:45936
14:11:04.886 [pulsar-io-23-28] INFO org.apache.pulsar.broker.service.persistent.PersistentDispatcherMultipleConsumers - Removed consumer Consumer{subscription=PersistentSubscription{topic=persistent://persistent://tenant/namespace/topic-partition-25, name=tydic-subscription-flink-2}, consumerId=25, consumerName=07f27, address=/192.168.1.84:45936} with pending 725 acks
14:11:05.078 [pulsar-ordered-OrderedExecutor-4-0-EventThread] INFO org.apache.pulsar.zookeeper.ZooKeeperDataCache - [State:CONNECTED Timeout:30000 sessionid:0x804029ad72c04ee local:/192.168.1.171:55324 remoteserver:bigdata-hostname-008/192.168.1.178:2181 lastZxid:4297775818 xid:373336 sent:373336 recv:444612 queuedpkts:0 pendingresp:0 queuedevents:0] Received ZooKeeper watch event: WatchedEvent state:SyncConnected type:NodeDataChanged path:/loadbalance/brokers/bigdata-hostname-014:8080
14:11:05.174 [pulsar-web-42-75] INFO org.eclipse.jetty.server.RequestLog - 192.168.1.171 - - [21/Nov/2020:14:11:05 +0800] "GET /metrics HTTP/1.1" 302 0 "-" "Prometheus/2.18.0" 1
14:11:05.187 [prometheus-stats-43-1] INFO org.eclipse.jetty.server.RequestLog - 192.168.1.171 - - [21/Nov/2020:14:11:05 +0800] "GET /metrics/ HTTP/1.1" 200 96307 "http://bigdata-hostname-001:8080/metrics" "Prometheus/2.18.0" 13
14:11:06.372 [pulsar-ordered-OrderedExecutor-4-0-EventThread] INFO org.apache.pulsar.zookeeper.ZooKeeperDataCache - [State:CONNECTED Timeout:30000 sessionid:0x804029ad72c04ee local:/192.168.1.171:55324 remoteserver:bigdata-hostname-008/192.168.1.178:2181 lastZxid:4297775818 xid:373337 sent:373337 recv:444614 queuedpkts:0 pendingresp:0 queuedevents:0] Received ZooKeeper watch event: WatchedEvent state:SyncConnected type:NodeDataChanged path:/loadbalance/brokers/bigdata-hostname-023:8080
14:11:06.951 [pulsar-load-manager-3-1] INFO org.apache.pulsar.broker.loadbalance.impl.ModularLoadManagerImpl - Writing local data to ZooKeeper because maximum change 21.470584203561497% exceeded threshold 10%; time since last report written is 420.0 seconds
14:11:06.971 [pulsar-ordered-OrderedExecutor-4-0-EventThread] INFO org.apache.pulsar.zookeeper.ZooKeeperDataCache - [State:CONNECTED Timeout:30000 sessionid:0x804029ad72c04ee local:/192.168.1.171:55324 remoteserver:bigdata-hostname-008/192.168.1.178:2181 lastZxid:4297775820 xid:373339 sent:373339 recv:444617 queuedpkts:0 pendingresp:0 queuedevents:0] Received ZooKeeper watch event: WatchedEvent state:SyncConnected type:NodeDataChanged path:/loadbalance/brokers/bigdata-hostname-001:8080
14:11:08.154 [pulsar-ordered-OrderedExecutor-4-0-EventThread] INFO org.apache.pulsar.zookeeper.ZooKeeperDataCache - [State:CONNECTED Timeout:30000 sessionid:0x804029ad72c04ee local:/192.168.1.171:55324 remoteserver:bigdata-hostname-008/192.168.1.178:2181 lastZxid:4297775820 xid:373341 sent:373341 recv:444620 queuedpkts:0 pendingresp:0 queuedevents:0] Received ZooKeeper watch event: WatchedEvent state:SyncConnected type:NodeDataChanged path:/loadbalance/brokers/bigdata-hostname-016:8080
14:11:08.172 [pulsar-ordered-OrderedExecutor-4-0-EventThread] INFO org.apache.pulsar.zookeeper.ZooKeeperDataCache - [State:CONNECTED Timeout:30000 sessionid:0x804029ad72c04ee local:/192.168.1.171:55324 remoteserver:bigdata-hostname-008/192.168.1.178:2181 lastZxid:4297775821 xid:373342 sent:373342 recv:444622 queuedpkts:0 pendingresp:0 queuedevents:0] Received ZooKeeper watch event: WatchedEvent state:SyncConnected type:NodeDataChanged path:/loadbalance/brokers/bigdata-hostname-002:8080
14:11:08.854 [pulsar-ordered-OrderedExecutor-4-0-EventThread] INFO org.apache.pulsar.zookeeper.ZooKeeperDataCache - [State:CONNECTED Timeout:30000 sessionid:0x804029ad72c04ee local:/192.168.1.171:55324 remoteserver:bigdata-hostname-008/192.168.1.178:2181 lastZxid:4297775822 xid:373343 sent:373343 recv:444624 queuedpkts:0 pendingresp:0 queuedevents:0] Received ZooKeeper watch event: WatchedEvent state:SyncConnected type:NodeDataChanged path:/loadbalance/brokers/bigdata-hostname-004:8080
14:11:09.372 [pulsar-ordered-OrderedExecutor-4-0-EventThread] INFO org.apache.pulsar.zookeeper.ZooKeeperDataCache - [State:CONNECTED Timeout:30000 sessionid:0x804029ad72c04ee local:/192.168.1.171:55324 remoteserver:bigdata-hostname-008/192.168.1.178:2181 lastZxid:4297775823 xid:373344 sent:373344 recv:444626 queuedpkts:0 pendingresp:0 queuedevents:0] Received ZooKeeper watch event: WatchedEvent state:SyncConnected type:NodeDataChanged path:/loadbalance/brokers/bigdata-hostname-019:8080
14:11:10.095 [pulsar-ordered-OrderedExecutor-4-0-EventThread] INFO org.apache.pulsar.zookeeper.ZooKeeperDataCache - [State:CONNECTED Timeout:30000 sessionid:0x804029ad72c04ee local:/192.168.1.171:55324 remoteserver:bigdata-hostname-008/192.168.1.178:2181 lastZxid:4297775824 xid:373345 sent:373345 recv:444628 queuedpkts:0 pendingresp:0 queuedevents:0] Received ZooKeeper watch event: WatchedEvent state:SyncConnected type:NodeDataChanged path:/loadbalance/brokers/bigdata-hostname-027:8080
14:11:14.788 [pulsar-ordered-OrderedExecutor-4-0-EventThread] INFO org.apache.pulsar.zookeeper.ZooKeeperDataCache - [State:CONNECTED Timeout:30000 sessionid:0x804029ad72c04ee local:/192.168.1.171:55324 remoteserver:bigdata-hostname-008/192.168.1.178:2181 lastZxid:4297775825 xid:373347 sent:373347 recv:444631 queuedpkts:0 pendingresp:0 queuedevents:0] Received ZooKeeper watch event: WatchedEvent state:SyncConnected type:NodeDataChanged path:/loadbalance/brokers/bigdata-hostname-020:8080
14:11:17.971 [pulsar-ordered-OrderedExecutor-4-0-EventThread] INFO org.apache.pulsar.zookeeper.ZooKeeperDataCache - [State:CONNECTED Timeout:30000 sessionid:0x804029ad72c04ee local:/192.168.1.171:55324 remoteserver:bigdata-hostname-008/192.168.1.178:2181 lastZxid:4297775826 xid:373361 sent:373361 recv:444646 queuedpkts:0 pendingresp:0 queuedevents:0] Received ZooKeeper watch event: WatchedEvent state:SyncConnected type:NodeDataChanged path:/loadbalance/brokers/bigdata-hostname-003:8080
14:11:18.395 [pulsar-ordered-OrderedExecutor-4-0-EventThread] INFO org.apache.pulsar.zookeeper.ZooKeeperDataCache - [State:CONNECTED Timeout:30000 sessionid:0x804029ad72c04ee local:/192.168.1.171:55324 remoteserver:bigdata-hostname-008/192.168.1.178:2181 lastZxid:4297775827 xid:373362 sent:373362 recv:444648 queuedpkts:0 pendingresp:0 queuedevents:0] Received ZooKeeper watch event: WatchedEvent state:SyncConnected type:NodeDataChanged path:/loadbalance/brokers/bigdata-hostname-021:8080
14:11:19.852 [pulsar-ordered-OrderedExecutor-4-0-EventThread] INFO org.apache.pulsar.zookeeper.ZooKeeperDataCache - [State:CONNECTED Timeout:30000 sessionid:0x804029ad72c04ee local:/192.168.1.171:55324 remoteserver:bigdata-hostname-008/192.168.1.178:2181 lastZxid:4297775828 xid:373363 sent:373363 recv:444650 queuedpkts:0 pendingresp:0 queuedevents:0] Received ZooKeeper watch event: WatchedEvent state:SyncConnected type:NodeDataChanged path:/loadbalance/brokers/bigdata-hostname-015:8080
14:11:26.420 [pulsar-ordered-OrderedExecutor-4-0-EventThread] INFO org.apache.pulsar.zookeeper.ZooKeeperDataCache - [State:CONNECTED Timeout:30000 sessionid:0x804029ad72c04ee local:/192.168.1.171:55324 remoteserver:bigdata-hostname-008/192.168.1.178:2181 lastZxid:4297775829 xid:373367 sent:373367 recv:444655 queuedpkts:0 pendingresp:0 queuedevents:0] Received ZooKeeper watch event: WatchedEvent state:SyncConnected type:NodeDataChanged path:/loadbalance/brokers/bigdata-hostname-026:8080
14:11:28.943 [pulsar-ordered-OrderedExecutor-4-0-EventThread] INFO org.apache.pulsar.zookeeper.ZooKeeperDataCache - [State:CONNECTED Timeout:30000 sessionid:0x804029ad72c04ee local:/192.168.1.171:55324 remoteserver:bigdata-hostname-008/192.168.1.178:2181 lastZxid:4297775830 xid:373370 sent:373370 recv:444659 queuedpkts:0 pendingresp:0 queuedevents:0] Received ZooKeeper watch event: WatchedEvent state:SyncConnected type:NodeDataChanged path:/loadbalance/brokers/bigdata-hostname-024:8080
14:11:29.194 [pulsar-ordered-OrderedExecutor-4-0-EventThread] INFO org.apache.pulsar.zookeeper.ZooKeeperDataCache - [State:CONNECTED Timeout:30000 sessionid:0x804029ad72c04ee local:/192.168.1.171:55324 remoteserver:bigdata-hostname-008/192.168.1.178:2181 lastZxid:4297775831 xid:373371 sent:373371 recv:444661 queuedpkts:0 pendingresp:0 queuedevents:0] Received ZooKeeper watch event: WatchedEvent state:SyncConnected type:NodeDataChanged path:/loadbalance/brokers/bigdata-hostname-005:8080
14:11:29.202 [pulsar-ordered-OrderedExecutor-4-0-EventThread] INFO org.apache.pulsar.zookeeper.ZooKeeperDataCache - [State:CONNECTED Timeout:30000 sessionid:0x804029ad72c04ee local:/192.168.1.171:55324 remoteserver:bigdata-hostname-008/192.168.1.178:2181 lastZxid:4297775832 xid:373372 sent:373372 recv:444663 queuedpkts:0 pendingresp:0 queuedevents:0] Received ZooKeeper watch event: WatchedEvent state:SyncConnected type:NodeDataChanged path:/loadbalance/brokers/bigdata-hostname-018:8080
14:11:34.367 [pulsar-ordered-OrderedExecutor-4-0-EventThread] INFO org.apache.pulsar.zookeeper.ZooKeeperDataCache - [State:CONNECTED Timeout:30000 sessionid:0x804029ad72c04ee local:/192.168.1.171:55324 remoteserver:bigdata-hostname-008/192.168.1.178:2181 lastZxid:4297775833 xid:373374 sent:373374 recv:444666 queuedpkts:0 pendingresp:0 queuedevents:0] Received ZooKeeper watch event: WatchedEvent state:SyncConnected type:NodeDataChanged path:/loadbalance/brokers/bigdata-hostname-009:8080
14:11:36.369 [pulsar-ordered-OrderedExecutor-4-0-EventThread] INFO org.apache.pulsar.zookeeper.ZooKeeperDataCache - [State:CONNECTED Timeout:30000 sessionid:0x804029ad72c04ee local:/192.168.1.171:55324 remoteserver:bigdata-hostname-008/192.168.1.178:2181 lastZxid:4297775834 xid:373376 sent:373376 recv:444669 queuedpkts:0 pendingresp:0 queuedevents:0] Received ZooKeeper watch event: WatchedEvent state:SyncConnected type:NodeDataChanged path:/loadbalance/brokers/bigdata-hostname-023:8080
14:11:36.718 [pulsar-ordered-OrderedExecutor-4-0-EventThread] INFO org.apache.pulsar.zookeeper.ZooKeeperDataCache - [State:CONNECTED Timeout:30000 sessionid:0x804029ad72c04ee local:/192.168.1.171:55324 remoteserver:bigdata-hostname-008/192.168.1.178:2181 lastZxid:4297775835 xid:373378 sent:373378 recv:444672 queuedpkts:0 pendingresp:0 queuedevents:0] Received ZooKeeper watch event: WatchedEvent state:SyncConnected type:NodeDataChanged path:/loadbalance/brokers/bigdata-hostname-025:8080
14:11:38.874 [pulsar-ordered-OrderedExecutor-4-0-EventThread] INFO org.apache.pulsar.zookeeper.ZooKeeperDataCache - [State:CONNECTED Timeout:30000 sessionid:0x804029ad72c04ee local:/192.168.1.171:55324 remoteserver:bigdata-hostname-008/192.168.1.178:2181 lastZxid:4297775836 xid:373380 sent:373380 recv:444675 queuedpkts:0 pendingresp:0 queuedevents:0] Received ZooKeeper watch event: WatchedEvent state:SyncConnected type:NodeDataChanged path:/loadbalance/brokers/bigdata-hostname-017:8080
14:11:39.659 [pulsar-ordered-OrderedExecutor-4-0-EventThread] INFO org.apache.pulsar.zookeeper.ZooKeeperDataCache - [State:CONNECTED Timeout:30000 sessionid:0x804029ad72c04ee local:/192.168.1.171:55324 remoteserver:bigdata-hostname-008/192.168.1.178:2181 lastZxid:4297775837 xid:373385 sent:373385 recv:444681 queuedpkts:0 pendingresp:0 queuedevents:0] Received ZooKeeper watch event: WatchedEvent state:SyncConnected type:NodeDataChanged path:/loadbalance/brokers/bigdata-hostname-010:8080
14:11:40.099 [pulsar-ordered-OrderedExecutor-4-0-EventThread] INFO org.apache.pulsar.zookeeper.ZooKeeperDataCache - [State:CONNECTED Timeout:30000 sessionid:0x804029ad72c04ee local:/192.168.1.171:55324 remoteserver:bigdata-hostname-008/192.168.1.178:2181 lastZxid:4297775838 xid:373388 sent:373388 recv:444685 queuedpkts:0 pendingresp:0 queuedevents:0] Received ZooKeeper watch event: WatchedEvent state:SyncConnected type:NodeDataChanged path:/loadbalance/brokers/bigdata-hostname-027:8080
14:11:43.940 [pulsar-ordered-OrderedExecutor-4-0-EventThread] INFO org.apache.pulsar.zookeeper.ZooKeeperDataCache - [State:CONNECTED Timeout:30000 sessionid:0x804029ad72c04ee local:/192.168.1.171:55324 remoteserver:bigdata-hostname-008/192.168.1.178:2181 lastZxid:4297775839 xid:373389 sent:373389 recv:444687 queuedpkts:0 pendingresp:0 queuedevents:0] Received ZooKeeper watch event: WatchedEvent state:SyncConnected type:NodeDataChanged path:/loadbalance/brokers/bigdata-hostname-024:8080
14:11:45.311 [pulsar-ordered-OrderedExecutor-4-0-EventThread] INFO org.apache.pulsar.zookeeper.ZooKeeperDataCache - [State:CONNECTED Timeout:30000 sessionid:0x804029ad72c04ee local:/192.168.1.171:55324 remoteserver:bigdata-hostname-008/192.168.1.178:2181 lastZxid:4297775840 xid:373391 sent:373391 recv:444690 queuedpkts:0 pendingresp:0 queuedevents:0] Received ZooKeeper watch event: WatchedEvent state:SyncConnected type:NodeDataChanged path:/loadbalance/brokers/bigdata-hostname-011:8080
14:11:49.211 [pulsar-ordered-OrderedExecutor-4-0-EventThread] INFO org.apache.pulsar.zookeeper.ZooKeeperDataCache - [State:CONNECTED Timeout:30000 sessionid:0x804029ad72c04ee local:/192.168.1.171:55324 remoteserver:bigdata-hostname-008/192.168.1.178:2181 lastZxid:4297775841 xid:373398 sent:373398 recv:444698 queuedpkts:0 pendingresp:0 queuedevents:0] Received ZooKeeper watch event: WatchedEvent state:SyncConnected type:NodeDataChanged path:/loadbalance/brokers/bigdata-hostname-018:8080
14:11:51.707 [pulsar-ordered-OrderedExecutor-4-0-EventThread] INFO org.apache.pulsar.zookeeper.ZooKeeperDataCache - [State:CONNECTED Timeout:30000 sessionid:0x804029ad72c04ee local:/192.168.1.171:55324 remoteserver:bigdata-hostname-008/192.168.1.178:2181 lastZxid:4297775842 xid:373401 sent:373401 recv:444702 queuedpkts:0 pendingresp:0 queuedevents:0] Received ZooKeeper watch event: WatchedEvent state:SyncConnected type:NodeDataChanged path:/loadbalance/brokers/bigdata-hostname-025:8080
14:11:59.373 [pulsar-ordered-OrderedExecutor-4-0-EventThread] INFO org.apache.pulsar.zookeeper.ZooKeeperDataCache - [State:CONNECTED Timeout:30000 sessionid:0x804029ad72c04ee local:/192.168.1.171:55324 remoteserver:bigdata-hostname-008/192.168.1.178:2181 lastZxid:4297775843 xid:373405 sent:373405 recv:444707 queuedpkts:0 pendingresp:0 queuedevents:0] Received ZooKeeper watch event: WatchedEvent state:SyncConnected type:NodeDataChanged path:/loadbalance/brokers/bigdata-hostname-019:8080
14:12:01.413 [pulsar-ordered-OrderedExecutor-4-0-EventThread] INFO org.apache.pulsar.zookeeper.ZooKeeperDataCache - [State:CONNECTED Timeout:30000 sessionid:0x804029ad72c04ee local:/192.168.1.171:55324 remoteserver:bigdata-hostname-008/192.168.1.178:2181 lastZxid:4297775844 xid:373409 sent:373409 recv:444712 queuedpkts:0 pendingresp:0 queuedevents:0] Received ZooKeeper watch event: WatchedEvent state:SyncConnected type:NodeDataChanged path:/loadbalance/brokers/bigdata-hostname-026:8080
14:12:05.174 [pulsar-web-42-75] INFO org.eclipse.jetty.server.RequestLog - 192.168.1.171 - - [21/Nov/2020:14:12:05 +0800] "GET /metrics HTTP/1.1" 302 0 "-" "Prometheus/2.18.0" 1
14:12:05.189 [prometheus-stats-43-1] INFO org.eclipse.jetty.server.RequestLog - 192.168.1.171 - - [21/Nov/2020:14:12:05 +0800] "GET /metrics/ HTTP/1.1" 200 96277 "http://bigdata-hostname-001:8080/metrics" "Prometheus/2.18.0" 15
14:12:06.951 [pulsar-load-manager-3-1] INFO org.apache.pulsar.broker.loadbalance.impl.ModularLoadManagerImpl - Writing local data to ZooKeeper because maximum change 37.467438880883044% exceeded threshold 10%; time since last report written is 60.0 seconds
14:12:06.978 [pulsar-ordered-OrderedExecutor-4-0-EventThread] INFO org.apache.pulsar.zookeeper.ZooKeeperDataCache - [State:CONNECTED Timeout:30000 sessionid:0x804029ad72c04ee local:/192.168.1.171:55324 remoteserver:bigdata-hostname-008/192.168.1.178:2181 lastZxid:4297775846 xid:373412 sent:373412 recv:444716 queuedpkts:0 pendingresp:0 queuedevents:0] Received ZooKeeper watch event: WatchedEvent state:SyncConnected type:NodeDataChanged path:/loadbalance/brokers/bigdata-hostname-001:8080
14:12:18.150 [pulsar-ordered-OrderedExecutor-4-0-EventThread] INFO org.apache.pulsar.zookeeper.ZooKeeperDataCache - [State:CONNECTED Timeout:30000 sessionid:0x804029ad72c04ee local:/192.168.1.171:55324 remoteserver:bigdata-hostname-008/192.168.1.178:2181 lastZxid:4297775846 xid:373419 sent:373419 recv:444724 queuedpkts:0 pendingresp:0 queuedevents:0] Received ZooKeeper watch event: WatchedEvent state:SyncConnected type:NodeDataChanged path:/loadbalance/brokers/bigdata-hostname-016:8080
14:12:22.843 [pulsar-ordered-OrderedExecutor-4-0-EventThread] INFO org.apache.pulsar.zookeeper.ZooKeeperDataCache - [State:CONNECTED Timeout:30000 sessionid:0x804029ad72c04ee local:/192.168.1.171:55324 remoteserver:bigdata-hostname-008/192.168.1.178:2181 lastZxid:4297775847 xid:373433 sent:373433 recv:444739 queuedpkts:0 pendingresp:0 queuedevents:0] Received ZooKeeper watch event: WatchedEvent state:SyncConnected type:NodeDataChanged path:/loadbalance/brokers/bigdata-hostname-022:8080
14:12:27.834 [pulsar-ordered-OrderedExecutor-4-0-EventThread] INFO org.apache.pulsar.zookeeper.ZooKeeperDataCache - [State:CONNECTED Timeout:30000 sessionid:0x804029ad72c04ee local:/192.168.1.171:55324 remoteserver:bigdata-hostname-008/192.168.1.178:2181 lastZxid:4297775848 xid:373441 sent:373441 recv:444748 queuedpkts:0 pendingresp:0 queuedevents:0] Received ZooKeeper watch event: WatchedEvent state:SyncConnected type:NodeDataChanged path:/loadbalance/brokers/bigdata-hostname-022:8080
14:12:28.159 [pulsar-ordered-OrderedExecutor-4-0-EventThread] INFO org.apache.pulsar.zookeeper.ZooKeeperDataCache - [State:CONNECTED Timeout:30000 sessionid:0x804029ad72c04ee local:/192.168.1.171:55324 remoteserver:bigdata-hostname-008/192.168.1.178:2181 lastZxid:4297775849 xid:373443 sent:373443 recv:444751 queuedpkts:0 pendingresp:0 queuedevents:0] Received ZooKeeper watch event: WatchedEvent state:SyncConnected type:NodeDataChanged path:/loadbalance/brokers/bigdata-hostname-016:8080
14:12:29.377 [pulsar-ordered-OrderedExecutor-4-0-EventThread] INFO org.apache.pulsar.zookeeper.ZooKeeperDataCache - [State:CONNECTED Timeout:30000 sessionid:0x804029ad72c04ee local:/192.168.1.171:55324 remoteserver:bigdata-hostname-008/192.168.1.178:2181 lastZxid:4297775850 xid:373444 sent:373444 recv:444753 queuedpkts:0 pendingresp:0 queuedevents:0] Received ZooKeeper watch event: WatchedEvent state:SyncConnected type:NodeDataChanged path:/loadbalance/brokers/bigdata-hostname-019:8080
14:12:36.376 [pulsar-ordered-OrderedExecutor-4-0-EventThread] INFO org.apache.pulsar.zookeeper.ZooKeeperDataCache - [State:CONNECTED Timeout:30000 sessionid:0x804029ad72c04ee local:/192.168.1.171:55324 remoteserver:bigdata-hostname-008/192.168.1.178:2181 lastZxid:4297775851 xid:373448 sent:373448 recv:444758 queuedpkts:0 pendingresp:0 queuedevents:0] Received ZooKeeper watch event: WatchedEvent state:SyncConnected type:NodeDataChanged path:/loadbalance/brokers/bigdata-hostname-023:8080
14:12:43.942 [pulsar-ordered-OrderedExecutor-4-0-EventThread] INFO org.apache.pulsar.zookeeper.ZooKeeperDataCache - [State:CONNECTED Timeout:30000 sessionid:0x804029ad72c04ee local:/192.168.1.171:55324 remoteserver:bigdata-hostname-008/192.168.1.178:2181 lastZxid:4297775852 xid:373451 sent:373451 recv:444762 queuedpkts:0 pendingresp:0 queuedevents:0] Received ZooKeeper watch event: WatchedEvent state:SyncConnected type:NodeDataChanged path:/loadbalance/brokers/bigdata-hostname-024:8080
14:12:49.207 [pulsar-ordered-OrderedExecutor-4-0-EventThread] INFO org.apache.pulsar.zookeeper.ZooKeeperDataCache - [State:CONNECTED Timeout:30000 sessionid:0x804029ad72c04ee local:/192.168.1.171:55324 remoteserver:bigdata-hostname-008/192.168.1.178:2181 lastZxid:4297775853 xid:373457 sent:373457 recv:444769 queuedpkts:0 pendingresp:0 queuedevents:0] Received ZooKeeper watch event: WatchedEvent state:SyncConnected type:NodeDataChanged path:/loadbalance/brokers/bigdata-hostname-018:8080
14:12:51.740 [pulsar-ordered-OrderedExecutor-4-0-EventThread] INFO org.apache.pulsar.zookeeper.ZooKeeperDataCache - [State:CONNECTED Timeout:30000 sessionid:0x804029ad72c04ee local:/192.168.1.171:55324 remoteserver:bigdata-hostname-008/192.168.1.178:2181 lastZxid:4297775854 xid:373468 sent:373468 recv:444781 queuedpkts:0 pendingresp:0 queuedevents:0] Received ZooKeeper watch event: WatchedEvent state:SyncConnected type:NodeDataChanged path:/loadbalance/brokers/bigdata-hostname-025:8080
14:12:59.379 [pulsar-ordered-OrderedExecutor-4-0-EventThread] INFO org.apache.pulsar.zookeeper.ZooKeeperDataCache - [State:CONNECTED Timeout:30000 sessionid:0x804029ad72c04ee local:/192.168.1.171:55324 remoteserver:bigdata-hostname-008/192.168.1.178:2181 lastZxid:4297775855 xid:373471 sent:373471 recv:444785 queuedpkts:0 pendingresp:0 queuedevents:0] Received ZooKeeper watch event: WatchedEvent state:SyncConnected type:NodeDataChanged path:/loadbalance/brokers/bigdata-hostname-019:8080
14:13:01.414 [pulsar-ordered-OrderedExecutor-4-0-EventThread] INFO org.apache.pulsar.zookeeper.ZooKeeperDataCache - [State:CONNECTED Timeout:30000 sessionid:0x804029ad72c04ee local:/192.168.1.171:55324 remoteserver:bigdata-hostname-008/192.168.1.178:2181 lastZxid:4297775856 xid:373479 sent:373479 recv:444794 queuedpkts:0 pendingresp:0 queuedevents:0] Received ZooKeeper watch event: WatchedEvent state:SyncConnected type:NodeDataChanged path:/loadbalance/brokers/bigdata-hostname-026:8080
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org