You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pulsar.apache.org by GitBox <gi...@apache.org> on 2022/12/09 09:52:02 UTC
[GitHub] [pulsar] yangl opened a new issue, #18834: [Bug] cannot get the right rack info since the 2.11 version
yangl opened a new issue, #18834:
URL: https://github.com/apache/pulsar/issues/18834
### Search before asking
- [X] I searched in the [issues](https://github.com/apache/pulsar/issues) and found nothing similar.
### Version
2.8.x run well, since the `2.11` version and the master branch cannot get the right rack information.
### Minimal reproduce step
bookkeeperClientRackawarePolicyEnabled=true
bookkeeperClientRegionawarePolicyEnabled=false
set-bookie-rack -b bookie11:3181 -g futian -r /FT --hostname bookie11:3181
set-bookie-rack -b bookie12:3181 -g futian -r /FT --hostname bookie12:3181
set-bookie-rack -b bookie13:3181 -g futian -r /FT --hostname bookie13:3181
set-bookie-rack -b bookie14:3181 -g futian -r /FT --hostname bookie14:3181
set-bookie-rack -b bookie15:3181 -g futian -r /FT --hostname bookie15:3181
set-bookie-rack -b bookie21:3181 -g longhua -r /LH --hostname bookie21:3181
set-bookie-rack -b bookie22:3181 -g longhua -r /LH --hostname bookie22:3181
set-bookie-rack -b bookie23:3181 -g longhua -r /LH --hostname bookie23:3181
set-bookie-rack -b bookie24:3181 -g longhua -r /LH --hostname bookie24:3181
set-bookie-rack -b bookie25:3181 -g longhua -r /LH --hostname bookie25:3181
set-bookie-rack -b bookie31:3181 -g longgang -r /LG --hostname bookie31:3181
set-bookie-rack -b bookie32:3181 -g longgang -r /LG --hostname bookie32:3181
set-bookie-rack -b bookie33:3181 -g longgang -r /LG --hostname bookie33:3181
set-bookie-rack -b bookie34:3181 -g longgang -r /LG --hostname bookie34:3181
set-bookie-rack -b bookie35:3181 -g longgang -r /LG --hostname bookie35:3181
### What did you expect to see?
Adding a new node: /FT/bookie13:3181
as the config rack, not the default rack !!!
### What did you see instead?
2022-12-09 17:40:35,293 INFO [RackawareEnsemblePlacementPolicyImpl#226] [main] Not weighted
2022-12-09 17:40:35,293 INFO [BookKeeper#527] [main] Weighted ledger placement is not enabled
2022-12-09 17:40:35,323 INFO [ZKRegistrationClient#270] [main-EventThread] Update BookieInfoCache (writable bookie) bookie14:3181 -> BookieServiceInfo{properties={}, endpoints=[EndpointInfo{id=bookie, port=3181, host=bookie14, protocol=bookie-rpc, auth=[], extensions=[]}]}
2022-12-09 17:40:35,325 INFO [ZKRegistrationClient#270] [main-EventThread] Update BookieInfoCache (writable bookie) bookie32:3181 -> BookieServiceInfo{properties={}, endpoints=[EndpointInfo{id=bookie, port=3181, host=bookie32, protocol=bookie-rpc, auth=[], extensions=[]}]}
2022-12-09 17:40:35,326 INFO [ZKRegistrationClient#270] [main-EventThread] Update BookieInfoCache (writable bookie) bookie35:3181 -> BookieServiceInfo{properties={}, endpoints=[EndpointInfo{id=bookie, port=3181, host=bookie35, protocol=bookie-rpc, auth=[], extensions=[]}]}
2022-12-09 17:40:35,326 INFO [ZKRegistrationClient#270] [main-EventThread] Update BookieInfoCache (writable bookie) bookie11:3181 -> BookieServiceInfo{properties={}, endpoints=[EndpointInfo{id=bookie, port=3181, host=bookie11, protocol=bookie-rpc, auth=[], extensions=[]}]}
2022-12-09 17:40:35,326 INFO [ZKRegistrationClient#270] [main-EventThread] Update BookieInfoCache (writable bookie) bookie22:3181 -> BookieServiceInfo{properties={}, endpoints=[EndpointInfo{id=bookie, port=3181, host=bookie22, protocol=bookie-rpc, auth=[], extensions=[]}]}
2022-12-09 17:40:35,326 INFO [ZKRegistrationClient#270] [main-EventThread] Update BookieInfoCache (writable bookie) bookie12:3181 -> BookieServiceInfo{properties={}, endpoints=[EndpointInfo{id=bookie, port=3181, host=bookie12, protocol=bookie-rpc, auth=[], extensions=[]}]}
2022-12-09 17:40:35,326 INFO [ZKRegistrationClient#270] [main-EventThread] Update BookieInfoCache (writable bookie) bookie25:3181 -> BookieServiceInfo{properties={}, endpoints=[EndpointInfo{id=bookie, port=3181, host=bookie25, protocol=bookie-rpc, auth=[], extensions=[]}]}
2022-12-09 17:40:35,326 INFO [ZKRegistrationClient#270] [main-EventThread] Update BookieInfoCache (writable bookie) bookie33:3181 -> BookieServiceInfo{properties={}, endpoints=[EndpointInfo{id=bookie, port=3181, host=bookie33, protocol=bookie-rpc, auth=[], extensions=[]}]}
2022-12-09 17:40:35,326 INFO [ZKRegistrationClient#270] [main-EventThread] Update BookieInfoCache (writable bookie) bookie23:3181 -> BookieServiceInfo{properties={}, endpoints=[EndpointInfo{id=bookie, port=3181, host=bookie23, protocol=bookie-rpc, auth=[], extensions=[]}]}
2022-12-09 17:40:35,327 INFO [ZKRegistrationClient#270] [main-EventThread] Update BookieInfoCache (writable bookie) bookie15:3181 -> BookieServiceInfo{properties={}, endpoints=[EndpointInfo{id=bookie, port=3181, host=bookie15, protocol=bookie-rpc, auth=[], extensions=[]}]}
2022-12-09 17:40:35,327 INFO [ZKRegistrationClient#270] [main-EventThread] Update BookieInfoCache (writable bookie) bookie31:3181 -> BookieServiceInfo{properties={}, endpoints=[EndpointInfo{id=bookie, port=3181, host=bookie31, protocol=bookie-rpc, auth=[], extensions=[]}]}
2022-12-09 17:40:35,327 INFO [ZKRegistrationClient#270] [main-EventThread] Update BookieInfoCache (writable bookie) bookie24:3181 -> BookieServiceInfo{properties={}, endpoints=[EndpointInfo{id=bookie, port=3181, host=bookie24, protocol=bookie-rpc, auth=[], extensions=[]}]}
2022-12-09 17:40:35,329 INFO [ZKRegistrationClient#270] [main-EventThread] Update BookieInfoCache (writable bookie) bookie21:3181 -> BookieServiceInfo{properties={}, endpoints=[EndpointInfo{id=bookie, port=3181, host=bookie21, protocol=bookie-rpc, auth=[], extensions=[]}]}
2022-12-09 17:40:35,330 INFO [ZKRegistrationClient#270] [main-EventThread] Update BookieInfoCache (writable bookie) bookie34:3181 -> BookieServiceInfo{properties={}, endpoints=[EndpointInfo{id=bookie, port=3181, host=bookie34, protocol=bookie-rpc, auth=[], extensions=[]}]}
2022-12-09 17:40:35,330 INFO [ZKRegistrationClient#270] [main-EventThread] Update BookieInfoCache (writable bookie) bookie13:3181 -> BookieServiceInfo{properties={}, endpoints=[EndpointInfo{id=bookie, port=3181, host=bookie13, protocol=bookie-rpc, auth=[], extensions=[]}]}
2022-12-09 17:40:35,330 WARN [TopologyAwareEnsemblePlacementPolicy$DNSResolverDecorator#567] [BookKeeperClientScheduler-OrderedScheduler-0-0] Failed to resolve network location for bookie14, using default rack for it : /default-rack.
2022-12-09 17:40:35,330 INFO [NetworkTopologyImpl#428] [BookKeeperClientScheduler-OrderedScheduler-0-0] Adding a new node: /default-rack/bookie14:3181
2022-12-09 17:40:35,330 WARN [TopologyAwareEnsemblePlacementPolicy$DNSResolverDecorator#567] [BookKeeperClientScheduler-OrderedScheduler-0-0] Failed to resolve network location for bookie32, using default rack for it : /default-rack.
2022-12-09 17:40:35,331 INFO [NetworkTopologyImpl#428] [BookKeeperClientScheduler-OrderedScheduler-0-0] Adding a new node: /default-rack/bookie32:3181
2022-12-09 17:40:35,331 WARN [TopologyAwareEnsemblePlacementPolicy$DNSResolverDecorator#567] [BookKeeperClientScheduler-OrderedScheduler-0-0] Failed to resolve network location for bookie35, using default rack for it : /default-rack.
2022-12-09 17:40:35,331 INFO [NetworkTopologyImpl#428] [BookKeeperClientScheduler-OrderedScheduler-0-0] Adding a new node: /default-rack/bookie35:3181
2022-12-09 17:40:35,331 WARN [TopologyAwareEnsemblePlacementPolicy$DNSResolverDecorator#567] [BookKeeperClientScheduler-OrderedScheduler-0-0] Failed to resolve network location for bookie11, using default rack for it : /default-rack.
2022-12-09 17:40:35,331 INFO [NetworkTopologyImpl#428] [BookKeeperClientScheduler-OrderedScheduler-0-0] Adding a new node: /default-rack/bookie11:3181
2022-12-09 17:40:35,331 WARN [TopologyAwareEnsemblePlacementPolicy$DNSResolverDecorator#567] [BookKeeperClientScheduler-OrderedScheduler-0-0] Failed to resolve network location for bookie22, using default rack for it : /default-rack.
2022-12-09 17:40:35,331 INFO [NetworkTopologyImpl#428] [BookKeeperClientScheduler-OrderedScheduler-0-0] Adding a new node: /default-rack/bookie22:3181
2022-12-09 17:40:35,332 WARN [TopologyAwareEnsemblePlacementPolicy$DNSResolverDecorator#567] [BookKeeperClientScheduler-OrderedScheduler-0-0] Failed to resolve network location for bookie12, using default rack for it : /default-rack.
2022-12-09 17:40:35,332 INFO [NetworkTopologyImpl#428] [BookKeeperClientScheduler-OrderedScheduler-0-0] Adding a new node: /default-rack/bookie12:3181
2022-12-09 17:40:35,332 WARN [TopologyAwareEnsemblePlacementPolicy$DNSResolverDecorator#567] [BookKeeperClientScheduler-OrderedScheduler-0-0] Failed to resolve network location for bookie25, using default rack for it : /default-rack.
2022-12-09 17:40:35,332 INFO [NetworkTopologyImpl#428] [BookKeeperClientScheduler-OrderedScheduler-0-0] Adding a new node: /default-rack/bookie25:3181
2022-12-09 17:40:35,332 WARN [TopologyAwareEnsemblePlacementPolicy$DNSResolverDecorator#567] [BookKeeperClientScheduler-OrderedScheduler-0-0] Failed to resolve network location for bookie33, using default rack for it : /default-rack.
2022-12-09 17:40:35,332 INFO [NetworkTopologyImpl#428] [BookKeeperClientScheduler-OrderedScheduler-0-0] Adding a new node: /default-rack/bookie33:3181
2022-12-09 17:40:35,332 WARN [TopologyAwareEnsemblePlacementPolicy$DNSResolverDecorator#567] [BookKeeperClientScheduler-OrderedScheduler-0-0] Failed to resolve network location for bookie23, using default rack for it : /default-rack.
2022-12-09 17:40:35,333 INFO [NetworkTopologyImpl#428] [BookKeeperClientScheduler-OrderedScheduler-0-0] Adding a new node: /default-rack/bookie23:3181
2022-12-09 17:40:35,333 WARN [TopologyAwareEnsemblePlacementPolicy$DNSResolverDecorator#567] [BookKeeperClientScheduler-OrderedScheduler-0-0] Failed to resolve network location for bookie15, using default rack for it : /default-rack.
2022-12-09 17:40:35,333 INFO [NetworkTopologyImpl#428] [BookKeeperClientScheduler-OrderedScheduler-0-0] Adding a new node: /default-rack/bookie15:3181
2022-12-09 17:40:35,333 WARN [TopologyAwareEnsemblePlacementPolicy$DNSResolverDecorator#567] [BookKeeperClientScheduler-OrderedScheduler-0-0] Failed to resolve network location for bookie31, using default rack for it : /default-rack.
2022-12-09 17:40:35,333 INFO [NetworkTopologyImpl#428] [BookKeeperClientScheduler-OrderedScheduler-0-0] Adding a new node: /default-rack/bookie31:3181
2022-12-09 17:40:35,333 WARN [TopologyAwareEnsemblePlacementPolicy$DNSResolverDecorator#567] [BookKeeperClientScheduler-OrderedScheduler-0-0] Failed to resolve network location for bookie24, using default rack for it : /default-rack.
2022-12-09 17:40:35,333 INFO [NetworkTopologyImpl#428] [BookKeeperClientScheduler-OrderedScheduler-0-0] Adding a new node: /default-rack/bookie24:3181
2022-12-09 17:40:35,333 WARN [TopologyAwareEnsemblePlacementPolicy$DNSResolverDecorator#567] [BookKeeperClientScheduler-OrderedScheduler-0-0] Failed to resolve network location for bookie21, using default rack for it : /default-rack.
2022-12-09 17:40:35,334 INFO [NetworkTopologyImpl#428] [BookKeeperClientScheduler-OrderedScheduler-0-0] Adding a new node: /default-rack/bookie21:3181
2022-12-09 17:40:35,334 WARN [TopologyAwareEnsemblePlacementPolicy$DNSResolverDecorator#567] [BookKeeperClientScheduler-OrderedScheduler-0-0] Failed to resolve network location for bookie34, using default rack for it : /default-rack.
2022-12-09 17:40:35,334 INFO [NetworkTopologyImpl#428] [BookKeeperClientScheduler-OrderedScheduler-0-0] Adding a new node: /default-rack/bookie34:3181
2022-12-09 17:40:35,334 WARN [TopologyAwareEnsemblePlacementPolicy$DNSResolverDecorator#567] [BookKeeperClientScheduler-OrderedScheduler-0-0] Failed to resolve network location for bookie13, using default rack for it : /default-rack.
2022-12-09 17:40:35,334 INFO [NetworkTopologyImpl#428] [BookKeeperClientScheduler-OrderedScheduler-0-0] Adding a new node: /default-rack/bookie13:3181
2022-12-09 17:40:35,383 INFO [BrokerInterceptorUtils#79] [main] Searching for broker interceptors in D:\opensource\pulsar\.\interceptors
### Anything else?
_No response_
### Are you willing to submit a PR?
- [ ] I'm willing to submit a PR!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] yangl commented on issue #18834: [Bug] cannot get the right rack info since the 2.10 version
Posted by GitBox <gi...@apache.org>.
yangl commented on issue #18834:
URL: https://github.com/apache/pulsar/issues/18834#issuecomment-1345442412
> Could you cherry-pick this pr and try it again?
which pr? thanks @horizonzy
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] yangl closed issue #18834: [Bug] cannot get the right rack info since the 2.10 version
Posted by GitBox <gi...@apache.org>.
yangl closed issue #18834: [Bug] cannot get the right rack info since the 2.10 version
URL: https://github.com/apache/pulsar/issues/18834
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] horizonzy commented on issue #18834: [Bug] cannot get the right rack info since the 2.10 version
Posted by GitBox <gi...@apache.org>.
horizonzy commented on issue #18834:
URL: https://github.com/apache/pulsar/issues/18834#issuecomment-1345059275
Could you cherry-pick this pr and try it again?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] horizonzy commented on issue #18834: [Bug] cannot get the right rack info since the 2.10 version
Posted by GitBox <gi...@apache.org>.
horizonzy commented on issue #18834:
URL: https://github.com/apache/pulsar/issues/18834#issuecomment-1345453415
> LGTM, but the rack first was default, caused by the resultFromCache is null. may be the else logic should init first？
We can't init it firstly, the `resultFromCache` is added by zk event. If means the currently available bookies. Only after bookies change event, then to refresh the rack info.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] yangl commented on issue #18834: [Bug] cannot get the right rack info since the 2.10 version
Posted by GitBox <gi...@apache.org>.
yangl commented on issue #18834:
URL: https://github.com/apache/pulsar/issues/18834#issuecomment-1345451886
LGTM, but the rack first was default, caused by the `resultFromCache` is null. may be the else logic should init first？
https://github.com/apache/pulsar/blob/50eed520de3cbb23662cbff64ad32144d1a5ddb4/pulsar-metadata/src/main/java/org/apache/pulsar/metadata/bookkeeper/PulsarRegistrationClient.java#L234-L238
```java
```
```properties
2022-12-11 11:46:52,941 INFO [ZooKeeper#637] [main] Initiating client connection, connectString=127.0.0.1:2181/p1 sessionTimeout=30000 watcher=org.apache.bookkeeper.zookeeper.ZooKeeperWatcherBase@67389cb8
2022-12-11 11:46:52,949 INFO [X509Util#77] [main] Setting -D jdk.tls.rejectClientInitiatedRenegotiation=true to disable client-initiated TLS renegotiation
2022-12-11 11:46:52,954 INFO [ClientCnxnSocket#239] [main] jute.maxbuffer value is 1048575 Bytes
2022-12-11 11:46:52,966 INFO [ClientCnxn#1732] [main] zookeeper.request.timeout value is 0. feature enabled=false
2022-12-11 11:46:52,976 INFO [ClientCnxn$SendThread#1171] [main-SendThread(127.0.0.1:2181)] Opening socket connection to server 127.0.0.1/127.0.0.1:2181.
2022-12-11 11:46:52,977 INFO [ClientCnxn$SendThread#1173] [main-SendThread(127.0.0.1:2181)] SASL config status: Will not attempt to authenticate using SASL (unknown error)
2022-12-11 11:46:52,980 INFO [ClientCnxn$SendThread#1005] [main-SendThread(127.0.0.1:2181)] Socket connection established, initiating session, client: /127.0.0.1:54989, server: 127.0.0.1/127.0.0.1:2181
2022-12-11 11:46:52,992 INFO [ClientCnxn$SendThread#1444] [main-SendThread(127.0.0.1:2181)] Session establishment complete on server 127.0.0.1/127.0.0.1:2181, session id = 0x10079cff828001a, negotiated timeout = 30000
2022-12-11 11:46:52,995 INFO [ZooKeeperWatcherBase#130] [main-EventThread] ZooKeeper client is connected now.
2022-12-11 11:46:53,123 INFO [ProtocolHandlerUtils#79] [main] Searching for protocol handlers in D:\opensource\pulsar\.\protocols
2022-12-11 11:46:53,124 WARN [ProtocolHandlerUtils#83] [main] Protocol handler directory not found
2022-12-11 11:46:53,190 INFO [MetadataDrivers#106] [main] BookKeeper metadata driver manager initialized
2022-12-11 11:46:53,289 INFO [ZKMetadataDriverBase#206] [main] Initialize zookeeper metadata driver at metadata service uri zk+hierarchical://127.0.01:2181/bk1 : zkServers = 127.0.01:2181, ledgersRootPath = /bk1.
2022-12-11 11:46:53,291 INFO [ZooKeeper#637] [main] Initiating client connection, connectString=127.0.01:2181 sessionTimeout=10000 watcher=org.apache.bookkeeper.zookeeper.ZooKeeperWatcherBase@443dbe42
2022-12-11 11:46:53,293 INFO [ClientCnxnSocket#239] [main] jute.maxbuffer value is 1048575 Bytes
2022-12-11 11:46:53,293 INFO [ClientCnxn#1732] [main] zookeeper.request.timeout value is 0. feature enabled=false
2022-12-11 11:46:53,294 INFO [ClientCnxn$SendThread#1171] [main-SendThread(127.0.0.1:2181)] Opening socket connection to server 127.0.0.1/127.0.0.1:2181.
2022-12-11 11:46:53,295 INFO [ClientCnxn$SendThread#1173] [main-SendThread(127.0.0.1:2181)] SASL config status: Will not attempt to authenticate using SASL (unknown error)
2022-12-11 11:46:53,295 INFO [ClientCnxn$SendThread#1005] [main-SendThread(127.0.0.1:2181)] Socket connection established, initiating session, client: /127.0.0.1:54990, server: 127.0.0.1/127.0.0.1:2181
2022-12-11 11:46:53,298 INFO [ClientCnxn$SendThread#1444] [main-SendThread(127.0.0.1:2181)] Session establishment complete on server 127.0.0.1/127.0.0.1:2181, session id = 0x10079cff828001b, negotiated timeout = 10000
2022-12-11 11:46:53,298 INFO [ZooKeeperWatcherBase#130] [main-EventThread] ZooKeeper client is connected now.
2022-12-11 11:46:53,775 INFO [DefaultBookieAddressResolver#62] [main] Cannot resolve 192.168.31.175:13181, bookie is unknown org.apache.bookkeeper.client.BKException$BKBookieHandleNotAvailableException: Bookie handle is not available
2022-12-11 11:46:53,775 INFO [BookieRackAffinityMapping#193] [main] Network address for 192.168.31.175:13181 is unresolvable yet. error is org.apache.bookkeeper.proto.BookieAddressResolver$BookieIdNotResolvedException: Cannot resolve bookieId 192.168.31.175:13181, bookie does not exist or it is not running
2022-12-11 11:46:53,854 WARN [TopologyAwareEnsemblePlacementPolicy$DNSResolverDecorator#567] [main] Failed to resolve network location for 192.168.31.175, using default rack for it : /default-rack.
2022-12-11 11:46:53,855 INFO [RackawareEnsemblePlacementPolicyImpl#216] [main] Initialize rackaware ensemble placement policy @ <Bookie:192.168.31.175:0> @ /default-rack : org.apache.pulsar.bookie.rackawareness.BookieRackAffinityMapping.
2022-12-11 11:46:53,855 INFO [RackawareEnsemblePlacementPolicyImpl#226] [main] Not weighted
2022-12-11 11:46:53,868 INFO [BookKeeper#527] [main] Weighted ledger placement is not enabled
2022-12-11 11:46:53,915 INFO [ZKRegistrationClient#270] [main-EventThread] Update BookieInfoCache (writable bookie) 192.168.31.175:13181 -> BookieServiceInfo{properties={}, endpoints=[EndpointInfo{id=bookie, port=13181, host=192.168.31.175, protocol=bookie-rpc, auth=[], extensions=[]}]}
2022-12-11 11:46:53,934 INFO [NetworkTopologyImpl#428] [BookKeeperClientScheduler-OrderedScheduler-0-0] Adding a new node: /r1/192.168.31.175:13181
2022-12-11 11:46:54,016 INFO [RangeEntryCacheManagerImpl#70] [main] Initialized managed-ledger entry cache of 402.0 Mb
2022-12-11 11:46:54,100 INFO [AuthorizationService#65] [main] org.apache.pulsar.broker.authorization.PulsarAuthorizationProvider has been loaded.
2022-12-11 11:46:54,108 INFO [AuthenticationService#84] [main] Authentication is disabled
2022-12-11 11:46:54,127 INFO [BrokerService#371] [main] Disabling per broker unack-msg blocking due invalid unAckMsgSubscriptionPercentageLimitOnBrokerBlocked 0.16
2022-12-11 11:46:54,937 INFO [PulsarService#1168] [main] Starting name space service, bootstrap namespaces=[]
2022-12-11 11:46:54,987 INFO [ZKMetadataDriverBase#206] [main] Initialize zookeeper metadata driver at metadata service uri zk+hierarchical://127.0.01:2181/bk1 : zkServers = 127.0.01:2181, ledgersRootPath = /bk1.
2022-12-11 11:46:54,988 INFO [ZooKeeper#637] [main] Initiating client connection, connectString=127.0.01:2181 sessionTimeout=10000 watcher=org.apache.bookkeeper.zookeeper.ZooKeeperWatcherBase@34cf5a97
2022-12-11 11:46:54,989 INFO [ClientCnxnSocket#239] [main] jute.maxbuffer value is 1048575 Bytes
2022-12-11 11:46:54,990 INFO [ClientCnxn#1732] [main] zookeeper.request.timeout value is 0. feature enabled=false
2022-12-11 11:46:54,991 INFO [ClientCnxn$SendThread#1171] [main-SendThread(127.0.0.1:2181)] Opening socket connection to server 127.0.0.1/127.0.0.1:2181.
2022-12-11 11:46:54,991 INFO [ClientCnxn$SendThread#1173] [main-SendThread(127.0.0.1:2181)] SASL config status: Will not attempt to authenticate using SASL (unknown error)
2022-12-11 11:46:54,992 INFO [ClientCnxn$SendThread#1005] [main-SendThread(127.0.0.1:2181)] Socket connection established, initiating session, client: /127.0.0.1:54991, server: 127.0.0.1/127.0.0.1:2181
2022-12-11 11:46:54,995 INFO [ClientCnxn$SendThread#1444] [main-SendThread(127.0.0.1:2181)] Session establishment complete on server 127.0.0.1/127.0.0.1:2181, session id = 0x10079cff828001c, negotiated timeout = 10000
2022-12-11 11:46:54,996 INFO [ZooKeeperWatcherBase#130] [main-EventThread] ZooKeeper client is connected now.
2022-12-11 11:46:55,010 INFO [DefaultBookieAddressResolver#62] [main] Cannot resolve 192.168.31.175:13181, bookie is unknown org.apache.bookkeeper.client.BKException$BKBookieHandleNotAvailableException: Bookie handle is not available
2022-12-11 11:46:55,010 INFO [BookieRackAffinityMapping#193] [main] Network address for 192.168.31.175:13181 is unresolvable yet. error is org.apache.bookkeeper.proto.BookieAddressResolver$BookieIdNotResolvedException: Cannot resolve bookieId 192.168.31.175:13181, bookie does not exist or it is not running
2022-12-11 11:46:55,010 WARN [TopologyAwareEnsemblePlacementPolicy$DNSResolverDecorator#567] [main] Failed to resolve network location for 192.168.31.175, using default rack for it : /default-rack.
2022-12-11 11:46:55,011 INFO [RackawareEnsemblePlacementPolicyImpl#216] [main] Initialize rackaware ensemble placement policy @ <Bookie:192.168.31.175:0> @ /default-rack : org.apache.pulsar.bookie.rackawareness.BookieRackAffinityMapping.
2022-12-11 11:46:55,011 INFO [RackawareEnsemblePlacementPolicyImpl#226] [main] Not weighted
2022-12-11 11:46:55,012 INFO [BookKeeper#527] [main] Weighted ledger placement is not enabled
2022-12-11 11:46:55,013 INFO [ZKRegistrationClient#270] [main-EventThread] Update BookieInfoCache (writable bookie) 192.168.31.175:13181 -> BookieServiceInfo{properties={}, endpoints=[EndpointInfo{id=bookie, port=13181, host=192.168.31.175, protocol=bookie-rpc, auth=[], extensions=[]}]}
2022-12-11 11:46:55,014 INFO [NetworkTopologyImpl#428] [BookKeeperClientScheduler-OrderedScheduler-0-0] Adding a new node: /r1/192.168.31.175:13181
2022-12-11 11:46:55,056 INFO [BrokerInterceptorUtils#79] [main] Searching for broker interceptors in D:\opensource\pulsar\.\interceptors
2022-12-11 11:46:55,058 WARN [BrokerInterceptorUtils#83] [main] Pulsar broker interceptors directory not found
2022-12-11 11:46:55,099 INFO [DistributedIdGenerator#55] [main] Broker distributed id generator started with instance id p1-1
2022-12-11 11:46:55,239 INFO [BrokerService#521] [main] Started Pulsar Broker service on /[0:0:0:0:0:0:0:0]:16650, TLS: (none), listener: (none)
2022-12-11 11:46:55,262 INFO [BrokerService#630] [main] Scheduling a thread to check backlog quota after [60] seconds in background
2022-12-11 11:46:55,268 INFO [DispatchRateLimiter#195] [main] configured broker message-dispatch rate DispatchRateImpl(dispatchThrottlingRateInMsg=0, dispatchThrottlingRateInByte=0, relativeToPublishRate=false, ratePeriodInSecond=1)
2022-12-11 11:46:55,269 INFO [DispatchRateLimiter#222] [main] setting message-dispatch-rate DispatchRateImpl(dispatchThrottlingRateInMsg=0, dispatchThrottlingRateInByte=0, relativeToPublishRate=false, ratePeriodInSecond=1)
2022-12-11 11:46:55,308 INFO [Log#170] [main] Logging initialized @5164ms to org.eclipse.jetty.util.log.Slf4jLog
2022-12-11 11:46:55,667 INFO [Server#375] [main] jetty-9.4.48.v20220622; built: 2022-06-21T20:42:25.880Z; git: 6b67c5719d1f4371b33655ff2d047d24e171e49a; jvm 19+37
2022-12-11 11:46:55,701 INFO [DefaultSessionIdManager#334] [main] DefaultSessionIdManager workerName=node0
2022-12-11 11:46:55,701 INFO [DefaultSessionIdManager#339] [main] No SessionScavenger set, using defaults
2022-12-11 11:46:55,704 INFO [HouseKeeper#132] [main] node0 Scavenging every 660000ms
12月 11, 2022 11:46:56 上午 org.glassfish.jersey.server.wadl.WadlFeature configure
警告: JAXBContext implementation could not be found. WADL feature is disabled.
2022-12-11 11:46:56,551 INFO [ContextHandler#921] [main] Started o.e.j.s.ServletContextHandler@aaee2a2{/,null,AVAILABLE}
12月 11, 2022 11:46:56 上午 org.glassfish.jersey.server.wadl.WadlFeature configure
警告: JAXBContext implementation could not be found. WADL feature is disabled.
2022-12-11 11:46:57,392 INFO [ContextHandler#921] [main] Started o.e.j.s.ServletContextHandler@6107165{/admin,null,AVAILABLE}
12月 11, 2022 11:46:57 上午 org.glassfish.jersey.server.wadl.WadlFeature configure
警告: JAXBContext implementation could not be found. WADL feature is disabled.
2022-12-11 11:46:58,189 INFO [ContextHandler#921] [main] Started o.e.j.s.ServletContextHandler@2a32fb6{/admin/v2,null,AVAILABLE}
12月 11, 2022 11:46:58 上午 org.glassfish.jersey.server.wadl.WadlFeature configure
警告: JAXBContext implementation could not be found. WADL feature is disabled.
2022-12-11 11:46:58,453 INFO [ContextHandler#921] [main] Started o.e.j.s.ServletContextHandler@1640c151{/admin/v3,null,AVAILABLE}
12月 11, 2022 11:46:58 上午 org.glassfish.jersey.server.wadl.WadlFeature configure
警告: JAXBContext implementation could not be found. WADL feature is disabled.
2022-12-11 11:46:58,522 INFO [ContextHandler#921] [main] Started o.e.j.s.ServletContextHandler@164a62bf{/lookup,null,AVAILABLE}
12月 11, 2022 11:46:58 上午 org.glassfish.jersey.server.wadl.WadlFeature configure
警告: JAXBContext implementation could not be found. WADL feature is disabled.
2022-12-11 11:46:58,605 INFO [ContextHandler#921] [main] Started o.e.j.s.ServletContextHandler@5d5b5fa7{/topics,null,AVAILABLE}
2022-12-11 11:46:58,606 INFO [ContextHandler#921] [main] Started o.e.j.s.ServletContextHandler@11ebb1b6{/metrics,null,AVAILABLE}
2022-12-11 11:46:58,611 INFO [ContextHandler#921] [main] Started o.e.j.s.h.ContextHandler@f3021cb{/static,null,AVAILABLE}
2022-12-11 11:46:58,629 INFO [AbstractConnector#333] [main] Started ServerConnector@42fcc7e6{HTTP/1.1, (http/1.1)}{0.0.0.0:18080}
2022-12-11 11:46:58,630 INFO [Server#415] [main] Started @8486ms
2022-12-11 11:46:58,630 INFO [WebService#307] [main] HTTP Service started at http://0.0.0.0:18080
2022-12-11 11:46:58,630 INFO [WebService#318] [main] HTTPS Service disabled
2022-12-11 11:46:58,731 INFO [LeaderElectionImpl#183] [main-EventThread] Acquired leadership on /loadbalance/leader
2022-12-11 11:46:58,731 INFO [PulsarService#1080] [main-EventThread] This broker was elected leader
2022-12-11 11:46:58,797 INFO [OwnershipCache#194] [main] Trying to acquire ownership of pulsar/p1/matebook13:18080/0x00000000_0xffffffff
2022-12-11 11:46:58,834 INFO [ResourceLockImpl#166] [main-EventThread] Acquired resource lock on /namespace/pulsar/p1/matebook13:18080/0x00000000_0xffffffff
2022-12-11 11:46:58,836 INFO [OwnershipCache#200] [main-EventThread] Successfully acquired ownership of OwnedBundle(bundle=pulsar/p1/matebook13:18080/0x00000000_0xffffffff, isActive=1)
2022-12-11 11:46:58,840 INFO [PulsarService#1200] [pulsar-2-1] Loading all topics on bundle: pulsar/p1/matebook13:18080/0x00000000_0xffffffff
2022-12-11 11:46:58,840 INFO [NamespaceService#287] [main] added heartbeat namespace name in local cache: ns=pulsar/p1/matebook13:18080
2022-12-11 11:46:58,865 INFO [OwnershipCache#194] [main] Trying to acquire ownership of pulsar/matebook13:18080/0x00000000_0xffffffff
2022-12-11 11:46:58,881 INFO [ResourceLockImpl#166] [main-EventThread] Acquired resource lock on /namespace/pulsar/matebook13:18080/0x00000000_0xffffffff
2022-12-11 11:46:58,881 INFO [OwnershipCache#200] [main-EventThread] Successfully acquired ownership of OwnedBundle(bundle=pulsar/matebook13:18080/0x00000000_0xffffffff, isActive=1)
2022-12-11 11:46:58,882 INFO [PulsarService#1200] [pulsar-2-2] Loading all topics on bundle: pulsar/matebook13:18080/0x00000000_0xffffffff
2022-12-11 11:46:58,882 INFO [NamespaceService#292] [main] added heartbeat namespace name in local cache: ns=pulsar/matebook13:18080
2022-12-11 11:46:58,892 WARN [JvmDefaultGCMetricsLogger#61] [main] Failed to get Runtime bean
java.lang.IllegalAccessException: class org.apache.pulsar.common.stats.JvmDefaultGCMetricsLogger cannot access class sun.management.ManagementFactoryHelper (in module java.management) because module java.management does not export sun.management to unnamed module @35047d03
at jdk.internal.reflect.Reflection.newIllegalAccessException(Reflection.java:420) ~[?:?]
at java.lang.reflect.AccessibleObject.checkAccess(AccessibleObject.java:709) ~[?:?]
at java.lang.reflect.Method.invoke(Method.java:569) ~[?:?]
at org.apache.pulsar.common.stats.JvmDefaultGCMetricsLogger.<clinit>(JvmDefaultGCMetricsLogger.java:51) ~[classes/:?]
at org.apache.pulsar.common.stats.JvmMetrics.create(JvmMetrics.java:74) ~[classes/:?]
at org.apache.pulsar.broker.stats.MetricsGenerator.<init>(MetricsGenerator.java:39) ~[classes/:?]
at org.apache.pulsar.broker.PulsarService.start(PulsarService.java:856) ~[classes/:?]
at org.apache.pulsar.PulsarBrokerStarter$BrokerStarter.start(PulsarBrokerStarter.java:275) ~[classes/:?]
at org.apache.pulsar.PulsarBrokerStarter.main(PulsarBrokerStarter.java:355) ~[classes/:?]
2022-12-11 11:46:58,915 INFO [PulsarService#1178] [main] Starting load management service ...
2022-12-11 11:46:58,947 INFO [ResourceLockImpl#166] [main-EventThread] Acquired resource lock on /loadbalance/brokers/matebook13:18080
2022-12-11 11:46:59,044 INFO [PulsarService#1182] [main] Starting load balancer
2022-12-11 11:46:59,054 INFO [PulsarService#1121] [main] SLA Namespace = sla-monitor/p1/matebook13:18080 doesn't exist.
2022-12-11 11:46:59,082 INFO [PulsarService#905] [main] messaging service is ready, bootstrap_seconds=6, bootstrap service port = 18080, broker url= pulsar://matebook13:16650, cluster=p1, configs=ServiceConfiguration(zookeeperServers=null, metadataStoreUrl=zk:127.0.0.1:2181/p1, globalZookeeperServers=null, configurationStoreServers=null, configurationMetadataStoreUrl=zk:127.0.0.1:2181/p1, brokerServicePort=Optional[16650], brokerServicePortTls=Optional.empty, webServicePort=Optional[18080], webServicePortTls=Optional.empty, webServiceTlsProvider=Conscrypt, webServiceTlsProtocols=[], webServiceTlsCiphers=[], bindAddress=0.0.0.0, advertisedAddress=null, advertisedListeners=null, internalListenerName=null, bindAddresses=null, haProxyProtocolEnabled=false, numAcceptorThreads=1, numIOThreads=16, numOrderedExecutorThreads=8, numHttpServerThreads=16, numExecutorThreadPoolSize=8, numCacheExecutorThreadPoolSize=10, enableBusyWait=false, maxConcurrentHttpRequests=1024, httpServerThreadPool
QueueSize=8192, httpServerAcceptQueueSize=8192, maxHttpServerConnections=2048, delayedDeliveryEnabled=true, delayedDeliveryTrackerFactoryClassName=org.apache.pulsar.broker.delayed.InMemoryDelayedDeliveryTrackerFactory, delayedDeliveryTickTimeMillis=1000, isDelayedDeliveryDeliverAtTimeStrict=false, delayedDeliveryMinIndexCountPerBucket=50000, delayedDeliveryMaxTimeStepPerBucketSnapshotSegmentSeconds=300, delayedDeliveryMaxNumBuckets=50, delayedDeliverySharedIndexEnabled=false, delayedDeliveryFixedDelayDetectionLookahead=50000, acknowledgmentAtBatchIndexLevelEnabled=false, webSocketServiceEnabled=false, isRunningStandalone=false, clusterName=p1, maxTenants=0, failureDomainsEnabled=false, metadataStoreSessionTimeoutMillis=30000, metadataStoreOperationTimeoutSeconds=30, metadataStoreCacheExpirySeconds=300, zooKeeperSessionTimeoutMillis=-1, zooKeeperOperationTimeoutSeconds=-1, zooKeeperCacheExpirySeconds=-1, brokerShutdownTimeoutMs=60000, skipBrokerShutdownOnOOM=false, topicLoadTimeoutSe
conds=60, metadataStoreBatchingEnabled=true, metadataStoreBatchingMaxDelayMillis=5, metadataStoreBatchingMaxOperations=1000, metadataStoreBatchingMaxSizeKb=128, metadataStoreConfigPath=null, metadataSyncEventTopic=null, configurationMetadataSyncEventTopic=null, topicFactoryClassName=null, backlogQuotaCheckEnabled=true, preciseTimeBasedBacklogQuotaCheck=false, backlogQuotaCheckIntervalInSeconds=60, backlogQuotaDefaultLimitGB=-1.0, backlogQuotaDefaultLimitBytes=-1, backlogQuotaDefaultLimitSecond=-1, backlogQuotaDefaultRetentionPolicy=producer_request_hold, ttlDurationDefaultInSeconds=0, brokerDeleteInactiveTopicsEnabled=true, brokerDeleteInactivePartitionedTopicMetadataEnabled=false, brokerDeleteInactiveTopicsFrequencySeconds=60, brokerDeleteInactiveTopicsMode=delete_when_no_subscriptions, brokerDeleteInactiveTopicsMaxInactiveDurationSeconds=60, forceDeleteTenantAllowed=false, forceDeleteNamespaceAllowed=false, maxPendingPublishRequestsPerConnection=1000, messageExpiryCheckIntervalInM
inutes=5, activeConsumerFailoverDelayTimeMillis=1000, subscriptionBacklogScanMaxTimeMs=120000, subscriptionBacklogScanMaxEntries=10000, subscriptionExpirationTimeMinutes=0, subscriptionRedeliveryTrackerEnabled=true, subscriptionExpiryCheckIntervalInMinutes=5, subscriptionTypesEnabled=[Failover, Shared, Key_Shared, Exclusive], subscriptionKeySharedEnable=true, subscriptionKeySharedUseConsistentHashing=true, subscriptionKeySharedConsistentHashingReplicaPoints=100, brokerDeduplicationEnabled=false, brokerDeduplicationMaxNumberOfProducers=10000, brokerDeduplicationSnapshotFrequencyInSeconds=120, brokerDeduplicationSnapshotIntervalSeconds=120, brokerDeduplicationEntriesInterval=1000, brokerDeduplicationProducerInactivityTimeoutMinutes=360, defaultNumberOfNamespaceBundles=4, maxNamespacesPerTenant=0, maxTopicsPerNamespace=0, brokerMaxConnections=0, brokerMaxConnectionsPerIp=0, isAllowAutoUpdateSchemaEnabled=true, autoShrinkForConsumerPendingAcksMap=false, clientLibraryVersionCheckEnabled=
false, statusFilePath=null, maxUnackedMessagesPerConsumer=50000, maxUnackedMessagesPerSubscription=200000, maxUnackedMessagesPerBroker=0, maxUnackedMessagesPerSubscriptionOnBrokerBlocked=0.16, maxConsumerMetadataSize=1024, unblockStuckSubscriptionEnabled=false, topicPublisherThrottlingTickTimeMillis=10, preciseTopicPublishRateLimiterEnable=false, brokerPublisherThrottlingTickTimeMillis=50, brokerPublisherThrottlingMaxMessageRate=0, brokerPublisherThrottlingMaxByteRate=0, dispatchThrottlingRateInMsg=0, dispatchThrottlingRateInByte=0, maxPublishRatePerTopicInMessages=0, maxPublishRatePerTopicInBytes=0, subscribeThrottlingRatePerConsumer=0, subscribeRatePeriodPerConsumerInSecond=30, dispatchThrottlingRatePerTopicInMsg=0, dispatchThrottlingRatePerTopicInByte=0, dispatchThrottlingOnBatchMessageEnabled=false, dispatchThrottlingRatePerSubscriptionInMsg=0, dispatchThrottlingRatePerSubscriptionInByte=0, dispatchThrottlingRatePerReplicatorInMsg=0, dispatchThrottlingRatePerReplicatorInByte=0,
dispatchThrottlingRateRelativeToPublishRate=false, dispatchThrottlingOnNonBacklogConsumerEnabled=true, resourceUsageTransportClassName=, resourceUsageTransportPublishIntervalInSecs=60, enableBrokerSideSubscriptionPatternEvaluation=true, subscriptionPatternMaxLength=50, dispatcherMaxReadBatchSize=100, dispatcherDispatchMessagesInSubscriptionThread=true, dispatchThrottlingForFilteredEntriesEnabled=false, dispatcherMaxReadSizeBytes=5242880, dispatcherMinReadBatchSize=1, dispatcherReadFailureBackoffInitialTimeInMs=15000, dispatcherReadFailureBackoffMaxTimeInMs=60000, dispatcherReadFailureBackoffMandatoryStopTimeInMs=0, dispatcherEntryFilterRescheduledMessageDelay=1000, dispatcherMaxRoundRobinBatchSize=20, preciseDispatcherFlowControl=false, entryFilterNames=[], entryFiltersDirectory=, allowOverrideEntryFilters=false, streamingDispatch=false, maxConcurrentLookupRequest=50000, maxConcurrentTopicLoadRequest=5000, maxConcurrentNonPersistentMessagePerConnection=1000, numWorkerThreadsForNonPe
rsistentTopic=8, enablePersistentTopics=true, enableNonPersistentTopics=false, enableRunBookieTogether=false, enableRunBookieAutoRecoveryTogether=false, maxProducersPerTopic=0, maxSameAddressProducersPerTopic=0, encryptionRequireOnProducer=false, maxConsumersPerTopic=0, maxSameAddressConsumersPerTopic=0, maxSubscriptionsPerTopic=0, maxConsumersPerSubscription=0, maxMessageSize=5242880, enableReplicatedSubscriptions=true, replicatedSubscriptionsSnapshotFrequencyMillis=1000, replicatedSubscriptionsSnapshotTimeoutSeconds=30, replicatedSubscriptionsSnapshotMaxCachedPerSubscription=10, maxMessagePublishBufferSizeInMB=1005, messagePublishBufferCheckIntervalInMillis=100, lazyCursorRecovery=false, retentionCheckIntervalInSeconds=120, maxNumPartitionsPerPartitionedTopic=0, brokerInterceptorsDirectory=./interceptors, brokerInterceptors=[], disableBrokerInterceptors=true, brokerEntryPayloadProcessors=[], zookeeperSessionExpiredPolicy=reconnect, topicFencingTimeoutSeconds=0, protocolHandlerDire
ctory=./protocols, useSeparateThreadPoolForProtocolHandlers=true, messagingProtocols=[], systemTopicEnabled=true, systemTopicSchemaCompatibilityStrategy=ALWAYS_COMPATIBLE, topicLevelPoliciesEnabled=true, brokerEntryMetadataInterceptors=[], exposingBrokerEntryMetadataToClientEnabled=false, enableNamespaceIsolationUpdateOnTime=false, strictBookieAffinityEnabled=false, tlsEnabled=false, tlsCertRefreshCheckDurationSec=300, tlsCertificateFilePath=null, tlsKeyFilePath=null, tlsTrustCertsFilePath=, tlsAllowInsecureConnection=false, tlsProtocols=[], tlsCiphers=[], tlsRequireTrustedClientCertOnConnect=false, authenticationEnabled=false, authenticationProviders=[], authenticationRefreshCheckSeconds=60, authorizationEnabled=false, authorizationProvider=org.apache.pulsar.broker.authorization.PulsarAuthorizationProvider, superUserRoles=[], proxyRoles=[], authenticateOriginalAuthData=false, authorizationAllowWildcardsMatching=false, anonymousUserRole=null, httpMaxRequestSize=-1, disableHttpDebugM
ethods=false, httpRequestsLimitEnabled=false, httpRequestsMaxPerSecond=100.0, httpRequestsFailOnUnknownPropertiesEnabled=false, saslJaasClientAllowedIds=.*pulsar.*, saslJaasServerSectionName=PulsarBroker, saslJaasServerRoleTokenSignerSecretPath=null, kinitCommand=/usr/bin/kinit, bookkeeperMetadataServiceUri=zk+hierarchical://127.0.01:2181/bk1, bookkeeperClientAuthenticationPlugin=null, bookkeeperClientAuthenticationParametersName=null, bookkeeperClientAuthenticationParameters=null, bookkeeperClientTimeoutInSeconds=30, bookkeeperClientSpeculativeReadTimeoutInMillis=0, bookkeeperNumberOfChannelsPerBookie=16, bookkeeperUseV2WireProtocol=true, bookkeeperClientHealthCheckEnabled=true, bookkeeperClientHealthCheckIntervalSeconds=60, bookkeeperClientHealthCheckErrorThresholdPerInterval=5, bookkeeperClientHealthCheckQuarantineTimeInSeconds=1800, bookkeeperClientQuarantineRatio=1.0, bookkeeperClientRackawarePolicyEnabled=true, bookkeeperClientRegionawarePolicyEnabled=false, bookkeeperClientMi
nNumRacksPerWriteQuorum=2, bookkeeperClientEnforceMinNumRacksPerWriteQuorum=false, bookkeeperClientReorderReadSequenceEnabled=false, bookkeeperClientIsolationGroups=null, bookkeeperClientSecondaryIsolationGroups=null, bookkeeperClientGetBookieInfoIntervalSeconds=86400, bookkeeperClientGetBookieInfoRetryIntervalSeconds=60, bookkeeperEnableStickyReads=true, bookkeeperTLSProviderFactoryClass=org.apache.bookkeeper.tls.TLSContextFactory, bookkeeperTLSClientAuthentication=false, bookkeeperTLSKeyFileType=PEM, bookkeeperTLSTrustCertTypes=PEM, bookkeeperTLSKeyStorePasswordPath=null, bookkeeperTLSTrustStorePasswordPath=null, bookkeeperTLSKeyFilePath=null, bookkeeperTLSCertificateFilePath=null, bookkeeperTLSTrustCertsFilePath=null, bookkeeperTlsCertFilesRefreshDurationSeconds=300, bookkeeperDiskWeightBasedPlacementEnabled=false, bookkeeperExplicitLacIntervalInMills=0, bookkeeperClientExposeStatsToPrometheus=false, bookkeeperClientThrottleValue=0, bookkeeperClientNumWorkerThreads=8, bookkeeperC
lientNumIoThreads=16, bookkeeperClientSeparatedIoThreadsEnabled=false, managedLedgerDefaultEnsembleSize=2, managedLedgerDefaultWriteQuorum=2, managedLedgerDefaultAckQuorum=2, managedLedgerCursorPositionFlushSeconds=60, managedLedgerStatsPeriodSeconds=60, managedLedgerDigestType=CRC32C, managedLedgerMaxEnsembleSize=5, managedLedgerMaxWriteQuorum=5, managedLedgerMaxAckQuorum=5, managedLedgerCacheSizeMB=402, managedLedgerCacheCopyEntries=false, managedLedgerMaxReadsInFlightSizeInMB=0, managedLedgerCacheEvictionWatermark=0.9, managedLedgerCacheEvictionFrequency=0.0, managedLedgerCacheEvictionIntervalMs=10, managedLedgerCacheEvictionTimeThresholdMillis=1000, managedLedgerCursorBackloggedThreshold=1000, managedLedgerDefaultMarkDeleteRateLimit=1.0, allowAutoTopicCreation=true, allowAutoTopicCreationType=partitioned, allowAutoSubscriptionCreation=true, defaultNumPartitions=1, managedLedgerStorageClassName=org.apache.pulsar.broker.ManagedLedgerClientFactory, managedLedgerNumSchedulerThreads=
8, managedLedgerMaxEntriesPerLedger=50000, managedLedgerMinLedgerRolloverTimeMinutes=10, managedLedgerMaxLedgerRolloverTimeMinutes=240, managedLedgerMaxSizePerLedgerMbytes=2048, managedLedgerOffloadDeletionLagMs=14400000, managedLedgerOffloadAutoTriggerSizeThresholdBytes=-1, managedLedgerOffloadThresholdInSeconds=-1, managedLedgerCursorMaxEntriesPerLedger=50000, managedLedgerCursorRolloverTimeInSeconds=14400, managedLedgerMaxUnackedRangesToPersist=10000, persistentUnackedRangesWithMultipleEntriesEnabled=false, managedLedgerMaxUnackedRangesToPersistInZooKeeper=-1, managedLedgerMaxUnackedRangesToPersistInMetadataStore=1000, managedLedgerUnackedRangesOpenCacheSetEnabled=true, autoSkipNonRecoverableData=false, managedLedgerMetadataOperationsTimeoutSeconds=60, managedLedgerReadEntryTimeoutSeconds=0, managedLedgerAddEntryTimeoutSeconds=0, managedLedgerPrometheusStatsLatencyRolloverSeconds=60, managedLedgerTraceTaskExecution=true, managedLedgerNewEntriesCheckDelayInMillis=10, managedLedger
DataReadPriority=tiered-storage-first, managedLedgerInfoCompressionType=NONE, managedCursorInfoCompressionType=NONE, managedLedgerMinimumBacklogCursorsForCaching=0, managedLedgerMinimumBacklogEntriesForCaching=1000, managedLedgerMaxBacklogBetweenCursorsForCaching=1000, loadBalancerEnabled=true, loadBalancerPlacementStrategy=leastLoadedServer, loadBalancerLoadSheddingStrategy=org.apache.pulsar.broker.loadbalance.impl.ThresholdShedder, lowerBoundarySheddingEnabled=false, loadBalancerLoadPlacementStrategy=org.apache.pulsar.broker.loadbalance.impl.LeastLongTermMessageRate, loadBalancerReportUpdateThresholdPercentage=10, loadBalancerReportUpdateMinIntervalMillis=5000, loadBalancerReportUpdateMaxIntervalMinutes=15, loadBalancerHostUsageCheckIntervalMinutes=1, loadBalancerSheddingEnabled=true, loadBalancerSheddingIntervalMinutes=1, loadBalancerDistributeBundlesEvenlyEnabled=true, loadBalancerSheddingGracePeriodMinutes=30, loadBalancerBrokerUnderloadedThresholdPercentage=50, loadBalancerBro
kerMaxTopics=50000, loadBalancerBrokerOverloadedThresholdPercentage=85, loadBalancerBrokerThresholdShedderPercentage=10, loadBalancerAverageResourceUsageDifferenceThresholdPercentage=10, flowOrQpsDifferenceThresholdPercentage=10, minUnloadMessage=1000, minUnloadMessageThroughput=1048576, maxUnloadPercentage=0.2, loadBalancerMsgRateDifferenceShedderThreshold=50.0, loadBalancerMsgThroughputMultiplierDifferenceShedderThreshold=4.0, maxUnloadBundleNumPerShedding=-1, loadBalancerHistoryResourcePercentage=0.9, loadBalancerBandwithInResourceWeight=1.0, loadBalancerBandwithOutResourceWeight=1.0, loadBalancerCPUResourceWeight=1.0, loadBalancerMemoryResourceWeight=1.0, loadBalancerDirectMemoryResourceWeight=1.0, loadBalancerBundleUnloadMinThroughputThreshold=10.0, loadBalancerResourceQuotaUpdateIntervalMinutes=15, loadBalancerBrokerComfortLoadLevelPercentage=65, loadBalancerAutoBundleSplitEnabled=true, loadBalancerAutoUnloadSplitBundlesEnabled=true, loadBalancerNamespaceBundleMaxTopics=1000,
loadBalancerNamespaceBundleMaxSessions=1000, loadBalancerNamespaceBundleMaxMsgRate=30000, loadBalancerNamespaceBundleMaxBandwidthMbytes=100, loadBalancerNamespaceMaximumBundles=128, loadManagerClassName=org.apache.pulsar.broker.loadbalance.impl.ModularLoadManagerImpl, supportedNamespaceBundleSplitAlgorithms=[range_equally_divide, topic_count_equally_divide, specified_positions_divide, flow_or_qps_equally_divide], defaultNamespaceBundleSplitAlgorithm=range_equally_divide, loadBalancerOverrideBrokerNicSpeedGbps=Optional.empty, namespaceBundleUnloadingTimeoutMs=60000, replicationMetricsEnabled=true, replicationConnectionsPerBroker=16, replicatorPrefix=pulsar.repl, replicationProducerQueueSize=1000, replicationPolicyCheckDurationSeconds=600, replicationTlsEnabled=false, defaultRetentionTimeInMinutes=0, defaultRetentionSizeInMB=0, keepAliveIntervalSeconds=30, brokerServicePurgeInactiveFrequencyInSeconds=60, bootstrapNamespaces=[], preferLaterVersions=false, brokerServiceCompactionMonitor
IntervalInSeconds=60, brokerServiceCompactionThresholdInBytes=0, brokerServiceCompactionPhaseOneLoopTimeInSeconds=30, clusterMigrationCheckDurationSeconds=0, isSchemaValidationEnforced=false, schemaRegistryStorageClassName=org.apache.pulsar.broker.service.schema.BookkeeperSchemaStorageFactory, schemaRegistryCompatibilityCheckers=[org.apache.pulsar.broker.service.schema.ProtobufNativeSchemaCompatibilityCheck, org.apache.pulsar.broker.service.schema.JsonSchemaCompatibilityCheck, org.apache.pulsar.broker.service.schema.AvroSchemaCompatibilityCheck], schemaCompatibilityStrategy=FULL, webSocketNumIoThreads=8, webSocketNumServiceThreads=20, webSocketConnectionsPerBroker=8, webSocketSessionIdleTimeoutMillis=300000, webSocketMaxTextFrameSize=1048576, authenticateMetricsEndpoint=false, exposeTopicLevelMetricsInPrometheus=true, metricsBufferResponse=false, exposeConsumerLevelMetricsInPrometheus=false, exposeProducerLevelMetricsInPrometheus=false, exposeManagedLedgerMetricsInPrometheus=true, e
xposeManagedCursorMetricsInPrometheus=false, jvmGCMetricsLoggerClassName=null, exposePreciseBacklogInPrometheus=false, metricsServletTimeoutMs=30000, exposeSubscriptionBacklogSizeInPrometheus=false, splitTopicAndPartitionLabelInPrometheus=false, exposeBundlesMetricsInPrometheus=false, functionsWorkerEnabled=false, functionsWorkerServiceNarPackage=, functionsWorkerEnablePackageManagement=false, exposePublisherStats=true, statsUpdateFrequencyInSecs=60, statsUpdateInitialDelayInSecs=60, aggregatePublisherStatsByProducerName=false, offloadersDirectory=./offloaders, managedLedgerOffloadDriver=null, managedLedgerOffloadMaxThreads=2, narExtractionDirectory=C:\Users\lin\AppData\Local\Temp\, managedLedgerOffloadPrefetchRounds=1, managedLedgerInactiveLedgerRolloverTimeSeconds=0, cacheEvictionByMarkDeletedPosition=false, transactionCoordinatorEnabled=false, transactionMetadataStoreProviderClassName=org.apache.pulsar.transaction.coordinator.impl.MLTransactionMetadataStoreProvider, transactionBu
fferProviderClassName=org.apache.pulsar.broker.transaction.buffer.impl.TopicTransactionBufferProvider, transactionPendingAckStoreProviderClassName=org.apache.pulsar.broker.transaction.pendingack.impl.MLPendingAckStoreProvider, numTransactionReplayThreadPoolSize=8, transactionBufferSnapshotMaxTransactionCount=1000, transactionBufferSnapshotMinTimeInMillis=5000, transactionBufferSnapshotSegmentSize=262144, transactionBufferSegmentedSnapshotEnabled=false, transactionBufferClientMaxConcurrentRequests=1000, transactionBufferClientOperationTimeoutInMills=3000, maxActiveTransactionsPerCoordinator=0, transactionPendingAckLogIndexMinLag=500, transactionLogBatchedWriteEnabled=false, transactionLogBatchedWriteMaxRecords=512, transactionLogBatchedWriteMaxSize=4194304, transactionLogBatchedWriteMaxDelayInMillis=1, transactionPendingAckBatchedWriteEnabled=false, transactionPendingAckBatchedWriteMaxRecords=512, transactionPendingAckBatchedWriteMaxSize=4194304, transactionPendingAckBatchedWriteMaxD
elayInMillis=1, tlsEnabledWithKeyStore=false, tlsProvider=null, tlsKeyStoreType=JKS, tlsKeyStore=null, tlsTrustStoreType=JKS, tlsTrustStore=null, brokerClientAuthenticationPlugin=org.apache.pulsar.client.impl.auth.AuthenticationDisabled, brokerClientAuthenticationParameters=, brokerClientTlsEnabled=false, brokerClientTlsEnabledWithKeyStore=false, brokerClientSslProvider=null, brokerClientTrustCertsFilePath=, brokerClientKeyFilePath=, brokerClientCertificateFilePath=, brokerClientTlsTrustStoreType=JKS, brokerClientTlsTrustStore=null, brokerClientTlsKeyStoreType=JKS, brokerClientTlsKeyStore=null, brokerClientTlsCiphers=[], brokerClientTlsProtocols=[], enablePackagesManagement=false, packagesManagementStorageProvider=org.apache.pulsar.packages.management.storage.bookkeeper.BookKeeperPackagesStorageProvider, packagesReplicas=1, packagesManagementLedgerRootPath=/ledgers, additionalServletDirectory=./brokerAdditionalServlet, additionalServlets=[])
2022-12-11 11:46:59,313 INFO [PulsarBrokerStarter$BrokerStarter#276] [main] PulsarService started.
2022-12-11 11:47:58,745 INFO [ModularLoadManagerImpl#640] [pulsar-load-manager-1-1] Only 1 broker available: no load shedding will be performed
2022-12-11 11:48:58,757 INFO [ModularLoadManagerImpl#640] [pulsar-load-manager-1-1] Only 1 broker available: no load shedding will be performed
2022-12-11 11:49:58,769 INFO [ModularLoadManagerImpl#640] [pulsar-load-manager-1-1] Only 1 broker available: no load shedding will be performed
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] hangc0276 commented on issue #18834: [Bug] cannot get the right rack info since the 2.10 version
Posted by GitBox <gi...@apache.org>.
hangc0276 commented on issue #18834:
URL: https://github.com/apache/pulsar/issues/18834#issuecomment-1344149318
@horizonzy Would you please help take a look? thanks.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] horizonzy commented on issue #18834: [Bug] cannot get the right rack info since the 2.10 version
Posted by GitBox <gi...@apache.org>.
horizonzy commented on issue #18834:
URL: https://github.com/apache/pulsar/issues/18834#issuecomment-1344289002
@yangl Hi, did you set the rack info firstly, then start the bookie servers?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] yangl commented on issue #18834: [Bug] cannot get the right rack info since the 2.10 version
Posted by GitBox <gi...@apache.org>.
yangl commented on issue #18834:
URL: https://github.com/apache/pulsar/issues/18834#issuecomment-1344932778
> @yangl Hi, did you set the rack info first, then start the bookie servers?
Either start the bookie server first or set the rack info first, the 2.10 and the master version cannot get the right rack;
when reconfig the rack info by the `set-bookie-rack -b bookie13:3181 -g futian -r /FT --hostname bookie13:3181
` commond, the broker log print the right rack info, but after a while the rack become the default again.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] horizonzy commented on issue #18834: [Bug] cannot get the right rack info since the 2.10 version
Posted by GitBox <gi...@apache.org>.
horizonzy commented on issue #18834:
URL: https://github.com/apache/pulsar/issues/18834#issuecomment-1345443362
Sorry, miss the link. https://github.com/apache/pulsar/pull/18672
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] yangl commented on issue #18834: [Bug] cannot get the right rack info since the 2.10 version
Posted by GitBox <gi...@apache.org>.
yangl commented on issue #18834:
URL: https://github.com/apache/pulsar/issues/18834#issuecomment-1345731020
> > LGTM, but the rack first was default, caused by the resultFromCache is null. may be the else logic should init first？
>
> We can't init it firstly, the `resultFromCache` is added by zk event. If means the currently available bookies. Only after bookies change event, then to refresh the rack info.
OK, thanks.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] yangl commented on issue #18834: [Bug] cannot get the right rack info since the 2.10 version
Posted by GitBox <gi...@apache.org>.
yangl commented on issue #18834:
URL: https://github.com/apache/pulsar/issues/18834#issuecomment-1344145990
may be introduced by https://github.com/apache/pulsar/pull/17922
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org