You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pulsar.apache.org by GitBox <gi...@apache.org> on 2021/01/04 09:47:18 UTC
[GitHub] [pulsar] xiaotongwang1 opened a new issue #9114: org.apache.bookkeeper.client.LedgerHandle - ReadException on ledgerId
xiaotongwang1 opened a new issue #9114:
URL: https://github.com/apache/pulsar/issues/9114
so many error log in pulsar broker log ,when i test message producer and consumer ,but i still can send and receive message
17:39:00.847 [pulsar-io-26-11] ERROR org.apache.bookkeeper.client.LedgerHandle - ReadException on ledgerId:24 firstEntry:139 lastEntry:139
17:39:02.150 [pulsar-io-26-11] ERROR org.apache.bookkeeper.client.LedgerHandle - ReadException on ledgerId:24 firstEntry:140 lastEntry:140
17:39:02.860 [pulsar-io-26-11] ERROR org.apache.bookkeeper.client.LedgerHandle - ReadException on ledgerId:24 firstEntry:141 lastEntry:141
17:39:03.936 [pulsar-io-26-11] ERROR org.apache.bookkeeper.client.LedgerHandle - ReadException on ledgerId:24 firstEntry:142 lastEntry:142
17:39:04.877 [pulsar-io-26-11] ERROR org.apache.bookkeeper.client.LedgerHandle - ReadException on ledgerId:24 firstEntry:143 lastEntry:143
17:39:05.800 [pulsar-io-26-11] ERROR org.apache.bookkeeper.client.LedgerHandle - ReadException on ledgerId:24 firstEntry:144 lastEntry:144
17:39:06.916 [pulsar-io-26-11] ERROR org.apache.bookkeeper.client.LedgerHandle - ReadException on ledgerId:24 firstEntry:145 lastEntry:145
17:39:07.877 [pulsar-io-26-11] ERROR org.apache.bookkeeper.client.LedgerHandle - ReadException on ledgerId:24 firstEntry:146 lastEntry:146
17:39:08.842 [pulsar-io-26-11] ERROR org.apache.bookkeeper.client.LedgerHandle - ReadException on ledgerId:24 firstEntry:147 lastEntry:147
17:39:09.860 [pulsar-io-26-11] ERROR org.apache.bookkeeper.client.LedgerHandle - ReadException on ledgerId:24 firstEntry:148 lastEntry:148
17:39:10.874 [pulsar-io-26-11] ERROR org.apache.bookkeeper.client.LedgerHandle - ReadException on ledgerId:24 firstEntry:149 lastEntry:149
17:39:11.783 [pulsar-io-26-11] ERROR org.apache.bookkeeper.client.LedgerHandle - ReadException on ledgerId:25 firstEntry:158 lastEntry:158
17:39:12.796 [pulsar-io-26-11] ERROR org.apache.bookkeeper.client.LedgerHandle - ReadException on ledgerId:25 firstEntry:159 lastEntry:159
17:39:13.811 [pulsar-io-26-11] ERROR org.apache.bookkeeper.client.LedgerHandle - ReadException on ledgerId:25 firstEntry:160 lastEntry:160
17:39:14.826 [pulsar-io-26-11] ERROR org.apache.bookkeeper.client.LedgerHandle - ReadException on ledgerId:25 firstEntry:161 lastEntry:161
17:39:15.837 [pulsar-io-26-11] ERROR org.apache.bookkeeper.client.LedgerHandle - ReadException on ledgerId:25 firstEntry:162 lastEntry:162
17:39:16.853 [pulsar-io-26-11] ERROR org.apache.bookkeeper.client.LedgerHandle - ReadException on ledgerId:25 firstEntry:163 lastEntry:163
17:39:17.879 [pulsar-io-26-11] ERROR org.apache.bookkeeper.client.LedgerHandle - ReadException on ledgerId:25 firstEntry:164 lastEntry:164
17:39:19.108 [pulsar-io-26-11] ERROR org.apache.bookkeeper.client.LedgerHandle - ReadException on ledgerId:25 firstEntry:165 lastEntry:165
17:39:19.980 [pulsar-io-26-11] ERROR org.apache.bookkeeper.client.LedgerHandle - ReadException on ledgerId:25 firstEntry:166 lastEntry:166
17:39:20.919 [pulsar-io-26-11] ERROR org.apache.bookkeeper.client.LedgerHandle - ReadException on ledgerId:25 firstEntry:167 lastEntry:167
17:39:21.833 [pulsar-io-26-11] ERROR org.apache.bookkeeper.client.LedgerHandle - ReadException on ledgerId:25 firstEntry:168 lastEntry:168
17:39:23.025 [pulsar-io-26-11] ERROR org.apache.bookkeeper.client.LedgerHandle - ReadException on ledgerId:25 firstEntry:169 lastEntry:169
17:39:23.865 [pulsar-io-26-11] ERROR org.apache.bookkeeper.client.LedgerHandle - ReadException on ledgerId:25 firstEntry:170 lastEntry:170
17:39:24.993 [pulsar-io-26-11] ERROR org.apache.bookkeeper.client.LedgerHandle - ReadException on ledgerId:25 firstEntry:171 lastEntry:171
17:39:25.893 [pulsar-io-26-11] ERROR org.apache.bookkeeper.client.LedgerHandle - ReadException on ledgerId:25 firstEntry:172 lastEntry:172
17:39:26.821 [pulsar-io-26-17] ERROR org.apache.bookkeeper.client.LedgerHandle - ReadException on ledgerId:26 firstEntry:157 lastEntry:157
17:39:27.828 [pulsar-io-26-17] ERROR org.apache.bookkeeper.client.LedgerHandle - ReadException on ledgerId:26 firstEntry:158 lastEntry:158
17:39:28.840 [pulsar-io-26-17] ERROR org.apache.bookkeeper.client.LedgerHandle - ReadException on ledgerId:26 firstEntry:159 lastEntry:159
17:39:29.851 [pulsar-io-26-17] ERROR org.apache.bookkeeper.client.LedgerHandle - ReadException on ledgerId:26 firstEntry:160 lastEntry:160
17:39:30.866 [pulsar-io-26-17] ERROR org.apache.bookkeeper.client.LedgerHandle - ReadException on ledgerId:26 firstEntry:161 lastEntry:161
17:39:31.882 [pulsar-io-26-17] ERROR org.apache.bookkeeper.client.LedgerHandle - ReadException on ledgerId:26 firstEntry:162 lastEntry:162
17:39:32.895 [pulsar-io-26-17] ERROR org.apache.bookkeeper.client.LedgerHandle - ReadException on ledgerId:26 firstEntry:163 lastEntry:163
17:39:33.813 [pulsar-io-26-17] ERROR org.apache.bookkeeper.client.LedgerHandle - ReadException on ledgerId:26 firstEntry:164 lastEntry:164
17:39:34.835 [pulsar-io-26-17] ERROR org.apache.bookkeeper.client.LedgerHandle - ReadException on ledgerId:26 firstEntry:165 lastEntry:165
17:39:35.968 [pulsar-io-26-17] ERROR org.apache.bookkeeper.client.LedgerHandle - ReadException on ledgerId:26 firstEntry:166 lastEntry:166
17:39:36.847 [pulsar-io-26-17] ERROR org.apache.bookkeeper.client.LedgerHandle - ReadException on ledgerId:26 firstEntry:167 lastEntry:167
17:39:37.882 [pulsar-io-26-17] ERROR org.apache.bookkeeper.client.LedgerHandle - ReadException on ledgerId:26 firstEntry:168 lastEntry:168
17:39:39.884 [pulsar-io-26-17] ERROR org.apache.bookkeeper.client.LedgerHandle - ReadException on ledgerId:26 firstEntry:170 lastEntry:170
17:39:40.891 [pulsar-io-26-17] ERROR org.apache.bookkeeper.client.LedgerHandle - ReadException on ledgerId:26 firstEntry:171 lastEntry:171
17:39:41.803 [pulsar-io-26-17] ERROR org.apache.bookkeeper.client.LedgerHandle - ReadException on ledgerId:26 firstEntry:172 lastEntry:172
17:40:12.927 [pulsar-io-26-11] ERROR org.apache.bookkeeper.client.LedgerHandle - ReadException on ledgerId:24 firstEntry:150 lastEntry:150
17:40:13.841 [pulsar-io-26-11] ERROR org.apache.bookkeeper.client.LedgerHandle - ReadException on ledgerId:24 firstEntry:151 lastEntry:151
17:40:14.855 [pulsar-io-26-11] ERROR org.apache.bookkeeper.client.LedgerHandle - ReadException on ledgerId:24 firstEntry:152 lastEntry:152
17:40:15.869 [pulsar-io-26-11] ERROR org.apache.bookkeeper.client.LedgerHandle - ReadException on ledgerId:24 firstEntry:153 lastEntry:153
17:40:16.886 [pulsar-io-26-11] ERROR org.apache.bookkeeper.client.LedgerHandle - ReadException on ledgerId:24 firstEntry:154 lastEntry:154
17:40:17.903 [pulsar-io-26-11] ERROR org.apache.bookkeeper.client.LedgerHandle - ReadException on ledgerId:24 firstEntry:155 lastEntry:155
17:40:18.916 [pulsar-io-26-11] ERROR org.apache.bookkeeper.client.LedgerHandle - ReadException on ledgerId:24 firstEntry:156 lastEntry:156
17:40:19.827 [pulsar-io-26-11] ERROR org.apache.bookkeeper.client.LedgerHandle - ReadException on ledgerId:24 firstEntry:157 lastEntry:157
17:40:20.844 [pulsar-io-26-11] ERROR org.apache.bookkeeper.client.LedgerHandle - ReadException on ledgerId:24 firstEntry:158 lastEntry:158
17:40:21.860 [pulsar-io-26-11] ERROR org.apache.bookkeeper.client.LedgerHandle - ReadException on ledgerId:24 firstEntry:159 lastEntry:159
17:40:22.872 [pulsar-io-26-11] ERROR org.apache.bookkeeper.client.LedgerHandle - ReadException on ledgerId:24 firstEntry:160 lastEntry:160
17:40:23.887 [pulsar-io-26-11] ERROR org.apache.bookkeeper.client.LedgerHandle - ReadException on ledgerId:24 firstEntry:161 lastEntry:161
17:40:24.904 [pulsar-io-26-11] ERROR org.apache.bookkeeper.client.LedgerHandle - ReadException on ledgerId:24 firstEntry:162 lastEntry:162
17:40:25.918 [pulsar-io-26-11] ERROR org.apache.bookkeeper.client.LedgerHandle - ReadException on ledgerId:24 firstEntry:163 lastEntry:163
17:40:26.948 [pulsar-io-26-11] ERROR org.apache.bookkeeper.client.LedgerHandle - ReadException on ledgerId:24 firstEntry:164 lastEntry:164
17:40:27.956 [pulsar-io-26-11] ERROR org.apache.bookkeeper.client.LedgerHandle - ReadException on ledgerId:24 firstEntry:165 lastEntry:165
17:40:28.882 [pulsar-io-26-11] ERROR org.apache.bookkeeper.client.LedgerHandle - ReadException on ledgerId:24 firstEntry:166 lastEntry:166
17:40:29.896 [pulsar-io-26-11] ERROR org.apache.bookkeeper.client.LedgerHandle - ReadException on ledgerId:24 firstEntry:167 lastEntry:167
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] xiaotongwang1 commented on issue #9114: org.apache.bookkeeper.client.LedgerHandle - ReadException on ledgerId
Posted by GitBox <gi...@apache.org>.
xiaotongwang1 commented on issue #9114:
URL: https://github.com/apache/pulsar/issues/9114#issuecomment-761963805
2021-01-18 11:25:30.413 [pulsar-io-26-1] ERROR org.apache.bookkeeper.client.LedgerHandle - ReadException on ledgerId:67 firstEntry:181 lastEntry:181
......
2021-01-18 11:26:41.414 [pulsar-io-26-1] ERROR org.apache.bookkeeper.client.LedgerHandle - ReadException on ledgerId:67 firstEntry:186 lastEntry:186
@sijie what does this error mean ? does it mean log ledgerId:67 Entry:186 cannot be consumed?
i check it with ./bookkeeper shell ledger 67 in bookie
entry 0 : (log: 2, pos: 6217)
entry 1 : (log: 2, pos: 6325)
entry 2 : (log: 2, pos: 6433)
entry 3 : (log: 2, pos: 6541)
entry 4 : (log: 2, pos: 6649)
entry 5 : (log: 2, pos: 6757)
entry 6 : (log: 2, pos: 6865)
entry 7 : (log: 2, pos: 6973)
entry 8 : (log: 2, pos: 7081)
entry 9 : (log: 2, pos: 7189)
entry 10 : (log: 2, pos: 7297)
entry 11 : (log: 2, pos: 7405)
entry 12 : (log: 2, pos: 7513)
entry 13 : (log: 2, pos: 7621)
entry 14 : (log: 2, pos: 7729)
entry 15 : (log: 2, pos: 7837)
entry 16 : (log: 2, pos: 7945)
entry 17 : (log: 2, pos: 8053)
entry 18 : (log: 2, pos: 8161)
entry 19 : (log: 2, pos: 15220)
entry 20 : (log: 2, pos: 15328)
entry 21 : (log: 2, pos: 15436)
entry 22 : (log: 2, pos: 15544)
entry 23 : (log: 2, pos: 15652)
entry 24 : (log: 2, pos: 15760)
entry 25 : (log: 2, pos: 15868)
entry 26 : (log: 2, pos: 15976)
entry 27 : (log: 2, pos: 16084)
entry 28 : (log: 2, pos: 16192)
entry 29 : (log: 2, pos: 16300)
entry 30 : (log: 2, pos: 16408)
entry 31 : (log: 2, pos: 16516)
entry 32 : (log: 2, pos: 16624)
entry 33 : (log: 2, pos: 16732)
entry 34 : (log: 2, pos: 16840)
entry 35 : (log: 2, pos: 16948)
entry 36 : (log: 2, pos: 17056)
entry 37 : (log: 2, pos: 17164)
entry 38 : (log: 2, pos: 17272)
entry 39 : (log: 2, pos: 17380)
entry 40 : (log: 2, pos: 17488)
entry 41 : (log: 2, pos: 17596)
entry 42 : (log: 2, pos: 17704)
entry 43 : (log: 2, pos: 17812)
entry 44 : (log: 2, pos: 21927)
entry 45 : (log: 2, pos: 22035)
entry 46 : (log: 2, pos: 22143)
entry 47 : (log: 2, pos: 22251)
entry 48 : (log: 2, pos: 22359)
entry 49 : (log: 2, pos: 22467)
entry 50 : (log: 2, pos: 22575)
entry 51 : (log: 2, pos: 22683)
entry 52 : (log: 2, pos: 25782)
entry 53 : (log: 2, pos: 25890)
entry 54 : (log: 2, pos: 25998)
entry 55 : (log: 2, pos: 26106)
entry 56 : (log: 2, pos: 26214)
entry 57 : (log: 2, pos: 26322)
entry 58 : (log: 2, pos: 26430)
entry 59 : (log: 2, pos: 26538)
entry 60 : (log: 2, pos: 26646)
entry 61 : (log: 2, pos: 26754)
entry 62 : (log: 2, pos: 26862)
entry 63 : (log: 2, pos: 26970)
entry 64 : (log: 2, pos: 27078)
entry 65 : (log: 2, pos: 27186)
entry 66 : (log: 2, pos: 27294)
entry 67 : (log: 2, pos: 27402)
entry 68 : (log: 2, pos: 27510)
entry 69 : (log: 2, pos: 30967)
entry 70 : (log: 2, pos: 31075)
entry 71 : (log: 2, pos: 31183)
entry 72 : (log: 2, pos: 31291)
entry 73 : (log: 2, pos: 31399)
entry 74 : (log: 2, pos: 31507)
entry 75 : (log: 2, pos: 31615)
entry 76 : (log: 2, pos: 31723)
entry 77 : (log: 2, pos: 31831)
entry 78 : (log: 2, pos: 31939)
entry 79 : (log: 2, pos: 32047)
entry 80 : (log: 2, pos: 32155)
entry 81 : (log: 2, pos: 32263)
entry 82 : (log: 2, pos: 32371)
entry 83 : (log: 2, pos: 32479)
entry 84 : (log: 2, pos: 32587)
entry 85 : (log: 2, pos: 32695)
entry 86 : (log: 2, pos: 32803)
entry 87 : (log: 2, pos: 32911)
entry 88 : (log: 2, pos: 33019)
entry 89 : (log: 2, pos: 33127)
entry 90 : (log: 2, pos: 33235)
entry 91 : (log: 2, pos: 33343)
entry 92 : (log: 2, pos: 33451)
entry 93 : (log: 2, pos: 33559)
entry 94 : (log: 2, pos: 33667)
entry 95 : (log: 2, pos: 33775)
entry 96 : (log: 2, pos: 37538)
entry 97 : (log: 2, pos: 37646)
entry 98 : (log: 2, pos: 37754)
entry 99 : (log: 2, pos: 37862)
entry 100 : (log: 2, pos: 37970)
entry 101 : (log: 2, pos: 38078)
entry 102 : (log: 2, pos: 38186)
entry 103 : (log: 2, pos: 38294)
entry 104 : (log: 2, pos: 38402)
entry 105 : (log: 2, pos: 38510)
entry 106 : (log: 2, pos: 38618)
entry 107 : (log: 2, pos: 38726)
entry 108 : (log: 2, pos: 38834)
entry 109 : (log: 2, pos: 38942)
entry 110 : (log: 2, pos: 39050)
entry 111 : (log: 2, pos: 39158)
entry 112 : (log: 2, pos: 39266)
entry 113 : (log: 2, pos: 39374)
entry 114 : (log: 2, pos: 39482)
entry 115 : (log: 2, pos: 39590)
entry 116 : (log: 2, pos: 39698)
entry 117 : (log: 2, pos: 41711)
entry 118 : (log: 2, pos: 41819)
entry 119 : (log: 2, pos: 41927)
entry 120 : (log: 2, pos: 42035)
entry 121 : (log: 2, pos: 42143)
entry 122 : (log: 2, pos: 42251)
entry 123 : (log: 2, pos: 42359)
entry 124 : (log: 2, pos: 42467)
entry 125 : (log: 2, pos: 42575)
entry 126 : (log: 2, pos: 42683)
entry 127 : (log: 2, pos: 42791)
entry 128 : (log: 2, pos: 42899)
entry 129 : (log: 2, pos: 43007)
entry 130 : (log: 2, pos: 43115)
entry 131 : (log: 2, pos: 43223)
entry 132 : (log: 2, pos: 47227)
entry 133 : (log: 2, pos: 47335)
entry 134 : (log: 2, pos: 47443)
entry 135 : (log: 2, pos: 47551)
entry 136 : (log: 2, pos: 47659)
entry 137 : (log: 2, pos: 47767)
entry 138 : (log: 2, pos: 47875)
entry 139 : (log: 2, pos: 47983)
entry 140 : (log: 2, pos: 48091)
entry 141 : (log: 2, pos: 48199)
entry 142 : (log: 2, pos: 48307)
entry 143 : (log: 2, pos: 48415)
entry 144 : (log: 2, pos: 48523)
entry 145 : (log: 2, pos: 48631)
entry 146 : (log: 2, pos: 48739)
entry 147 : (log: 2, pos: 48847)
entry 148 : (log: 2, pos: 48955)
entry 149 : (log: 2, pos: 51027)
entry 150 : (log: 2, pos: 51135)
entry 151 : (log: 2, pos: 51243)
entry 152 : (log: 2, pos: 51351)
entry 153 : (log: 2, pos: 51459)
entry 154 : (log: 2, pos: 51567)
entry 155 : (log: 2, pos: 51675)
entry 156 : (log: 2, pos: 51783)
entry 157 : (log: 2, pos: 51891)
entry 158 : (log: 2, pos: 51999)
entry 159 : (log: 2, pos: 52107)
entry 160 : (log: 2, pos: 52215)
entry 161 : (log: 2, pos: 56332)
entry 162 : (log: 2, pos: 56440)
entry 163 : (log: 2, pos: 56548)
entry 164 : (log: 2, pos: 56656)
entry 165 : (log: 2, pos: 56764)
entry 166 : (log: 2, pos: 56872)
entry 167 : (log: 2, pos: 56980)
entry 168 : (log: 2, pos: 57088)
entry 169 : (log: 2, pos: 57196)
entry 170 : (log: 2, pos: 57304)
entry 171 : (log: 2, pos: 57412)
entry 172 : (log: 2, pos: 57520)
entry 173 : (log: 2, pos: 57628)
entry 174 : (log: 2, pos: 57736)
entry 175 : (log: 2, pos: 57844)
entry 176 : (log: 2, pos: 57952)
entry 177 : (log: 2, pos: 58060)
entry 178 : (log: 2, pos: 58168)
entry 179 : (log: 2, pos: 58276)
entry 180 : (log: 2, pos: 58384)
entry 181 : (log: 2, pos: 58492)
entry 182 : (log: 2, pos: 58600)
entry 183 : (log: 2, pos: 58708)
entry 184 : (log: 2, pos: 58816)
can not see entry 186
but when i use
./bookkeeper shell readledger -bookie 10.33.50.111:3181 -ledgerid 67 -firstentryid 181 -lastentryid 181
can not read data
`2021-01-18 11:42:50.578 [main] INFO org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=10.33.50.207:2281,10.33.50.165:2281,10.33.50.184:2281 sessionTimeout=60000 watcher=org.apache.bookkeeper.zookeeper.ZooKeeperWatcherBase@3e2059ae
2021-01-18 11:42:50.583 [main] INFO org.apache.zookeeper.common.X509Util - Setting -D jdk.tls.rejectClientInitiatedRenegotiation=true to disable client-initiated TLS renegotiation
2021-01-18 11:42:50.691 [main] INFO org.apache.zookeeper.ClientCnxnSocket - jute.maxbuffer value is 4194304 Bytes
2021-01-18 11:42:50.698 [main] INFO org.apache.zookeeper.ClientCnxn - zookeeper.request.timeout value is 0. feature enabled=
2021-01-18 11:42:50.715 [main-SendThread(10.33.50.184:2281)] INFO org.apache.zookeeper.Login - Client successfully logged in.
2021-01-18 11:42:50.718 [main-SendThread(10.33.50.184:2281)] INFO org.apache.zookeeper.client.ZooKeeperSaslClient - Client will use DIGEST-MD5 as SASL mechanism.
2021-01-18 11:42:50.726 [main-SendThread(10.33.50.184:2281)] INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server 10.33.50.184/10.33.50.184:2281. Will attempt to SASL-authenticate using Login Context section 'Client'
2021-01-18 11:42:50.925 [epollEventLoopGroup-4-1] WARN org.apache.zookeeper.common.X509Util - zookeeper.ssl.keyStore.location not specified
2021-01-18 11:42:50.981 [epollEventLoopGroup-4-1] INFO org.apache.zookeeper.ClientCnxnSocketNetty - SSL handler added for channel: [id: 0x77aa6737]
2021-01-18 11:42:50.997 [epollEventLoopGroup-4-1] INFO org.apache.zookeeper.ClientCnxn - Socket connection established, initiating session, client: /10.33.50.111:59286, server: 10.33.50.184/10.33.50.184:2281
2021-01-18 11:42:51.035 [epollEventLoopGroup-4-1] INFO org.apache.zookeeper.ClientCnxnSocketNetty - channel is connected: [id: 0x77aa6737, L:/10.33.50.111:59286 - R:10.33.50.184/10.33.50.184:2281]
2021-01-18 11:42:51.134 [epollEventLoopGroup-4-1] INFO org.apache.zookeeper.ClientCnxn - Session establishment complete on server 10.33.50.184/10.33.50.184:2281, sessionid = 0x3004853533b000d, negotiated timeout = 40000
2021-01-18 11:42:51.137 [main-EventThread] INFO o.apache.bookkeeper.zookeeper.ZooKeeperWatcherBase - ZooKeeper client is connected now.
2021-01-18 11:42:51.189 [main] ERROR o.a.b.client.RackawareEnsemblePlacementPolicyImpl - Failed to initialize DNS Resolver org.apache.bookkeeper.net.ScriptBasedMapping, used default subnet resolver : java.lang.RuntimeException: No network topology script is found when using script based DNS resolver.
2021-01-18 11:42:51.230 [main] INFO o.a.b.client.RackawareEnsemblePlacementPolicyImpl - Initialize rackaware ensemble placement policy @ <Bookie:10.33.50.111:0> @ /default-rack : org.apache.bookkeeper.client.TopologyAwareEnsemblePlacementPolicy$DefaultResolver.
2021-01-18 11:42:51.230 [main] INFO o.a.b.client.RackawareEnsemblePlacementPolicyImpl - Not weighted
2021-01-18 11:42:51.248 [main] INFO org.apache.bookkeeper.client.BookKeeper - Weighted ledger placement is not enabled
2021-01-18 11:42:51.373 [main-EventThread] INFO o.apache.bookkeeper.discover.ZKRegistrationClient - Update BookieInfoCache (writable bookie) 10.33.50.37:3181 -> BookieServiceInfo{properties={}, endpoints=[EndpointInfo{id=bookie, port=3181, host=10.33.50.37, protocol=bookie-rpc, auth=[], extensions=[]}]}
2021-01-18 11:42:51.373 [main-EventThread] INFO o.apache.bookkeeper.discover.ZKRegistrationClient - Update BookieInfoCache (writable bookie) 10.33.50.35:3181 -> BookieServiceInfo{properties={}, endpoints=[EndpointInfo{id=bookie, port=3181, host=10.33.50.35, protocol=bookie-rpc, auth=[], extensions=[]}]}
2021-01-18 11:42:51.374 [main-EventThread] INFO o.apache.bookkeeper.discover.ZKRegistrationClient - Update BookieInfoCache (writable bookie) 10.33.50.111:3181 -> BookieServiceInfo{properties={}, endpoints=[EndpointInfo{id=bookie, port=3181, host=10.33.50.111, protocol=bookie-rpc, auth=[], extensions=[]}]}
2021-01-18 11:42:51.379 [BookKeeperClientScheduler-OrderedScheduler-0-0] INFO org.apache.bookkeeper.net.NetworkTopologyImpl - Adding a new node: /default-rack/10.33.50.37:3181
2021-01-18 11:42:51.379 [BookKeeperClientScheduler-OrderedScheduler-0-0] INFO org.apache.bookkeeper.net.NetworkTopologyImpl - Adding a new node: /default-rack/10.33.50.35:3181
2021-01-18 11:42:51.379 [BookKeeperClientScheduler-OrderedScheduler-0-0] INFO org.apache.bookkeeper.net.NetworkTopologyImpl - Adding a new node: /default-rack/10.33.50.111:3181
2021-01-18 11:42:51.470 [main] INFO org.apache.zookeeper.ClientCnxnSocketNetty - channel is told closing
2021-01-18 11:42:51.473 [epollEventLoopGroup-4-1] INFO org.apache.zookeeper.ClientCnxnSocketNetty - channel is disconnected: [id: 0x77aa6737, L:/10.33.50.111:59286 ! R:10.33.50.184/10.33.50.184:2281]
2021-01-18 11:42:51.473 [epollEventLoopGroup-4-1] INFO org.apache.zookeeper.ClientCnxnSocketNetty - channel is told closing
2021-01-18 11:42:51.474 [main] INFO org.apache.zookeeper.ZooKeeper - Session: 0x3004853533b000d closed
2021-01-18 11:42:51.474 [main-EventThread] INFO org.apache.zookeeper.ClientCnxn - EventThread shut down for session: 0x3004853533b000d
`
and i can read another ledger data
./bookkeeper shell readledger -bookie 10.33.50.111:3181 -ledgerid 90 -firstentryid 124 -lastentryid 124
`2021-01-18 11:41:52.389 [main] INFO org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=10.33.50.207:2281,10.33.50.165:2281,10.33.50.184:2281 sessionTimeout=60000 watcher=org.apache.bookkeeper.zookeeper.ZooKeeperWatcherBase@57ad2aa7
2021-01-18 11:41:52.398 [main] INFO org.apache.zookeeper.common.X509Util - Setting -D jdk.tls.rejectClientInitiatedRenegotiation=true to disable client-initiated TLS renegotiation
2021-01-18 11:41:52.530 [main] INFO org.apache.zookeeper.ClientCnxnSocket - jute.maxbuffer value is 4194304 Bytes
2021-01-18 11:41:52.542 [main] INFO org.apache.zookeeper.ClientCnxn - zookeeper.request.timeout value is 0. feature enabled=
2021-01-18 11:41:52.561 [main-SendThread(10.33.50.207:2281)] INFO org.apache.zookeeper.Login - Client successfully logged in.
2021-01-18 11:41:52.563 [main-SendThread(10.33.50.207:2281)] INFO org.apache.zookeeper.client.ZooKeeperSaslClient - Client will use DIGEST-MD5 as SASL mechanism.
2021-01-18 11:41:52.570 [main-SendThread(10.33.50.207:2281)] INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server 10.33.50.207/10.33.50.207:2281. Will attempt to SASL-authenticate using Login Context section 'Client'
2021-01-18 11:41:52.789 [epollEventLoopGroup-4-1] WARN org.apache.zookeeper.common.X509Util - zookeeper.ssl.keyStore.location not specified
2021-01-18 11:41:52.850 [epollEventLoopGroup-4-1] INFO org.apache.zookeeper.ClientCnxnSocketNetty - SSL handler added for channel: [id: 0xfbc3c149]
2021-01-18 11:41:52.874 [epollEventLoopGroup-4-1] INFO org.apache.zookeeper.ClientCnxn - Socket connection established, initiating session, client: /10.33.50.111:32868, server: 10.33.50.207/10.33.50.207:2281
2021-01-18 11:41:52.922 [epollEventLoopGroup-4-1] INFO org.apache.zookeeper.ClientCnxnSocketNetty - channel is connected: [id: 0xfbc3c149, L:/10.33.50.111:32868 - R:10.33.50.207/10.33.50.207:2281]
2021-01-18 11:41:53.062 [epollEventLoopGroup-4-1] INFO org.apache.zookeeper.ClientCnxn - Session establishment complete on server 10.33.50.207/10.33.50.207:2281, sessionid = 0x100485353060012, negotiated timeout = 40000
2021-01-18 11:41:53.066 [main-EventThread] INFO o.apache.bookkeeper.zookeeper.ZooKeeperWatcherBase - ZooKeeper client is connected now.
2021-01-18 11:41:53.122 [main] ERROR o.a.b.client.RackawareEnsemblePlacementPolicyImpl - Failed to initialize DNS Resolver org.apache.bookkeeper.net.ScriptBasedMapping, used default subnet resolver : java.lang.RuntimeException: No network topology script is found when using script based DNS resolver.
2021-01-18 11:41:53.163 [main] INFO o.a.b.client.RackawareEnsemblePlacementPolicyImpl - Initialize rackaware ensemble placement policy @ <Bookie:10.33.50.111:0> @ /default-rack : org.apache.bookkeeper.client.TopologyAwareEnsemblePlacementPolicy$DefaultResolver.
2021-01-18 11:41:53.163 [main] INFO o.a.b.client.RackawareEnsemblePlacementPolicyImpl - Not weighted
2021-01-18 11:41:53.181 [main] INFO org.apache.bookkeeper.client.BookKeeper - Weighted ledger placement is not enabled
2021-01-18 11:41:53.333 [main-EventThread] INFO o.apache.bookkeeper.discover.ZKRegistrationClient - Update BookieInfoCache (writable bookie) 10.33.50.37:3181 -> BookieServiceInfo{properties={}, endpoints=[EndpointInfo{id=bookie, port=3181, host=10.33.50.37, protocol=bookie-rpc, auth=[], extensions=[]}]}
2021-01-18 11:41:53.334 [main-EventThread] INFO o.apache.bookkeeper.discover.ZKRegistrationClient - Update BookieInfoCache (writable bookie) 10.33.50.35:3181 -> BookieServiceInfo{properties={}, endpoints=[EndpointInfo{id=bookie, port=3181, host=10.33.50.35, protocol=bookie-rpc, auth=[], extensions=[]}]}
2021-01-18 11:41:53.334 [main-EventThread] INFO o.apache.bookkeeper.discover.ZKRegistrationClient - Update BookieInfoCache (writable bookie) 10.33.50.111:3181 -> BookieServiceInfo{properties={}, endpoints=[EndpointInfo{id=bookie, port=3181, host=10.33.50.111, protocol=bookie-rpc, auth=[], extensions=[]}]}
2021-01-18 11:41:53.343 [BookKeeperClientScheduler-OrderedScheduler-0-0] INFO org.apache.bookkeeper.net.NetworkTopologyImpl - Adding a new node: /default-rack/10.33.50.37:3181
2021-01-18 11:41:53.344 [BookKeeperClientScheduler-OrderedScheduler-0-0] INFO org.apache.bookkeeper.net.NetworkTopologyImpl - Adding a new node: /default-rack/10.33.50.35:3181
2021-01-18 11:41:53.344 [BookKeeperClientScheduler-OrderedScheduler-0-0] INFO org.apache.bookkeeper.net.NetworkTopologyImpl - Adding a new node: /default-rack/10.33.50.111:3181
2021-01-18 11:41:53.367 [bookie-io-1-13] INFO c.h.d.s.d.b.server.SASLBookieAuthProviderFactory - init SASLBookieAuthProvider
2021-01-18 11:41:53.367 [bookie-io-1-13] INFO c.h.d.s.dmq.bookie.server.SASLBookieAuthProvider - create SASLBookieAuthProvider with remoteAddr null
2021-01-18 11:41:53.367 [bookie-io-1-13] INFO org.apache.bookkeeper.proto.BookieRequestHandler - Channel connected [id: 0xe9d51d1b, L:/10.33.50.111:3181 - R:/10.33.50.35:34226]
2021-01-18 11:41:53.412 [bookie-io-1-13] INFO c.h.d.s.dmq.bookie.server.SASLBookieAuthProvider - ScramStage.INIT:bookie server sasl scrame init handle client_first_message success and resturn server_first_message ,client username is : admin
2021-01-18 11:41:53.457 [bookie-io-1-14] INFO c.h.d.s.d.b.server.SASLBookieAuthProviderFactory - init SASLBookieAuthProvider
2021-01-18 11:41:53.457 [bookie-io-1-14] INFO c.h.d.s.dmq.bookie.server.SASLBookieAuthProvider - create SASLBookieAuthProvider with remoteAddr null
2021-01-18 11:41:53.457 [bookie-io-1-14] INFO org.apache.bookkeeper.proto.BookieRequestHandler - Channel connected [id: 0xbb3198bd, L:/10.33.50.111:3181 - R:/10.33.50.111:58676]
2021-01-18 11:41:53.458 [nioEventLoopGroup-9-1] INFO org.apache.bookkeeper.proto.PerChannelBookieClient - Successfully connected to bookie: 10.33.50.111:3181 [id: 0xbd06febe, L:/10.33.50.111:58676 - R:/10.33.50.111:3181]
2021-01-18 11:41:53.466 [bookie-io-1-13] INFO c.h.d.s.dmq.bookie.server.SASLBookieAuthProvider - ScramStage.FIRST:bookie server sasl scrame handle client_final_message success and return server_final_message admin
2021-01-18 11:41:53.468 [bookie-io-1-13] INFO c.h.d.s.dmq.bookie.server.SASLBookieAuthProvider - ScramStage.FINAL:bookie server sasl scrame handle admin
2021-01-18 11:41:53.468 [bookie-io-1-13] INFO org.apache.bookkeeper.proto.AuthHandler - Authentication success on server side
2021-01-18 11:41:53.479 [bookie-io-1-13] INFO org.apache.bookkeeper.proto.BookieRequestHandler - Channels disconnected: [id: 0xe9d51d1b, L:/10.33.50.111:3181 ! R:/10.33.50.35:34226]
2021-01-18 11:41:53.493 [nioEventLoopGroup-9-1] WARN c.h.d.s.dmq.bookie.client.SASLClientAuthProvider - SASLClientAuthProvider init admin
2021-01-18 11:41:53.494 [nioEventLoopGroup-9-1] INFO c.h.d.s.dmq.bookie.client.SASLClientAuthProvider - SASLClientAuthProvider init to send client_first_message
2021-01-18 11:41:53.508 [bookie-io-1-14] INFO c.h.d.s.dmq.bookie.server.SASLBookieAuthProvider - ScramStage.INIT:bookie server sasl scrame init handle client_first_message success and resturn server_first_message ,client username is : admin
2021-01-18 11:41:53.547 [bookie-io-1-15] INFO c.h.d.s.d.b.server.SASLBookieAuthProviderFactory - init SASLBookieAuthProvider
2021-01-18 11:41:53.547 [bookie-io-1-15] INFO c.h.d.s.dmq.bookie.server.SASLBookieAuthProvider - create SASLBookieAuthProvider with remoteAddr null
2021-01-18 11:41:53.547 [bookie-io-1-15] INFO org.apache.bookkeeper.proto.BookieRequestHandler - Channel connected [id: 0x508d5de3, L:/10.33.50.111:3181 - R:/10.33.50.37:37450]
2021-01-18 11:41:53.565 [nioEventLoopGroup-9-1] INFO c.h.d.s.dmq.bookie.client.SASLClientAuthProvider - bookie SASLClientAuthProvider server_first_message handler success and send client_final_message
2021-01-18 11:41:53.567 [bookie-io-1-14] INFO c.h.d.s.dmq.bookie.server.SASLBookieAuthProvider - ScramStage.FIRST:bookie server sasl scrame handle client_final_message success and return server_final_message admin
2021-01-18 11:41:53.568 [nioEventLoopGroup-9-1] INFO c.h.d.s.dmq.bookie.client.SASLClientAuthProvider - bookie SASLClientAuthProvider server_final_message handler success and send client_complete_message
2021-01-18 11:41:53.574 [bookie-io-1-14] INFO c.h.d.s.dmq.bookie.server.SASLBookieAuthProvider - ScramStage.FINAL:bookie server sasl scrame handle admin
2021-01-18 11:41:53.574 [bookie-io-1-14] INFO org.apache.bookkeeper.proto.AuthHandler - Authentication success on server side
2021-01-18 11:41:53.583 [BookieClientScheduler-OrderedExecutor-0-0] INFO o.a.b.tools.cli.commands.bookie.ReadLedgerCommand - --------- Lid=90, Eid=124 ---------
2021-01-18 11:41:53.583 [BookieClientScheduler-OrderedExecutor-0-0] INFO o.a.b.tools.cli.commands.bookie.ReadLedgerCommand - Data: +-------------------------------------------------+
| 0 1 2 3 4 5 6 7 8 9 a b c d e f |
+--------+-------------------------------------------------+----------------+
|00000000| 00 00 00 00 00 00 00 5a 00 00 00 00 00 00 00 7c |.......Z.......||
|00000010| 00 00 00 00 00 00 00 7b 00 00 00 00 00 00 21 b1 |.......{......!.|
|00000020| 81 95 5f 64 0e 01 f1 8d 29 b7 00 00 00 2a 0a 15 |.._d....)....*..|
|00000030| 70 75 6c 73 61 72 2d 63 6c 75 73 74 65 72 2d 32 |pulsar-cluster-2|
|00000040| 2d 31 2d 31 31 10 8a 27 18 90 bd c9 9c f1 2e 58 |-1-11..'.......X|
|00000050| 01 82 01 00 c0 01 8a 27 00 00 00 05 18 08 40 8a |.......'......@.|
|00000060| 27 32 34 37 31 33 58 58 58 |'24713XXX |
+--------+-------------------------------------------------+----------------+
2021-01-18 11:41:53.585 [bookie-io-1-14] INFO org.apache.bookkeeper.proto.BookieRequestHandler - Channels disconnected: [id: 0xbb3198bd, L:/10.33.50.111:3181 ! R:/10.33.50.111:58676]
2021-01-18 11:41:53.585 [nioEventLoopGroup-9-1] INFO org.apache.bookkeeper.proto.PerChannelBookieClient - Disconnected from bookie channel [id: 0xbd06febe, L:/10.33.50.111:58676 ! R:/10.33.50.111:3181]
2021-01-18 11:41:53.588 [main] INFO org.apache.bookkeeper.proto.PerChannelBookieClient - Closing the per channel bookie client for 10.33.50.111:3181
2021-01-18 11:41:53.594 [bookie-io-1-15] INFO c.h.d.s.dmq.bookie.server.SASLBookieAuthProvider - ScramStage.INIT:bookie server sasl scrame init handle client_first_message success and resturn server_first_message ,client username is : admin
2021-01-18 11:41:53.648 [bookie-io-1-15] INFO c.h.d.s.dmq.bookie.server.SASLBookieAuthProvider - ScramStage.FIRST:bookie server sasl scrame handle client_final_message success and return server_final_message admin
2021-01-18 11:41:53.650 [bookie-io-1-15] INFO c.h.d.s.dmq.bookie.server.SASLBookieAuthProvider - ScramStage.FINAL:bookie server sasl scrame handle admin
2021-01-18 11:41:53.650 [bookie-io-1-15] INFO org.apache.bookkeeper.proto.AuthHandler - Authentication success on server side
2021-01-18 11:41:53.659 [bookie-io-1-15] INFO org.apache.bookkeeper.proto.BookieRequestHandler - Channels disconnected: [id: 0x508d5de3, L:/10.33.50.111:3181 ! R:/10.33.50.37:37450]
2021-01-18 11:41:53.724 [main] INFO org.apache.zookeeper.ClientCnxnSocketNetty - channel is told closing
2021-01-18 11:41:53.727 [epollEventLoopGroup-4-1] INFO org.apache.zookeeper.ClientCnxnSocketNetty - channel is disconnected: [id: 0xfbc3c149, L:/10.33.50.111:32868 ! R:10.33.50.207/10.33.50.207:2281]
2021-01-18 11:41:53.728 [epollEventLoopGroup-4-1] INFO org.apache.zookeeper.ClientCnxnSocketNetty - channel is told closing
2021-01-18 11:41:53.728 [main] INFO org.apache.zookeeper.ZooKeeper - Session: 0x100485353060012 closed
2021-01-18 11:41:53.728 [main-EventThread] INFO org.apache.zookeeper.ClientCnxn - EventThread shut down for session: 0x100485353060012
`
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] sijie commented on issue #9114: org.apache.bookkeeper.client.LedgerHandle - ReadException on ledgerId
Posted by GitBox <gi...@apache.org>.
sijie commented on issue #9114:
URL: https://github.com/apache/pulsar/issues/9114#issuecomment-756586366
@xiaotongwang1 It sounds like the errors are retried already.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] codelipenghui commented on issue #9114: org.apache.bookkeeper.client.LedgerHandle - ReadException on ledgerId
Posted by GitBox <gi...@apache.org>.
codelipenghui commented on issue #9114:
URL: https://github.com/apache/pulsar/issues/9114#issuecomment-770235263
@zymap Could you please help take a look at this issue? Any cases that the entry id is -1?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] eolivelli closed issue #9114: org.apache.bookkeeper.client.LedgerHandle - ReadException on ledgerId
Posted by GitBox <gi...@apache.org>.
eolivelli closed issue #9114:
URL: https://github.com/apache/pulsar/issues/9114
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] xiaotongwang1 commented on issue #9114: org.apache.bookkeeper.client.LedgerHandle - ReadException on ledgerId
Posted by GitBox <gi...@apache.org>.
xiaotongwang1 commented on issue #9114:
URL: https://github.com/apache/pulsar/issues/9114#issuecomment-761965321
[dmq@host-10-33-50-37 bin]$ ./bookkeeper shell ledger 67
JMX enabled by default
ERROR: initializing dbLedgerStorage Entry -1 not found in 67[dmq@host-10-33-50-37 bin]$
can not check ledger info now
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] kirill-kosenko commented on issue #9114: org.apache.bookkeeper.client.LedgerHandle - ReadException on ledgerId
Posted by GitBox <gi...@apache.org>.
kirill-kosenko commented on issue #9114:
URL: https://github.com/apache/pulsar/issues/9114#issuecomment-822766525
I observe similar errors when "Pulsar Transactions" feature is enabled
```
23:26:41.278 [pulsar-io-52-11] ERROR org.apache.bookkeeper.client.LedgerHandle - ReadException on ledgerId:22 firstEntry:401 lastEntry:401
...
23:26:41.332 [pulsar-io-52-6] ERROR org.apache.bookkeeper.client.LedgerHandle - ReadException on ledgerId:24 firstEntry:802 lastEntry:802
23:26:41.358 [pulsar-io-52-7] ERROR org.apache.bookkeeper.client.LedgerHandle - ReadException on ledgerId:31 firstEntry:802 lastEntry:802
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org