You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pulsar.apache.org by GitBox <gi...@apache.org> on 2022/03/03 08:59:55 UTC
[GitHub] [pulsar] lordcheng10 opened a new pull request #14543: Fix the problem that the broker never pushes messages to the consumer
lordcheng10 opened a new pull request #14543:
URL: https://github.com/apache/pulsar/pull/14543
### Motivation
We encountered such a problem: the broker never pushes messages because it reads a non-existing entry, and will keep trying to read the non-existing entry.
The error log is as follows:
00:00:10.094 [pulsar-io-4-122] INFO org.apache.pulsar.broker.service.persistent.PersistentDispatcherMultipleConsumers - [persistent://teg_onion_onion_common_data_gz/teg_onion_onion_common_data_gz/teg_onion_onion_common_data_gz-partition-159 / t_teg_onion_b_teg_onion_onion_common_data_gz_cg_onion_common_data_cos_svr_gz_001] Retrying read operation
00:00:28.320 [BookKeeperClientWorker-OrderedExecutor-21-0] ERROR org.apache.bookkeeper.client.PendingReadOp - Read of ledger entry failed: L15759573 E15389-E15389, Sent to [11.135.219.182:3181, 11.135.217.80:3181], Heard from [] : bitset = {}, Error = 'No such entry'. First unread entry is (-1, rc = null)
00:00:28.320 [BookKeeperClientWorker-OrderedExecutor-33-0] WARN org.apache.bookkeeper.mledger.impl.OpReadEntry - [teg_onion_onion_common_data_gz/teg_onion_onion_common_data_gz/persistent/teg_onion_onion_common_data_gz-partition-275][t_teg_onion_b_teg_onion_onion_common_data_gz_cg_onion_common_data_cos_svr_gz_001] read failed from ledger at position:15759573:15389
org.apache.bookkeeper.mledger.ManagedLedgerException$NonRecoverableLedgerException: No such entry
00:00:28.320 [BookKeeperClientWorker-OrderedExecutor-33-0] ERROR org.apache.pulsar.broker.service.persistent.PersistentDispatcherMultipleConsumers - [persistent://teg_onion_onion_common_data_gz/teg_onion_onion_common_data_gz/teg_onion_onion_common_data_gz-partition-275 / t_teg_onion_b_teg_onion_onion_common_data_gz_cg_onion_common_data_cos_svr_gz_001] Error reading entries at 15759573:15389 : No such entry, Read Type Normal - Retrying to read in 54.299 seconds
**And I found through the bookkeeper command: sh bin/bookkeeper shell ledger 15759573 that entryId=15389 does not exist, and the smallest entryid=15558:**
**Through monitoring, we found that the consumption delay of some partiotns continued to riseļ¼**
### Modifications
When we encounter this situation, skip the entry
### Documentation
Check the box below or label this PR directly (if you have committer privilege).
Need to update docs?
- [ ] `doc-required`
(If you need help on updating docs, create a doc issue)
- [x] `no-need-doc`
(Please explain why)
- [ ] `doc`
(If this PR contains doc changes)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] lordcheng10 closed pull request #14543: Fix consumer block problem: skip no entry
Posted by GitBox <gi...@apache.org>.
lordcheng10 closed pull request #14543:
URL: https://github.com/apache/pulsar/pull/14543
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org