You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pulsar.apache.org by GitBox <gi...@apache.org> on 2020/11/24 08:11:00 UTC
[GitHub] [pulsar] eolivelli opened a new issue #8677: Cannot get lastMessageId for an empty topic (due to message retention)
eolivelli opened a new issue #8677:
URL: https://github.com/apache/pulsar/issues/8677
**Describe the bug**
It looks like that when a topic remains empty due to message retention, it is not possible to ask for the lastMessageId
I see these errors in the HTTP server logs:
> "GET /admin/v2/persistent/XXX/YYY/ZZZZ/lastMessageId HTTP/1.1" 500 53 "-" "Pulsar-Java-v2.6.2" 2
And this line:
> Error opening ledger for reading at position 178974309:7 - org.apache.bookkeeper.mledger.ManagedLedgerException$NonRecoverableLedgerException: No such ledger exists on Metadata Server
**To Reproduce**
I don't have a reproducer yet, I have only seen this issue in production.
**Expected behavior**
Some non-error code should be returned to the client
** System (please complete the following information):**
- Linux, JDK14, both Pulsar Broker and Pulsar Client
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] eolivelli commented on issue #8677: Cannot get lastMessageId for an empty topic (due to message retention)
Posted by GitBox <gi...@apache.org>.
eolivelli commented on issue #8677:
URL: https://github.com/apache/pulsar/issues/8677#issuecomment-733549476
I am working on a fix
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] eolivelli commented on issue #8677: Cannot get lastMessageId for an empty topic (due to message retention)
Posted by GitBox <gi...@apache.org>.
eolivelli commented on issue #8677:
URL: https://github.com/apache/pulsar/issues/8677#issuecomment-734404832
I have created a reproducer, I will work on a fix tomorrow
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] eolivelli edited a comment on issue #8677: Cannot get lastMessageId for an empty topic (due to message retention)
Posted by GitBox <gi...@apache.org>.
eolivelli edited a comment on issue #8677:
URL: https://github.com/apache/pulsar/issues/8677#issuecomment-734404832
I have created a reproducer, I will work on a fix tomorrow
https://github.com/apache/pulsar/pull/8725
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] eolivelli commented on issue #8677: Cannot get lastMessageId for an empty topic (due to message retention)
Posted by GitBox <gi...@apache.org>.
eolivelli commented on issue #8677:
URL: https://github.com/apache/pulsar/issues/8677#issuecomment-734331182
I have found an error in the logs during TrimConsumedLedgers
20-11-22-03-25-41 [XXX/YYY/ZZZZ] End TrimConsumedLedgers. ledgers=11 totalSize=34130
20-11-22-03-25-41 [XXX/YYY/ZZZZ] Removing ledger 180334035 - size: 1964
20-11-22-03-25-41 [XXX/YYY/ZZZZ] Failed to mark delete while trimming data ledgers: Invalid mark deleted position
20-11-22-03-25-41 [XXX/YYY/ZZZZ] End TrimConsumedLedgers. ledgers=1 totalSize=0
20-11-22-03-25-41 [XXX/YYY/ZZZZ] Removing ledger 178974309 - size: 2248
before this errors I see for other topics errors like:
Failed to persist msg in store: Not enough non-faulty bookies available
20-11-19-03-22-59 [persistent://xxx/xxxx/xxxx] Un-fencing topic...
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] codelipenghui commented on issue #8677: Cannot get lastMessageId for an empty topic (due to message retention)
Posted by GitBox <gi...@apache.org>.
codelipenghui commented on issue #8677:
URL: https://github.com/apache/pulsar/issues/8677#issuecomment-733712078
Thanks @eolivelli
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] eolivelli commented on issue #8677: Cannot get lastMessageId for an empty topic (due to message retention)
Posted by GitBox <gi...@apache.org>.
eolivelli commented on issue #8677:
URL: https://github.com/apache/pulsar/issues/8677#issuecomment-734697068
The fix is in #8725
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] codelipenghui closed issue #8677: Cannot get lastMessageId for an empty topic (due to message retention)
Posted by GitBox <gi...@apache.org>.
codelipenghui closed issue #8677:
URL: https://github.com/apache/pulsar/issues/8677
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org