You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pulsar.apache.org by GitBox <gi...@apache.org> on 2022/05/19 06:52:05 UTC
[GitHub] [pulsar] leizhiyuan opened a new issue, #15659: how to solve backlog quota exceeds when another subscription reset the cursor to retention position
leizhiyuan opened a new issue, #15659:
URL: https://github.com/apache/pulsar/issues/15659
for a topic A ， set backlog quota 1G， retention 1T， strategy is produce exception
there has sub1, which is consuming normally, and then sub2 started from earliest，maybe users reset the cursor，then backlog size will be 1G+1T which is bigger than backlog quota, producer will fail .
except for setting backlog quota -1 (which will make broker serve much data), is there any better way?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] Technoboy- commented on issue #15659: how to solve backlog quota exceeds when another subscription reset the cursor to retention position
Posted by GitBox <gi...@apache.org>.
Technoboy- commented on issue #15659:
URL: https://github.com/apache/pulsar/issues/15659#issuecomment-1131424899
Seems fixed by 15663
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] leizhiyuan closed issue #15659: how to solve backlog quota exceeds when another subscription reset the cursor to retention position
Posted by GitBox <gi...@apache.org>.
leizhiyuan closed issue #15659: how to solve backlog quota exceeds when another subscription reset the cursor to retention position
URL: https://github.com/apache/pulsar/issues/15659
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] how to solve backlog quota exceeds when another subscription reset the cursor to retention position [pulsar]
Posted by "merlimat (via GitHub)" <gi...@apache.org>.
merlimat commented on issue #15659:
URL: https://github.com/apache/pulsar/issues/15659#issuecomment-6390802553
Thanks @leizhiyuan. This is by design for durable subscriptions: the `destination_storage` backlog quota counts from the slowest durable cursor, so rewinding `sub2` into retention makes the whole retained range backlog. To re-read retained data without affecting the quota, use a non-durable cursor: a `Reader` (`client.newReader().startMessageId(...)` or `startMessageFromRollbackDuration(...)`), or a consumer with `.subscriptionMode(SubscriptionMode.NonDurable)`. Non-durable cursors aren't counted in the topic's backlog size, so producers keep working. Another option is a `message_age` backlog quota instead of a size-based one. Closing as answered; please follow up in https://github.com/apache/pulsar/discussions if you have more questions.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] Technoboy- commented on issue #15659: how to solve backlog quota exceeds when another subscription reset the cursor to retention position
Posted by GitBox <gi...@apache.org>.
Technoboy- commented on issue #15659:
URL: https://github.com/apache/pulsar/issues/15659#issuecomment-1131433268
> Seems fixed by #15663
Not the same, sorry.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] github-actions[bot] commented on issue #15659: how to solve backlog quota exceeds when another subscription reset the cursor to retention position
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on issue #15659:
URL: https://github.com/apache/pulsar/issues/15659#issuecomment-1159601537
The issue had no activity for 30 days, mark with Stale label.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] how to solve backlog quota exceeds when another subscription reset the cursor to retention position [pulsar]
Posted by "merlimat (via GitHub)" <gi...@apache.org>.
merlimat closed issue #15659: how to solve backlog quota exceeds when another subscription reset the cursor to retention position
URL: https://github.com/apache/pulsar/issues/15659
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org