Re: [PR] [improve] PIP-381: Handle PositionInfo that's too large to serialize as a single entry [pulsar]

["merlimat (via GitHub)" <gi...@apache.org>]

merlimat commented on PR #22799:
URL: https://github.com/apache/pulsar/pull/22799#issuecomment-6352870127

   Thanks @dlg99, and thanks to everyone who reviewed this. I'm closing this as part of the open-PR backlog triage. The problem has since been addressed with a more compact format instead of chunking. #9292 added the long-array encoding, which is now the default (`managedLedgerPersistIndividualAckAsLongArray=true`), and #25992 raised `managedLedgerMaxUnackedRangesToPersist` to 200k. With those defaults, the cursor state fits a backlog of about 30M entries in a single entry. Past that, it is truncated with a warning and a metric, and the cursor still recovers. The serialization code has also been rewritten since this PR was opened. If there's still a need beyond that limit, please open a fresh PR against current master that keeps the format readable by older brokers during a rollback.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org