You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@pulsar.apache.org by "ub-3 (via GitHub)" <gi...@apache.org> on 2024/07/14 22:22:15 UTC

[D] Deleting data in bookkeeper [pulsar]

GitHub user ub-3 created a discussion: Deleting data in bookkeeper

Will the ledger be deleted if a rollover occurred according to the parameters: managedLedgerMaxLedgerRolloverTimeMinutes, managedLedgerMinLedgerRolloverTimeMinutes, managedLedgerMaxEntriesPerLedger, but the cursor ledger was not closed.

GitHub link: https://github.com/apache/pulsar/discussions/23032

----
This is an automatically sent email for commits@pulsar.apache.org.
To unsubscribe, please send an email to: commits-unsubscribe@pulsar.apache.org

Re: [D] Deleting data in bookkeeper [pulsar]

Posted by "ub-3 (via GitHub)" <gi...@apache.org>.

GitHub user ub-3 edited a discussion: Deleting data in bookkeeper

1. Will the ledger be deleted if a rollover occurred according to the parameters: managedLedgerMaxLedgerRolloverTimeMinutes, m
anagedLedgerMinLedgerRolloverTimeMinutes, managedLedgerMaxEntriesPerLedger, but the cursor ledger was not closed.
2. And another question. If compaction is disabled on the bookkeeper side, will the entry log be deleted when closing ledger?

GitHub link: https://github.com/apache/pulsar/discussions/23032

----
This is an automatically sent email for commits@pulsar.apache.org.
To unsubscribe, please send an email to: commits-unsubscribe@pulsar.apache.org

Re: [D] Deleting data in bookkeeper [pulsar]

Posted by "sbourkeostk (via GitHub)" <gi...@apache.org>.

GitHub user sbourkeostk added a comment to the discussion: Deleting data in bookkeeper

1. A topic (managed-ledger) consists of a set of ledgers. When a ledger is rolled over the previous ledger is only removed if all cursors have moved past its entries (assuming no retention/TTLs).
2. BookKeeper has no concept/knowledge of compaction, that's a Pulsar concept. As in question 1, a ledger is only deleted when the broker that responsible for the topic deletes the ledger from bookkeeper. The broker will not do that until: all messages stored in the ledger have been ack'd on all subscriptions or the TTL has expired, and the retention window has passed.

GitHub link: https://github.com/apache/pulsar/discussions/23032#discussioncomment-10266379

----
This is an automatically sent email for commits@pulsar.apache.org.
To unsubscribe, please send an email to: commits-unsubscribe@pulsar.apache.org

Re: [D] Deleting data in bookkeeper [pulsar]

Posted by "ub-3 (via GitHub)" <gi...@apache.org>.

GitHub user ub-3 closed a discussion: Deleting data in bookkeeper

1. Will the ledger be deleted if a rollover occurred according to the parameters: managedLedgerMaxLedgerRolloverTimeMinutes, m
anagedLedgerMinLedgerRolloverTimeMinutes, managedLedgerMaxEntriesPerLedger, but the cursor ledger was not closed.
2. And another question. If compaction is disabled on the bookkeeper side, will the entry log be deleted when closing ledger?

GitHub link: https://github.com/apache/pulsar/discussions/23032

----
This is an automatically sent email for commits@pulsar.apache.org.
To unsubscribe, please send an email to: commits-unsubscribe@pulsar.apache.org

Re: [D] Deleting data in bookkeeper [pulsar]

Posted by "ub-3 (via GitHub)" <gi...@apache.org>.

GitHub user ub-3 added a comment to the discussion: Deleting data in bookkeeper

And another question. If compaction is disabled on the bookkeeper side, will the entry log be deleted when closing ledger?

GitHub link: https://github.com/apache/pulsar/discussions/23032#discussioncomment-10045721

----
This is an automatically sent email for commits@pulsar.apache.org.
To unsubscribe, please send an email to: commits-unsubscribe@pulsar.apache.org

Re: [D] Deleting data in bookkeeper [pulsar]

Posted by "ub-3 (via GitHub)" <gi...@apache.org>.

GitHub user ub-3 deleted a comment on the discussion: Deleting data in bookkeeper

And another question. If compaction is disabled on the bookkeeper side, will the entry log be deleted when closing ledger?

GitHub link: https://github.com/apache/pulsar/discussions/23032#discussioncomment-10045721

----
This is an automatically sent email for commits@pulsar.apache.org.
To unsubscribe, please send an email to: commits-unsubscribe@pulsar.apache.org