You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@pulsar.apache.org by "pckhoi (via GitHub)" <gi...@apache.org> on 2024/02/24 10:44:05 UTC

[D] Is it possible to consume messages from offloaded ledgers? [pulsar]

GitHub user pckhoi created a discussion: Is it possible to consume messages from offloaded ledgers?

It is said in the Tiered Storage Overview that "After offloading ledgers to long-term storage, you can still query data in the offloaded ledgers with Pulsar SQL." Does that mean that regular consumers will not be able to consume from those ledgers?

GitHub link: https://github.com/apache/pulsar/discussions/22113

----
This is an automatically sent email for commits@pulsar.apache.org.
To unsubscribe, please send an email to: commits-unsubscribe@pulsar.apache.org

Re: [D] Is it possible to consume messages from offloaded ledgers? [pulsar]

Posted by "jak78 (via GitHub)" <gi...@apache.org>.

GitHub user jak78 added a comment to the discussion: Is it possible to consume messages from offloaded ledgers?

Hi @pckhoi! Regular consumers can still consume messages from offloaded ledgers.
Feel free to check the [Tiered Storage docs](https://pulsar.apache.org/docs/3.2.x/tiered-storage-overview/):
> Pulsar's Tiered Storage feature allows older backlog data to be moved from BookKeeper to long-term and cheaper storage, while still allowing clients to access the backlog as if nothing has changed.

Best,

GitHub link: https://github.com/apache/pulsar/discussions/22113#discussioncomment-8610065

----
This is an automatically sent email for commits@pulsar.apache.org.
To unsubscribe, please send an email to: commits-unsubscribe@pulsar.apache.org

Re: [D] Is it possible to consume messages from offloaded ledgers? [pulsar]

Posted by "jak78 (via GitHub)" <gi...@apache.org>.

GitHub user jak78 added a comment to the discussion: Is it possible to consume messages from offloaded ledgers?

I'm glad that clarified things. I just created a [PR](https://github.com/apache/pulsar-site/pull/810) to improve the doc thanks to your feedback.

GitHub link: https://github.com/apache/pulsar/discussions/22113#discussioncomment-8642507

----
This is an automatically sent email for commits@pulsar.apache.org.
To unsubscribe, please send an email to: commits-unsubscribe@pulsar.apache.org

Re: [D] Is it possible to consume messages from offloaded ledgers? [pulsar]

Posted by "pckhoi (via GitHub)" <gi...@apache.org>.

GitHub user pckhoi added a comment to the discussion: Is it possible to consume messages from offloaded ledgers?

Thanks for the clarification! I didn't see an example so I needed a clear answer.

GitHub link: https://github.com/apache/pulsar/discussions/22113#discussioncomment-8642136

----
This is an automatically sent email for commits@pulsar.apache.org.
To unsubscribe, please send an email to: commits-unsubscribe@pulsar.apache.org