You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pulsar.apache.org by GitBox <gi...@apache.org> on 2018/01/09 16:37:56 UTC
[GitHub] ivankelly opened a new pull request #1044: Compact algo
ivankelly opened a new pull request #1044: Compact algo
URL: https://github.com/apache/incubator-pulsar/pull/1044
Compaction will go through the topic in two passes. The first pass
selects latest offset for each key in the topic. Then the second pass
writes these values to a ledger.
The two passes are required to avoid holding the payloads of each of
the latest values in memory, as the payload can be many orders of
magnitude larger than a message id.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services