You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@pulsar.apache.org by gi...@git.apache.org on 2017/09/08 03:58:07 UTC

[GitHub] merlimat opened a new pull request #751: Broker side deduplication

merlimat opened a new pull request #751: Broker side deduplication
URL: https://github.com/apache/incubator-pulsar/pull/751
 
 
   ### Motivation
   
   Context in [PIP-6](https://github.com/apache/incubator-pulsar/wiki/PIP-6:-Guaranteed-Message-Deduplication).
   
   This PR contains the broker side changes to implement the deduplication using the logic described in the design doc. 
   
   This is not the complete feature. I will add unit tests after pushing the client library changes as well. All tasks are in the [deduplication project](https://github.com/apache/incubator-pulsar/projects/3)
   
   ### Modifications
   
    * Added APIs to enable/disable deduplication
    * Check for sequence ids to discard duplicates
    * Use the cursor properties to take snapshot of the sequence id map
    * Load the snapshot and replay the cursor when loading the topic
   
 
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services