[GitHub] [pulsar] gaoran10 opened a new issue #7538: [Problem] How to generate sequenceId for commit marker in partition topic

[GitBox <gi...@apache.org>]

gaoran10 opened a new issue #7538:
URL: https://github.com/apache/pulsar/issues/7538


   ### Context
   
   When publishing messages to a topic, the `sequenceId` param is used for topic message deduplication. 
   
   In the transaction, when the TC receives commit command, the TC needs to write a commit marker append to the topic partition, the commit marker needs a `sequenceId` to avoid duplication, if the commit marker is duplicated the topic partition cursor will send duplication committed messages to the consumer, or we need to find some other approaches to avoid duplication.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [pulsar] sijie commented on issue #7538: [Question] How to generate sequenceId for commit marker in partition topic

[GitBox <gi...@apache.org>]

sijie commented on issue #7538:
URL: https://github.com/apache/pulsar/issues/7538#issuecomment-659773048


   Since the commit is initiated by TC and done by TB. TB first writes a `committing` record to the transaction buffer. You can use the message-id of the `committing` record to create a long number. This can be used as the sequence id to write the commit marker to the data partition.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org