[GitHub] [pulsar] merlimat opened a new pull request #4329: Moved entries filtering from consumer to dispatcher

[GitBox <gi...@apache.org>]

merlimat opened a new pull request #4329: Moved entries filtering from consumer to dispatcher
URL: https://github.com/apache/pulsar/pull/4329
 
 
   ### Motivation
   
   As discussed in #4062, there is a back and forth between the dispatcher and the consumer when passing the messages. The key points are:
   
    * We need to filter the entries we got from storage for various reasons, like: 
      - Checksum and metadata corruption
      - Delays 
      - Internal markers not meant for consumers
   * Consumer needs to know the batch size for each entry
   * We want to de-serialize the message metadata protobuf just once
   
   With this PR, the dispatcher will do the filter and it will prefill a the batch sizes for each entry. Consumer will just see the filtered list.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services