[GitHub] [storm] cjljohnson opened a new pull request #3131: STORM-3510: Track overflow count per taskId for resending backpressur…

[GitBox <gi...@apache.org>]

cjljohnson opened a new pull request #3131: STORM-3510: Track overflow count per taskId for resending backpressur…
URL: https://github.com/apache/storm/pull/3131
 
 
   …e status
   
   This is a fix to the WorkerState.transferLocalBatch logic for keeping track of how often to resend backpressure status updates as the overflow queue grows.
   
   Previously a single counter was shared and overwritten for all executors and not retained between mini-batches.
   
   This fix stores the overflow count in a map keyed by taskId and stored in BackPressureTracker.java so values from different executors don't overwrite each other and a status update is only sent once per 10000 tuples rather than every mini batch once the threshold has been reached.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services