[GitHub] [storm] Ethanlm opened a new pull request #3280: [STORM-3620] fix data corruption in the case of multi-threaded bolts …

[GitBox <gi...@apache.org>]

Ethanlm opened a new pull request #3280:
URL: https://github.com/apache/storm/pull/3280


   ## What is the purpose of the change
   
   Users might want to launch extra threads within bolts ; because the serializer is not thread safe, there will be race conditions causing data corruption. The change here is to make the serializer thread-local, add unit test, and add a MultiThreadWordCount example. 
   
   ## How was the change tested
   
   1. Added unit test
   2. submit the MultiThreadWordCount example and validated that the threadlocal serializer fixed the data corruption issue.
   
   
   There is another known issue https://issues.apache.org/jira/browse/STORM-3646 when 
   ```
   topology.producer.batch.size
   topology.transfer.batch.size
   ```
   are not 1 (by default is 1). Make sure don't change the values to something else for now. 


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [storm] Ethanlm merged pull request #3280: [STORM-3620] fix data corruption in the case of multi-threaded bolts caused by non thread-safe serializers

[GitBox <gi...@apache.org>]

Ethanlm merged pull request #3280:
URL: https://github.com/apache/storm/pull/3280


   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org