You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@storm.apache.org by "Kevin Peek (JIRA)" <ji...@apache.org> on 2016/11/21 17:45:58 UTC

[jira] [Created] (STORM-2210) ShuffleGrouping does not produce even distribution

Kevin Peek created STORM-2210:
---------------------------------

             Summary: ShuffleGrouping does not produce even distribution
                 Key: STORM-2210
                 URL: https://issues.apache.org/jira/browse/STORM-2210
             Project: Apache Storm
          Issue Type: Bug
          Components: storm-core
    Affects Versions: 1.0.2
            Reporter: Kevin Peek
            Priority: Minor


When testing the ShuffleGrouping in a multithreaded environment, it produces an extremely uneven distribution.

This appears to be a result of the Collection.shuffle call here. https://github.com/apache/storm/blob/1.0.x-branch/storm-core/src/jvm/org/apache/storm/grouping/ShuffleGrouping.java#L58

Because current was set to zero before the shuffle, other threads are able to access the arrayList while it is being shuffled.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)