You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@storm.apache.org by "Robert Joseph Evans (JIRA)" <ji...@apache.org> on 2015/06/19 03:14:01 UTC

[jira] [Created] (STORM-888) Nimbus Scaling: very large topologies

Robert Joseph Evans created STORM-888:
-----------------------------------------

             Summary: Nimbus Scaling: very large topologies
                 Key: STORM-888
                 URL: https://issues.apache.org/jira/browse/STORM-888
             Project: Apache Storm
          Issue Type: Bug
            Reporter: Robert Joseph Evans


While doing load testing of a heartbeat server implementation we found that nimbus started to struggle when scheduling a very large highly connected topology.

[~knusbaum] perhaps you can give some details on the topology you used, but it was three levels spout, and two levels of bolts.  The bolts were very highly connected with separate streams for each connection.

We should profile nimbus while it is doing this and see if we can determine the bottleneck to fix it.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)