[jira] [Updated] (STORM-297) Storm Performance cannot be scaled up by adding more CPU cores

["Rick Kellogg (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/STORM-297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Rick Kellogg updated STORM-297:
-------------------------------
    Component/s: storm-core

> Storm Performance cannot be scaled up by adding more CPU cores
> --------------------------------------------------------------
>
>                 Key: STORM-297
>                 URL: https://issues.apache.org/jira/browse/STORM-297
>             Project: Apache Storm
>          Issue Type: Bug
>          Components: storm-core
>            Reporter: Sean Zhong
>            Assignee: Sean Zhong
>              Labels: Performance, netty
>             Fix For: 0.9.2-incubating
>
>         Attachments: Storm_performance_fix.pdf, storm_Netty_receiver_diagram.png, storm_conf.txt, storm_performance_fix.patch, worker_throughput_without_storm-297.png
>
>
> We cannot scale up the performance by adding more CPU cores and increasing parallelism.
> For a 2 layer topology Spout ---shuffle grouping--> bolt, when message size is small (around 100 bytes), we can find in the below picture that neither the CPU nor the network is saturated. When message size is 100 bytes, only 40% of CPU is used, only 18% of network is used, although we have a high parallelism (overall we have 144 executors)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)