[jira] [Commented] (STORM-1057) Add throughput metric to spout/bolt and display them on web ui

["ASF GitHub Bot (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/STORM-1057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14902559#comment-14902559 ] 

ASF GitHub Bot commented on STORM-1057:
---------------------------------------

GitHub user wangli1426 opened a pull request:

    https://github.com/apache/storm/pull/753

    [STORM-1057] Add throughput metrics to spouts/bolts and display them on web ui

    The throughputs for the spouts and bolts could help the user to identify the performance bottleneck and detect the load balancing issue. In this RP, I take measurements on the throughput of the executors and display them on web UI.
    
    ### Summary of Changes
    1. Take throughput measurements on the spouts and bolts;
    2. Add throughput to ExecutorStats;
    3. Display the throughputs on web UI.
    
    
    **Note: If you cannot see the throughputs on your web UI, please clean your browser cache and try again.**
    ### Screenshots
    
    ![screen shot 2015-09-21 at 13 16 01](https://cloud.githubusercontent.com/assets/5260276/9987644/3e3b5720-607c-11e5-928c-ec49892b67f6.png)
    ![screen shot 2015-09-21 at 13 17 24](https://cloud.githubusercontent.com/assets/5260276/9987684/953e7048-607c-11e5-9188-b0f8ba1c7943.png)
    ![screen shot 2015-09-21 at 13 17 57](https://cloud.githubusercontent.com/assets/5260276/9987686/96ab9dc0-607c-11e5-954d-2369069b22d6.png)
    ![screen shot 2015-09-21 at 13 18 49](https://cloud.githubusercontent.com/assets/5260276/9987687/999e7e26-607c-11e5-99e4-0ac8d31b8768.png)

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/wangli1426/storm throughput-metrics

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/storm/pull/753.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #753
    
----
commit 67721f77f28cbb4a29fab7e3023b220095886338
Author: Li Wang <wa...@gmail.com>
Date:   2015-09-18T02:11:20Z

    initializing Timer in RateTracker.java lazily to avoid a bug in Clojure Maven plugin that might make compiling process never finish

commit 1dad2041fb0ae8689794fec93d05df2266292dc8
Author: Li Wang <wa...@gmail.com>
Date:   2015-09-18T07:19:28Z

    take throughput measurements on spouts and bolts

commit d74f784175cc4b8c631c52acaab3e0743f11a56d
Author: Li Wang <wa...@gmail.com>
Date:   2015-09-20T01:26:11Z

    keep Nimbus updated to the latest throughput stats

commit 1a2a9b38cd256b29cb0177450f29d03ce20471c3
Author: Li Wang <wa...@gmail.com>
Date:   2015-09-21T05:27:05Z

    display throughput metrics on web UI

----


> Add throughput metric to spout/bolt and display them on web ui
> --------------------------------------------------------------
>
>                 Key: STORM-1057
>                 URL: https://issues.apache.org/jira/browse/STORM-1057
>             Project: Apache Storm
>          Issue Type: New Feature
>            Reporter: Li Wang
>            Assignee: Li Wang
>   Original Estimate: 168h
>  Remaining Estimate: 168h
>
> Throughput is a fundamental metric to reasoning about the performance bottleneck of a topology. Displaying the throughputs of components and tasks on the web ui could greatly facilitate the user identifying the performance bottleneck and checking whether the the workload among components and tasks are balanced. 
> What to do:
> 1. Measure the throughput of each spout/bolt.
> 2. Display the throughput metrics on web UI.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)