You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@storm.apache.org by revans2 <gi...@git.apache.org> on 2015/10/17 21:14:58 UTC
[GitHub] storm pull request: STORM-1118: Added test to compare latency vs. ...
GitHub user revans2 opened a pull request:
https://github.com/apache/storm/pull/805
STORM-1118: Added test to compare latency vs. throughput in storm.
Also added a metrics gathering server for testing, an HdrHistogram based metric, and CPU utilization metric using sigar.
This should provide a simple test for comparing different versions of storm to one another or different hardware options. The goal is to produce a load at a given throughput and measure the latency it takes the system to process that throughput. Generally if you have a given SLA you want the same hardware to handle the most throughput possible to meet your SLA.
The current test uses word count, but should easily be extended to handle more complex processing.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/revans2/incubator-storm STORM-1118-perf
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/storm/pull/805.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #805
----
commit c356c35aeab17bc14861bf7efa8ddedd3f257741
Author: Robert (Bobby) Evans <ev...@yahoo-inc.com>
Date: 2015-10-16T19:57:23Z
STORM-1118: Added test to compair latency vs throughput in storm.
Also added a metrics gathering server for testing, an HdrHistogram based metric, and CPU utilization metric using sigar.
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] storm pull request: STORM-1118: Added test to compare latency vs. ...
Posted by kishorvpatil <gi...@git.apache.org>.
Github user kishorvpatil commented on the pull request:
https://github.com/apache/storm/pull/805#issuecomment-149225741
LGTM. +1. `storm-metrics` would be useful sub-module to keep up our efforts with improving storm metrics.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] storm pull request: STORM-1118: Added test to compare latency vs. ...
Posted by jerrypeng <gi...@git.apache.org>.
Github user jerrypeng commented on the pull request:
https://github.com/apache/storm/pull/805#issuecomment-149334480
+1 this is going to be very useful when attempting to profile storm performance and underlying hardware performance
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] storm pull request: STORM-1118: Added test to compare latency vs. ...
Posted by asfgit <gi...@git.apache.org>.
Github user asfgit closed the pull request at:
https://github.com/apache/storm/pull/805
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---