[jira] [Created] (STORM-642) Add Storm Benchmarking Framework

["P. Taylor Goetz (JIRA)" <ji...@apache.org>]

P. Taylor Goetz created STORM-642:
-------------------------------------

             Summary: Add Storm Benchmarking Framework
                 Key: STORM-642
                 URL: https://issues.apache.org/jira/browse/STORM-642
             Project: Apache Storm
          Issue Type: Improvement
          Components: external
            Reporter: P. Taylor Goetz
            Assignee: P. Taylor Goetz


(This is intended to be a parent for a multi-task JIRA)

Add a framework for benchmarking Storm topologies and clusters that would capture basic throughput (messages/sec., MB/sec.) and latency metrics.

Allow for the definition of named "benchmark suites" in a configuration file (i.e. YAML) that would define multiple runs of the same benchmark with different tuning parameters (# workers, parallelism hints, etc.). This would allow for easy comparison of different runs to show how different tuning options affect overall performance.

Develop and benchmark both Core Storm and Trident Topologies to illustrate the difference in performance characteristics. Benchmark multiple trident constructs (joins, aggregations, partition(Persist), etc.) to illustrate performance implications.

Document results in a blog post series "Benchmarking Storm" on storm.apache.org/blog.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)