[jira] [Commented] (HELIX-345) Speed up the controller pipelines

["Kanak Biscuitwala (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HELIX-345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13849972#comment-13849972 ] 

Kanak Biscuitwala commented on HELIX-345:
-----------------------------------------

A good way to start is to vary parameters like nodes, resources, partitions, replicas, etc, and see how that impacts the time needed to run the pipeline (and the number of times the pipeline is run). We can hold variables fixed while changing two of them simultaneously, producing a few 2D graphs.

Then, we can find the bottlenecks and fix them through caching, parallelization, or any other strategy that makes sense.

> Speed up the controller pipelines
> ---------------------------------
>
>                 Key: HELIX-345
>                 URL: https://issues.apache.org/jira/browse/HELIX-345
>             Project: Apache Helix
>          Issue Type: Bug
>    Affects Versions: 0.6.2-incubating, 0.7.0-incubating
>            Reporter: Kanak Biscuitwala
>            Assignee: Kanak Biscuitwala
>
> ReadClusterDataStage can take some time. We should have techniques for speeding it up like parallelizing or caching.



--
This message was sent by Atlassian JIRA
(v6.1.4#6159)