[jira] [Commented] (HELIX-345) Speed up the controller pipelines

["Hudson (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HELIX-345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13907346#comment-13907346 ] 

Hudson commented on HELIX-345:
------------------------------

SUCCESS: Integrated in helix #1230 (See [https://builds.apache.org/job/helix/1230/])
[HELIX-345] Speed up the controller pipeline (kanak: rev 51329f6f0bbb8a43cdfd06ffd3bf7ac5c8a93c68)
* helix-core/src/main/java/org/apache/helix/task/TaskUtil.java
* helix-core/src/main/java/org/apache/helix/api/Cluster.java
* helix-core/src/main/java/org/apache/helix/controller/stages/BestPossibleStateCalcStage.java
* helix-core/src/test/java/org/apache/helix/controller/stages/TestRebalancePipeline.java
* helix-core/src/main/java/org/apache/helix/controller/stages/MessageGenerationStage.java
* helix-core/src/main/java/org/apache/helix/model/ResourceConfiguration.java
* helix-core/src/main/java/org/apache/helix/controller/stages/ResourceComputationStage.java
* helix-core/src/main/java/org/apache/helix/controller/stages/PersistContextStage.java
* helix-core/src/main/java/org/apache/helix/controller/rebalancer/config/FullAutoRebalancerConfig.java
* helix-core/src/main/java/org/apache/helix/model/IdealState.java
* helix-core/src/main/java/org/apache/helix/tools/ClusterExternalViewVerifier.java
* helix-core/src/test/java/org/apache/helix/integration/TestUserDefRebalancerCompatibility.java
* helix-core/src/test/java/org/apache/helix/integration/TestReelectedPipelineCorrectness.java
* helix-core/src/main/java/org/apache/helix/ConfigAccessor.java
* helix-core/src/main/java/org/apache/helix/controller/rebalancer/config/SemiAutoRebalancerConfig.java
* helix-core/src/main/java/org/apache/helix/controller/stages/MessageThrottleStage.java
* helix-core/src/main/java/org/apache/helix/controller/stages/ExternalViewComputeStage.java
* helix-core/src/test/java/org/apache/helix/api/TestNewStages.java
* helix-core/src/main/java/org/apache/helix/controller/stages/PersistAssignmentStage.java
* helix-core/src/test/java/org/apache/helix/monitoring/TestClusterStatusMonitorLifecycle.java
* helix-core/src/main/java/org/apache/helix/controller/rebalancer/FullAutoRebalancer.java
* helix-core/src/main/java/org/apache/helix/tools/YAMLClusterSetup.java
* helix-core/src/main/java/org/apache/helix/controller/strategy/AutoRebalanceStrategy.java
* helix-core/src/main/java/org/apache/helix/tools/ClusterStateVerifier.java
* helix-core/src/main/java/org/apache/helix/api/config/ClusterConfig.java
* helix-core/src/main/java/org/apache/helix/controller/stages/TaskAssignmentStage.java
* helix-core/src/main/java/org/apache/helix/controller/stages/ReadClusterDataStage.java
* helix-core/src/main/java/org/apache/helix/controller/rebalancer/RebalancerRef.java
* helix-core/src/main/java/org/apache/helix/controller/GenericHelixController.java
* helix-core/src/main/java/org/apache/helix/controller/stages/MessageSelectionStage.java
* helix-core/src/main/java/org/apache/helix/controller/stages/CompatibilityCheckStage.java
* helix-core/src/main/java/org/apache/helix/controller/stages/ClusterDataCache.java
* helix-core/src/main/java/org/apache/helix/controller/stages/CurrentStateComputationStage.java
* helix-core/src/test/java/org/apache/helix/Mocks.java
* helix-core/src/main/java/org/apache/helix/task/TaskRebalancer.java
* helix-core/src/main/java/org/apache/helix/model/ResourceAssignment.java
* helix-core/src/test/java/org/apache/helix/controller/stages/TestResourceValidationStage.java
* helix-core/src/main/java/org/apache/helix/controller/rebalancer/config/PartitionedRebalancerConfig.java
* helix-core/src/main/java/org/apache/helix/controller/rebalancer/config/CustomRebalancerConfig.java
* helix-core/src/main/java/org/apache/helix/manager/zk/ZKHelixDataAccessor.java
* helix-core/src/main/java/org/apache/helix/controller/stages/ResourceValidationStage.java
* helix-core/src/main/java/org/apache/helix/api/accessor/ClusterAccessor.java
* helix-core/src/main/java/org/apache/helix/api/accessor/ResourceAccessor.java
* helix-core/src/main/java/org/apache/helix/controller/rebalancer/config/RebalancerConfigHolder.java


> Speed up the controller pipelines
> ---------------------------------
>
>                 Key: HELIX-345
>                 URL: https://issues.apache.org/jira/browse/HELIX-345
>             Project: Apache Helix
>          Issue Type: Bug
>    Affects Versions: 0.6.2-incubating, 0.7.0-incubating
>            Reporter: Kanak Biscuitwala
>            Assignee: Kanak Biscuitwala
>
> ReadClusterDataStage can take some time. We should have techniques for speeding it up like parallelizing or caching.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)