You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@beam.apache.org by "Zhuo Liu (JIRA)" <ji...@apache.org> on 2017/10/11 21:10:02 UTC

[jira] [Created] (BEAM-3045) Can't find autoscaling algorithm for streaming workflows

Zhuo Liu created BEAM-3045:
------------------------------

             Summary: Can't find autoscaling algorithm for streaming workflows
                 Key: BEAM-3045
                 URL: https://issues.apache.org/jira/browse/BEAM-3045
             Project: Beam
          Issue Type: Improvement
          Components: runner-dataflow
            Reporter: Zhuo Liu
            Assignee: Thomas Groh
            Priority: Minor


Hi I see there is an auto-scaling algorithm for google dataflow.
https://cloud.google.com/dataflow/service/dataflow-service-desc

Also enum AutoscalingAlgorithmType{NONE, BASIC, THROUGHPUT_BASED} could be found in org.apache.beam.runners.dataflow.options.DataflowPipelineWorkerPoolOptions, however, I was not able to find the actual algorithm implementation for the THROUGHPUT_BASED scaling algorithm.
Anyone could help?
I was especially interested in the autoscaling algorithm for streaming workflows.

Thanks a lot!



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)