You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@gobblin.apache.org by "Abhishek Tiwari (JIRA)" <ji...@apache.org> on 2017/08/15 19:32:00 UTC

[jira] [Updated] (GOBBLIN-202) Add better metrics to gobblin to support AWS autoscaling

     [ https://issues.apache.org/jira/browse/GOBBLIN-202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Abhishek Tiwari updated GOBBLIN-202:
------------------------------------
    Sprint: Apache Gobblin 170807

> Add better metrics to gobblin to support AWS autoscaling
> --------------------------------------------------------
>
>                 Key: GOBBLIN-202
>                 URL: https://issues.apache.org/jira/browse/GOBBLIN-202
>             Project: Apache Gobblin
>          Issue Type: Improvement
>            Reporter: Joel Baranick
>            Assignee: Joel Baranick
>
> Autoscaling Gobblin via CPU usage is suboptimal as it is not related to the amount of work to do.  In a perfect system gobblin worker nodes would be running at nearly 100% cpu. Therefore, autoscaling by this metric would not work. To support autoscaling new metrics should be added that indicate the amount of work that gobblin needs to do.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)