You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@gobblin.apache.org by "Urmi Mustafi (Jira)" <ji...@apache.org> on 2023/03/02 22:49:00 UTC

[jira] [Updated] (GOBBLIN-1793) Add metrics to measure and isolate bottleneck for initializing scheduler

     [ https://issues.apache.org/jira/browse/GOBBLIN-1793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Urmi Mustafi updated GOBBLIN-1793:
----------------------------------
    Component/s: gobblin-service
    Description: Add metrics to benchmark runtime of every piece of work involved to initialize the scheduler from the catalog to identify the bottleneck. We suspect the main time is taken to obtain specs from the mysqlstore, compile them, or schedule them but measure each part in case we are mistaken to identify a plan for improving the scheduler downtime during initialization. 

> Add metrics to measure and isolate bottleneck for initializing scheduler
> ------------------------------------------------------------------------
>
>                 Key: GOBBLIN-1793
>                 URL: https://issues.apache.org/jira/browse/GOBBLIN-1793
>             Project: Apache Gobblin
>          Issue Type: Bug
>          Components: gobblin-service
>            Reporter: Urmi Mustafi
>            Priority: Major
>
> Add metrics to benchmark runtime of every piece of work involved to initialize the scheduler from the catalog to identify the bottleneck. We suspect the main time is taken to obtain specs from the mysqlstore, compile them, or schedule them but measure each part in case we are mistaken to identify a plan for improving the scheduler downtime during initialization. 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)