You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "ASF subversion and git services (JIRA)" <ji...@apache.org> on 2017/01/03 13:13:58 UTC
[jira] [Commented] (AIRFLOW-673) Add operational metrics test for
SchedulerJob
[ https://issues.apache.org/jira/browse/AIRFLOW-673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15795038#comment-15795038 ]
ASF subversion and git services commented on AIRFLOW-673:
---------------------------------------------------------
Commit 7fa86f72c6b6892bdc0621179cc01d67b2b59001 in incubator-airflow's branch refs/heads/master from [~vijaysbhat]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-airflow.git;h=7fa86f7 ]
[AIRFLOW-673] Add operational metrics test for SchedulerJob
Extend SchedulerJob to instrument the execution
performance of task instances contained in each
DAG.
We want to know if any DAG is starved of resources,
and this will be reflected in the stats printed
out at the end of the test run.
Extend SchedulerJob to instrument the execution
performance of task instances contained in each
DAG. We want to know if any DAG is starved of
resources, and this will be reflected in the stats
printed out at the end of the test run.
this test is for instrumenting
the operational impact of
https://github.com/apache/incubator-
airflow/pull/1906
Closes #1919 from vijaysbhat/scheduler_perf_tool
> Add operational metrics test for SchedulerJob
> ---------------------------------------------
>
> Key: AIRFLOW-673
> URL: https://issues.apache.org/jira/browse/AIRFLOW-673
> Project: Apache Airflow
> Issue Type: Test
> Components: core, scheduler, tests
> Reporter: Vijay Bhat
> Assignee: Vijay Bhat
>
> Add a performance test to supply operational metrics for SchedulerJob. We want to know if any DAG is starved of resources, and this will be reflected in the stats printed out at the end of the test run.
> Please refer to the discussion in the PR - https://github.com/apache/incubator-airflow/pull/1906.
> @bolkedbruin - This has operational consequences which I can not fully oversee. Such as the scheduling now might be biased towards one dag (ie. do other dags run at all?). While this issue is already there it might become more prevalent because of this.
> Can you supply operational metrics @vijaysbhat?
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)