You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "t oo (JIRA)" <ji...@apache.org> on 2019/08/08 20:37:00 UTC
[jira] [Created] (AIRFLOW-5149) Config flag to skip SLA checks
t oo created AIRFLOW-5149:
-----------------------------
Summary: Config flag to skip SLA checks
Key: AIRFLOW-5149
URL: https://issues.apache.org/jira/browse/AIRFLOW-5149
Project: Apache Airflow
Issue Type: Improvement
Components: DAG, DagRun, scheduler
Affects Versions: 1.10.4
Reporter: t oo
Fix For: 2.0.0
Some airflow users have no use of managing SLAs within airflow. I believe the scheduling process should be as fast as possible and not do unnecessary logging, the current IF statement is slower than a boolean flag and produces a redundant log.
h1. *EXISTING BEHAVIOR*
|if not any([isinstance(ti.sla, timedelta) for ti in dag.tasks]):|
| |self.log.info("Skipping SLA check for %s because no tasks in DAG have SLAs", dag)|
| |return|
h1. *FIX*
[https://github.com/apache/airflow/blob/master/airflow/jobs/scheduler_job.py]
within
|def _process_dags(self, dagbag, dags, tis_out):|
line 1221
*BEFORE*
self._process_task_instances(dag, tis_out)
self.manage_slas(dag)
*AFTER*
1.
self._process_task_instances(dag, tis_out)
if conf.getboolean('scheduler', 'CHECK_SLA'):
self.manage_slas(dag)
2. config then has a new variable check_sla with default true so existing users unaffected but other users can set to false.
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)