You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "Wu Xiang (JIRA)" <ji...@apache.org> on 2016/09/02 07:07:20 UTC
[jira] [Commented] (AIRFLOW-78) airflow clear leaves dag_runs
[ https://issues.apache.org/jira/browse/AIRFLOW-78?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15457747#comment-15457747 ]
Wu Xiang commented on AIRFLOW-78:
---------------------------------
hi [~sanand],
This PR will prevent Airflow to process task instances for running DagRuns when max_active_dag_runs reached.
This should be a bug, when max_active_dag_runs are reached, several things should still be processed,
1) _process_task_instances for running dag runs
2) manage_slas for running dag runs
3) prevent generating new dag runs
relative line of code:
https://github.com/apache/incubator-airflow/blob/master/airflow/jobs.py#L1076
> airflow clear leaves dag_runs
> -----------------------------
>
> Key: AIRFLOW-78
> URL: https://issues.apache.org/jira/browse/AIRFLOW-78
> Project: Apache Airflow
> Issue Type: Wish
> Components: cli
> Affects Versions: Airflow 1.6.2
> Reporter: Adrian Bridgett
> Assignee: Norman Mu
> Priority: Minor
>
> (moved from https://github.com/apache/incubator-airflow/issues/829)
> "airflow clear -c -d -s 2016-01-03 dagid" doesn't clear the dagrun, it sets it to running instead (apparently since this is often used to re-run jobs).
> However this then breaks max_active_runs=1 (I have to stop the scheduler, then airflow clear, psql to delete the dagrun, then start the scheduler).
> This problem was probably seen on an Airflow 1.6.x install.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)