You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "Alex Guziel (JIRA)" <ji...@apache.org> on 2017/04/12 04:41:41 UTC
[jira] [Created] (AIRFLOW-1104) Concurrency check in scheduler
should count queued tasks as well as running
Alex Guziel created AIRFLOW-1104:
------------------------------------
Summary: Concurrency check in scheduler should count queued tasks as well as running
Key: AIRFLOW-1104
URL: https://issues.apache.org/jira/browse/AIRFLOW-1104
Project: Apache Airflow
Issue Type: Bug
Environment: see https://github.com/apache/incubator-airflow/pull/2221
"Tasks with the QUEUED state should also be counted below, but for now we cannot count them. This is because there is no guarantee that queued tasks in failed dagruns will or will not eventually run and queued tasks that will never run will consume slots and can stall a DAG. Once we can guarantee that all queued tasks in failed dagruns will never run (e.g. make sure that all running/newly queued TIs have running dagruns), then we can include QUEUED tasks here, with the constraint that they are in running dagruns."
Reporter: Alex Guziel
Priority: Minor
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)