You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@airflow.apache.org by "Dan Davydov (JIRA)" <ji...@apache.org> on 2018/03/03 08:47:00 UTC

[jira] [Created] (AIRFLOW-2173) Don't check task IDs for concurrency reached check

Dan Davydov created AIRFLOW-2173:
------------------------------------

             Summary: Don't check task IDs for concurrency reached check
                 Key: AIRFLOW-2173
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-2173
             Project: Apache Airflow
          Issue Type: Bug
          Components: core
            Reporter: Dan Davydov
            Assignee: Dan Davydov


Currently the concurrency reached check does a filter in the DB query to only include tasks that are currently in the parsed DAG. For sufficiently large DAGs with many tasks, this causes mysql to use an inefficient query plan and can put a lot of load on the database. Since there is no good reason to omit old running tasks in a DAG from concurrency, this filter should just be removed.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)