You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@airflow.apache.org by "Fokko Driesprong (JIRA)" <ji...@apache.org> on 2018/03/06 09:36:00 UTC

[jira] [Resolved] (AIRFLOW-2173) Don't check task IDs for concurrency reached check

     [ https://issues.apache.org/jira/browse/AIRFLOW-2173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Fokko Driesprong resolved AIRFLOW-2173.
---------------------------------------
       Resolution: Fixed
    Fix Version/s: 2.0.0

Issue resolved by pull request #3099
[https://github.com/apache/incubator-airflow/pull/3099]

> Don't check task IDs for concurrency reached check
> --------------------------------------------------
>
>                 Key: AIRFLOW-2173
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-2173
>             Project: Apache Airflow
>          Issue Type: Bug
>          Components: core
>            Reporter: Dan Davydov
>            Assignee: Dan Davydov
>            Priority: Major
>             Fix For: 2.0.0
>
>
> Currently the concurrency reached check does a filter in the DB query to only include tasks that are currently in the parsed DAG. For sufficiently large DAGs with many tasks, this causes mysql to use an inefficient query plan and can put a lot of load on the database. Since there is no good reason to omit old running tasks in a DAG from concurrency, this filter should just be removed.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)