You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2021/01/20 23:38:56 UTC

[GitHub] [airflow] jsmodic opened a new issue #13802: max_active_runs doesn't seem to work anymore (in 1.10.14)

jsmodic opened a new issue #13802:
URL: https://github.com/apache/airflow/issues/13802


   **Apache Airflow version**:
   
   1.10.14
   
   **Environment**:
   
   Regular Airflow setup:
   Python 3.6.2
   Airflow 1.10.14
   Celery 4.3.0
   
   **What happened**:
   
   max_active_runs isn't limiting DAG runs. I set it to 20 but more than 20 are running.
   
   It used to work on older versions of 1.10.
   
   **What you expected to happen**:
   
   DAG Runs to be limited to what I set in max_active_runs
   
   
   **Anything else we need to know**:
   
   I've had "max_active_runs" set as a DAG parameter for a long time and it always worked fine until this latest update I went from 1.10.12 -> 1.10.14. 
   
   I didn't see anything relevant in the upgrade changelogs, so I didn't realize it wasn't working until I look into some problems.
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] jsmodic commented on issue #13802: max_active_runs doesn't seem to work anymore (in 1.10.14)

Posted by GitBox <gi...@apache.org>.
jsmodic commented on issue #13802:
URL: https://github.com/apache/airflow/issues/13802#issuecomment-764058641






----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] kaxil closed issue #13802: max_active_runs doesn't seem to work anymore (in 1.10.14)

Posted by GitBox <gi...@apache.org>.
kaxil closed issue #13802:
URL: https://github.com/apache/airflow/issues/13802


   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] jsmodic commented on issue #13802: max_active_runs doesn't seem to work anymore (in 1.10.14)

Posted by GitBox <gi...@apache.org>.
jsmodic commented on issue #13802:
URL: https://github.com/apache/airflow/issues/13802#issuecomment-764065462


   Looks like it broke here: https://github.com/apache/airflow/commit/cb8d53fbc64af8d6c175d0dda6ae51db65ccc19b


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] jsmodic commented on issue #13802: max_active_runs doesn't seem to work anymore (in 1.10.14)

Posted by GitBox <gi...@apache.org>.
jsmodic commented on issue #13802:
URL: https://github.com/apache/airflow/issues/13802#issuecomment-764058641


   As far as I can tell:
   
   https://github.com/apache/airflow/blob/1.10.14/airflow/jobs/scheduler_job.py#L794
   
   never actually populates "active_dag_runs" anymore like in 1.10.12
   
   https://github.com/apache/airflow/blob/1.10.12/airflow/jobs/scheduler_job.py#L796


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] kaxil closed issue #13802: max_active_runs doesn't seem to work anymore (in 1.10.14)

Posted by GitBox <gi...@apache.org>.
kaxil closed issue #13802:
URL: https://github.com/apache/airflow/issues/13802


   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] kaxil commented on issue #13802: max_active_runs doesn't seem to work anymore (in 1.10.14)

Posted by GitBox <gi...@apache.org>.
kaxil commented on issue #13802:
URL: https://github.com/apache/airflow/issues/13802#issuecomment-764163774


   closed by https://github.com/apache/airflow/pull/13803


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] kaxil commented on issue #13802: max_active_runs doesn't seem to work anymore (in 1.10.14)

Posted by GitBox <gi...@apache.org>.
kaxil commented on issue #13802:
URL: https://github.com/apache/airflow/issues/13802#issuecomment-764163774


   closed by https://github.com/apache/airflow/pull/13803


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org