You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2021/01/26 02:58:25 UTC
[GitHub] [airflow] zlhsmfj opened a new issue #13902: Scheduler never schedules, and dag.max_active_run doesn't work
zlhsmfj opened a new issue #13902:
URL: https://github.com/apache/airflow/issues/13902
Apache Airflow version: 1.10.13 - 1.10.14
https://github.com/apache/airflow/blob/5b61c21ab5c2f16e94967ed60c7e9b8b38d401ef/airflow/jobs/scheduler_job.py#L769-L799
The update of `active_dag_runs` lost in the for loop, cause 2 problems:
1. dag.max_active_run doesn't work.
2. Scheduler will never schedule while there are too many running dag_runs (dag_file_processor_timeout).
Fix:
```
if run.state == State.RUNNING:
+ active_dag_runs.append(run)
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] zlhsmfj closed issue #13902: Scheduler never schedules, and dag.max_active_run doesn't work
Posted by GitBox <gi...@apache.org>.
zlhsmfj closed issue #13902:
URL: https://github.com/apache/airflow/issues/13902
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] zlhsmfj commented on issue #13902: Scheduler never schedules, and dag.max_active_run doesn't work
Posted by GitBox <gi...@apache.org>.
zlhsmfj commented on issue #13902:
URL: https://github.com/apache/airflow/issues/13902#issuecomment-771633689
Seems this bug has been fixed in branch v1-10-stable
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] boring-cyborg[bot] commented on issue #13902: Scheduler never schedules, and dag.max_active_run doesn't work
Posted by GitBox <gi...@apache.org>.
boring-cyborg[bot] commented on issue #13902:
URL: https://github.com/apache/airflow/issues/13902#issuecomment-767255744
Thanks for opening your first issue here! Be sure to follow the issue template!
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] zlhsmfj closed issue #13902: Scheduler never schedules, and dag.max_active_run doesn't work
Posted by GitBox <gi...@apache.org>.
zlhsmfj closed issue #13902:
URL: https://github.com/apache/airflow/issues/13902
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] zlhsmfj commented on issue #13902: Scheduler never schedules, and dag.max_active_run doesn't work
Posted by GitBox <gi...@apache.org>.
zlhsmfj commented on issue #13902:
URL: https://github.com/apache/airflow/issues/13902#issuecomment-771633689
Seems this bug has been fixed in branch v1-10-stable
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] zlhsmfj edited a comment on issue #13902: Scheduler never schedules, and dag.max_active_run doesn't work
Posted by GitBox <gi...@apache.org>.
zlhsmfj edited a comment on issue #13902:
URL: https://github.com/apache/airflow/issues/13902#issuecomment-771633689
Seems this bug has been fixed on branch v1-10-stable
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] boring-cyborg[bot] commented on issue #13902: Scheduler never schedules, and dag.max_active_run doesn't work
Posted by GitBox <gi...@apache.org>.
boring-cyborg[bot] commented on issue #13902:
URL: https://github.com/apache/airflow/issues/13902#issuecomment-767255744
Thanks for opening your first issue here! Be sure to follow the issue template!
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] zlhsmfj edited a comment on issue #13902: Scheduler never schedules, and dag.max_active_run doesn't work
Posted by GitBox <gi...@apache.org>.
zlhsmfj edited a comment on issue #13902:
URL: https://github.com/apache/airflow/issues/13902#issuecomment-771633689
Seems this bug has been fixed on branch v1-10-stable
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org