You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2021/01/15 16:02:22 UTC
[GitHub] [airflow] Adam-Leyshon commented on issue #9975: max_active_runs = 1 can still create multiple active execution runs
Adam-Leyshon commented on issue #9975:
URL: https://github.com/apache/airflow/issues/9975#issuecomment-761028139
This issue is affecting 1.10.14.
Upgrading to 2.0 is not possible for us at this time since we have a number of internal blockers on plugins that we wrote that require refactoring.
We cleared a DAG run for 2019-01-01 and selected the all future tasks option,
Now it want to processes over 200 runs at the same time
We did not experience this issue in 1.10.9.
Instead it is now trying to run a single task for each of the active runs in parallel instead of waiting for the first run to complete.
What I expect to happen is for it to clear the tasks and then complete each run sequentially, our system requires data be loaded in that order, having multiple parallel runs is causing huge issues for us.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org