You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2022/09/14 16:07:50 UTC

[GitHub] [airflow] was-av opened a new issue, #26397: Deadlock dag_runs when max_active_runs=1 and dag_duration greater then schedule interval

was-av opened a new issue, #26397:
URL: https://github.com/apache/airflow/issues/26397

   ### Apache Airflow version
   
   Other Airflow 2 version
   
   ### What happened
   
   When max_active_runs set 1, new dag runs stopped when slow dag run duration greater then schedule interval
   
   ### What you think should happen instead
   
   New dag runs don't stop execution after slow dag run finished.
   
   ### How to reproduce
   
   DAG for reproduce
   ```python
   from airflow import DAG
   from airflow.operators.bash import BashOperator
   from pendulum import datetime
   
   default_args = {"owner": "airflow"}
   
   with DAG(
       dag_id="deadlock",
       start_date=datetime(2020, 2, 2),
       schedule_interval="* * * * *",
       catchup=False,
       default_args=default_args,
       max_active_runs=1,
       tags=["test"],
   ) as dag:
       op1 = BashOperator(task_id="op1", bash_command="echo START ; sleep 70; echo END")
   ```
   
   ### Operating System
   
   PRETTY_NAME="Debian GNU/Linux 11 (bullseye)" NAME="Debian GNU/Linux" VERSION_ID="11" VERSION="11 (bullseye)" VERSION_CODENAME=bullseye ID=debian HOME_URL="https://www.debian.org/" SUPPORT_URL="https://www.debian.org/support" BUG_REPORT_URL="https://bugs.debian.org/"
   
   ### Versions of Apache Airflow Providers
   
   Apache Airflow
   version                | 2.3.2 
   
   ### Deployment
   
   Docker-Compose
   
   ### Deployment details
   
   _No response_
   
   ### Anything else
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [airflow] potiuk commented on issue #26397: Deadlock dag_runs when max_active_runs=1 and dag_duration greater then schedule interval

Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #26397:
URL: https://github.com/apache/airflow/issues/26397#issuecomment-1248063146

   Yeah. Sometimes we get such fixes as "by-product" of other fixes, so upgrading to latest version from the "major" line is always good thing to try first. Saves a ton of time! 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [airflow] potiuk commented on issue #26397: Deadlock dag_runs when max_active_runs=1 and dag_duration greater then schedule interval

Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #26397:
URL: https://github.com/apache/airflow/issues/26397#issuecomment-1247105188

   I think we had some issues fixed around that recently. Can you please upgrade to 2.3.4 and check it there (you will have to do it anyway and you can save us investigation and yourself time to answer questions we might have)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [airflow] was-av commented on issue #26397: Deadlock dag_runs when max_active_runs=1 and dag_duration greater then schedule interval

Posted by GitBox <gi...@apache.org>.
was-av commented on issue #26397:
URL: https://github.com/apache/airflow/issues/26397#issuecomment-1247696750

   I don't find this fix in the changelog, but this bug is not reproducible in version 2.3.4.
   Thanks for the quick response.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [airflow] boring-cyborg[bot] commented on issue #26397: Deadlock dag_runs when max_active_runs=1 and dag_duration greater then schedule interval

Posted by GitBox <gi...@apache.org>.
boring-cyborg[bot] commented on issue #26397:
URL: https://github.com/apache/airflow/issues/26397#issuecomment-1246991321

   Thanks for opening your first issue here! Be sure to follow the issue template!
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [airflow] was-av closed issue #26397: Deadlock dag_runs when max_active_runs=1 and dag_duration greater then schedule interval

Posted by GitBox <gi...@apache.org>.
was-av closed issue #26397: Deadlock dag_runs when max_active_runs=1 and dag_duration greater then schedule interval
URL: https://github.com/apache/airflow/issues/26397


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org