[jira] [Updated] (AIRFLOW-2996) Airflow subdag is failed while the child task is still running or succeded

["Aizhamal Nurmamat kyzy (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/AIRFLOW-2996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Aizhamal Nurmamat kyzy updated AIRFLOW-2996:
--------------------------------------------
         Labels: subdag  (was: )
    Component/s: operators

Adding 'operators' component and 'subdag' label for component refactor.

> Airflow subdag is failed while the child task is still running or succeded
> --------------------------------------------------------------------------
>
>                 Key: AIRFLOW-2996
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-2996
>             Project: Apache Airflow
>          Issue Type: Bug
>          Components: operators, subdag
>    Affects Versions: 1.9.0
>            Reporter: Vijay Arum
>            Priority: Major
>              Labels: subdag
>
> Airflow subdag is failed while the child task is still running or succeded. subdag when retries on failure , tries to execute  the child task which is already in running , this causes a deadlock and subdag is failed eventually after all attempts. while all  child task succeds.
> this issue occurring frequency is not that often .
> i have a subdag with bunch of tasks. i have set retries to 2. once in a while the subdag fails in {color:#14892c}first attempt bcoz of mysql connection{color} "{color:#FF0000}sqlalchemy.exc.OperationalError: (_mysql_exceptions.OperationalError) (2013, 'Lost connection to MySQL server at \'reading initial communication packet\', system error: 0 "Internal error/check (Not system error)"') (Background on this error at: [http://sqlalche.me/e/e3q8)]"{color}
>  subdag initiates retry 1, subdag tries to re execute running child task, which violates task instance state violation. {color:#d04437}"Task is in the 'running' state which is not a valid state for execution. The task must be cleared in order to be run." {color:#333333}subdag retry evenually fails with the message{color} "following taska are deadlocked "{color}
>  
> {color:#d04437}{color:#333333} subdag initiates retry 2,{color} subdag tries to re execute running child task, which violates task instance state violation. "Task is in the 'running' state which is not a valid state for execution. The task must be cleared in order to be run." {color:#333333}subdag retry evenually fails with the message{color} "following taska are deadlocked "{color}
>  
> {color:#333333}finally subdag is marked as failed while all child tasks suceeds{color}
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)