You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2021/03/17 13:43:37 UTC

[GitHub] [airflow] ashb edited a comment on issue #14744: Task Instances in the "shutdown" state prevent the scheduler from scheduling new tasks

ashb edited a comment on issue #14744:
URL: https://github.com/apache/airflow/issues/14744#issuecomment-801089725


   Ah, I wonder if the "correct" fix is then instead to look for zombie task in RUNNING or SHUTDOWN state, where as currently it only looks at them in the RUNNING state
   
   https://github.com/apache/airflow/blob/2a2adb3f94cc165014d746102e12f9620f271391/airflow/utils/dag_processing.py#L1077-L1089
   
   I wonder if a related problem is that the LocalTaskJob is never cleaned up and left in the Running state even though it isn't heartbeating anymore.
   
   @larsjeh Could you go to Browse -> Jobs and see if you have a number of "old" LoclalTaskJobs in running?


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org