[GitHub] [airflow] kristoffern commented on pull request #19769: Handle stuck queued tasks in Celery for db backend

[GitBox <gi...@apache.org>]

kristoffern commented on pull request #19769:
URL: https://github.com/apache/airflow/pull/19769#issuecomment-1026656132


   @ephraimbuddy I've now deployed the modified patch-file to our Kubernetes cluster and tested since yesterday.
   
   In short I started all our parallel DAG runs for the data processing/ETL that we do.
   In the past it's reproduced the bug on virtually every attempt with tasks that get stuck in "Queued".
   
   At the moment I've ran it 4 times and on none of the runs have I seen the bug occur. 
   Now of course this isn't proof the bug is resolved, but it has drastically reduced the odds that the bug is still there :+1: 
   
   So to summarize:
   
   A: Patch doesn't break the system
   B: Patch by all accounts fixes the stuck in queued bug to occur.
   
   [19769-without-NEW_SESSION.patch.txt](https://github.com/apache/airflow/files/7977405/19769-without-NEW_SESSION.patch.txt)
   .
   
   Thank you for the hard work, and likely I will use this patch and modified Dockerfile in our deployment scripts until 2.2.4 or 2.3.0 is released :+1: 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org