[GitHub] [airflow] iercan opened a new issue #20518: Landing Times and Task Duration Charts crashes for big dags.

[GitBox <gi...@apache.org>]

iercan opened a new issue #20518:
URL: https://github.com/apache/airflow/issues/20518


   ### Apache Airflow version
   
   2.2.3 (latest released)
   
   ### What happened
   
   I've upgraded airflow from 2.1.4 to 2.2.3.(tested 2.2.0 also) Small dags are okay but that one dag I have 170+ task and when I open task tries or landing times graphs page, page gets unresponsive and crash. I had to rollback because of this problem.
   
   On webserver logs show this error.
   
   > airflow_1     | [2021-12-27 14:34:28 +0000] [45] [CRITICAL] WORKER TIMEOUT (pid:410)
   > airflow_1     | [2021-12-27 14:34:28 +0000] [410] [INFO] Worker exiting (pid: 410)
   > airflow_1     | [2021-12-27 14:34:28 +0000] [443] [INFO] Booting worker with pid: 443
   
   ### What you expected to happen
   
   Landing page and task tries pages should load successfully. 
   
   ### How to reproduce
   
   To reproduce this you should have a dag that have about +170 task and have running logs about 30 days. Then upgrade airflow from 2.1.4 to >2.2.0. After that landing times and task tries pages will get unresponsive. 
   
   ### Operating System
   
   Debian 9
   
   ### Versions of Apache Airflow Providers
   
   > apache-airflow-providers-amazon==2.5.0
   apache-airflow-providers-celery==2.1.0
   apache-airflow-providers-cncf-kubernetes==2.2.0
   apache-airflow-providers-docker==2.3.0
   apache-airflow-providers-elasticsearch==2.1.0
   apache-airflow-providers-ftp==2.0.1
   apache-airflow-providers-google==6.2.0
   apache-airflow-providers-grpc==2.0.1
   apache-airflow-providers-hashicorp==2.1.1
   apache-airflow-providers-http==2.0.1
   apache-airflow-providers-imap==2.0.1
   apache-airflow-providers-microsoft-azure==3.4.0
   apache-airflow-providers-mysql==2.1.1
   apache-airflow-providers-odbc==2.0.1
   apache-airflow-providers-postgres==2.4.0
   apache-airflow-providers-redis==2.0.1
   apache-airflow-providers-sendgrid==2.0.1
   apache-airflow-providers-sftp==2.3.0
   apache-airflow-providers-slack==4.1.0
   apache-airflow-providers-sqlite==2.0.1
   apache-airflow-providers-ssh==2.3.0
   
   
   ### Deployment
   
   Docker-Compose
   
   ### Deployment details
   
   Airflow deployed with docker by using official apache/airflow image.
   Meta database is postgresql 9.6
   
   ### Anything else
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org