You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2022/02/01 21:45:40 UTC

[GitHub] [airflow] csm10495 commented on issue #21078: DAG with multiple async tasks leads to MySQL errors... which lead to failed tasks

csm10495 commented on issue #21078:
URL: https://github.com/apache/airflow/issues/21078#issuecomment-1027317538


   So there were several tasks that 
   
   ```
            /- Task1
   Start 
            \- Task2
   
            \- Task...n
   ```
   Each task was just a simple Python Operator doing something external. 
   
   This was more easy to reproduce if we set AIRFLOW__CORE__PARALLELISM and AIRFLOW__CORE__MAX_ACTIVE_TASKS_PER_DAG  to something high like 128 and then had a dag with 200+ parallel tasks. Though we had seen it in a case with neither set (so the fell to defaults).
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org