[GitHub] [airflow] ashb commented on issue #5079: [AIRFLOW-4285] Update task dependency context defination and usage

[GitBox <gi...@apache.org>]

ashb commented on issue #5079: [AIRFLOW-4285] Update task dependency context defination and usage
URL: https://github.com/apache/airflow/pull/5079#issuecomment-561716214
 
 
   @KevinYang21 Confirmed, it still happens, and seems to be an issue when the tasks "overflow" the executor.
   
   For example, set:
   
   - AIRFLOW__CORE__PARALLELISM=5
   - ```
     dag = DAG('example_dag',
                max_active_runs=50,
                concurrency=500,```
   
   We've got a one-line fix for it too:
   
   https://github.com/astronomer/airflow/commit/8d0ee05976db021d4f3185d5ca55ae818fc1f7a0
   
   (It took about 5 person-days to track down! Always the way with one line fixes.)
   
   Once we've got unit tests added too we'll open a PR. Unfortunately this bug also affects 1.10.6 as we cherry-picked this change :(

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services