Re: [I] Flaky task expansion in backfills [airflow]

["syun64 (via GitHub)" <gi...@apache.org>]

syun64 commented on issue #33543:
URL: https://github.com/apache/airflow/issues/33543#issuecomment-1811763148

   Hi @uranusjr I'm actually still seeing issues with this specific task - and non-deterministically so. It succeeds in some CI containers, and succeeds in others. I've tried looking into task expansions, and my general understanding is that this error is being raised because the upstream tasks have not yet finished: https://github.com/apache/airflow/blob/main/airflow/models/expandinput.py#L153
   
   Which is surprising, because the TriggerRule for the task that expands is TriggerRule.ALL_DONE - so tasks should have been finished by then... I'm happy to continue taking a look to try to [fix this test for my open PR](https://github.com/apache/airflow/pull/33532), but if you have some pointers on what could be going wrong - please let me know! It'll be very helpful, especially given that I lack experience working with task expansions in live DAGs


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org