[GitHub] [airflow] holyachon edited a comment on issue #19901: No scheduling when max_active_runs is 1

[GitBox <gi...@apache.org>]

holyachon edited a comment on issue #19901:
URL: https://github.com/apache/airflow/issues/19901#issuecomment-1029889193


   @easontm @alexakra 
   Hello. I'm also experiencing a similar situation closer to @easontm, where the scheduler does not schedule a DAG in Airflow 2.2.3.
   I have a "DAG for health check" of which schedule_interval is `*/10 * * * *` (runs every ten minutes). And almost every specific time(02:20), this dag is not scheduled and column `DAG.next_dagrun_create_after` is NULL.
   After a few minutes later (ex. 02:25~30), the dag is scheduled only then. So there is a delay in dag scheduling. ( `airflow_dagrun_schedule_delay` metric is below)
   ![FA1F25F3-9CB3-4B5B-AAD1-96BD4B7F81A6](https://user-images.githubusercontent.com/3615955/152519810-9b159d96-2982-4dac-bca1-44ac1e039de7.png)
   
   
   I think it happens because many tasks are running and scheduled at 02:20, but they work(run or scheduled) well except "health check DAG".
   
   > Another correlated symptom is that affected DAGs no longer get any scheduler/processing logs (in $AIRFLOW_HOME/logs/scheduler/<DATE>/...).
   
   Also there is no scheduler log about affected DAG same as @easontm.
   
   Is there any other workaround or solution without downgrade?
   Thank you in advance :)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org