You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2020/09/07 01:47:55 UTC

[GitHub] [airflow] foresightyj opened a new issue #10775: Some (not all) dags are not scheduled according to the configured interval (@daily). Why?

foresightyj opened a new issue #10775:
URL: https://github.com/apache/airflow/issues/10775


   I have about 10 airflow dags that needs to be run daily to check nightly builds of my system. So I scheduled them all with `@daily` intervals. But only some of them are scheduled as expected while others don't. So for the past few weeks I always trigger them manually.
   
   The screenshot below shows the problem. Note that it is 7 Sept today. 
   
   ![image](https://user-images.githubusercontent.com/1296736/92340742-2745f400-f0ee-11ea-94dd-02c4577efe03.png)
   
   ![image](https://user-images.githubusercontent.com/1296736/92340897-8e63a880-f0ee-11ea-94fd-96afcdc5b6d1.png)
   
   
   This is one of the dag definitions:
   
   ```
   default_args = {
       'owner': 'foresightyj',
       'depends_on_past': False,
       'start_date': airflow.utils.dates.days_ago(0),
   }
   
   dag = DAG('check_vue_types_v1',
             catchup=False,
             schedule_interval='@daily',
             default_args=default_args)
   
   warmup = BashOperator(
       task_id=f'vue-type-check',
       bash_command=f'npm run vtc --prefix /home/foresightyj/Working/fht-web-vue',
       dag=dag,
   )
   ```
   
   Occassionally, I saw this warning but I guess that is because some tasks took too long and I am running with a SequentialExecutor in only one machine?
   
   ![image](https://user-images.githubusercontent.com/1296736/92340824-56f4fc00-f0ee-11ea-94a5-b1753abc8a47.png)
   
   I am guessing that it is unlikely this is a bug of airflow. I must have missed something. Thanks if anybody could enlighten me.
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] eladkal commented on issue #10775: Some (not all) dags are not scheduled according to the configured interval (@daily). Why?

Posted by GitBox <gi...@apache.org>.
eladkal commented on issue #10775:
URL: https://github.com/apache/airflow/issues/10775#issuecomment-769397706


   We can't really investigate as there are no actual reproduce steps.
   I created dags with `schedule_interval='@daily'`on both 1.10.14 and 2.0.0 and it's working fine.
   If you still need help troubleshooting your case please use http://stackoverflow.com/


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] boring-cyborg[bot] commented on issue #10775: Some (not all) dags are not scheduled according to the configured interval (@daily). Why?

Posted by GitBox <gi...@apache.org>.
boring-cyborg[bot] commented on issue #10775:
URL: https://github.com/apache/airflow/issues/10775#issuecomment-687973105


   Thanks for opening your first issue here! Be sure to follow the issue template!
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] eladkal closed issue #10775: Some (not all) dags are not scheduled according to the configured interval (@daily). Why?

Posted by GitBox <gi...@apache.org>.
eladkal closed issue #10775:
URL: https://github.com/apache/airflow/issues/10775


   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org