You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "Rohit (Jira)" <ji...@apache.org> on 2020/03/09 18:45:00 UTC

[jira] [Updated] (AIRFLOW-7020) Jobs running with cron is not working as expected

     [ https://issues.apache.org/jira/browse/AIRFLOW-7020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Rohit updated AIRFLOW-7020:
---------------------------
    Description: 
Job submitted with @daily is finished executing. It worked as expected and finished execution of all tasks like 1 hour ago:

[https://imgur.com/uqRz8W6|https://imgur.com/uqRz8W6)]

 

But another dag running with [15 * * * *|https://w2ec996050d80d4f7-tp.appspot.com/admin/dagrun/?flt2_dag_id_equals=load_num_tasks_t4] is not working as expected all it's task are clogged. (queued not at all running) ![Clogged]([https://imgur.com/rnxvOdw)]

 

I waited for hours but still the same result, the job's task is in null state.

 

So, I copied the code and just changed the cron from 15 * * * *. to @daily and changed dag  name and started as new dag this one works like a charm

![DailyDag]([https://imgur.com/wECr2Qg)]

 

As you can see from the following image: 

![Difference]([https://imgur.com/ibvA2W3)]
 * 1st one is dag with 15 * * * *.
 * 2nd one with @daily

 

Why I am getting this? Is it a known issue? 

Is there any solution?

  was:
Job submitted with @daily is finished executing. It worked as expected and finished execution of all tasks like 1 hour ago:

![DailyJob]([https://imgur.com/uqRz8W6)]

 

But another dag running with [15 * * * *|https://w2ec996050d80d4f7-tp.appspot.com/admin/dagrun/?flt2_dag_id_equals=load_num_tasks_t4] is not working as expected all it's task are clogged. (queued not at all running) ![Clogged]([https://imgur.com/rnxvOdw)]

 

I waited for hours but still the same result, the job's task is in null state.

 

So, I copied the code and just changed the cron from 15 * * * *. to @daily and changed dag  name and started as new dag this one works like a charm

![DailyDag]([https://imgur.com/wECr2Qg)]

 

As you can see from the following image: 

![Difference]([https://imgur.com/ibvA2W3)]
 * 1st one is dag with 15 * * * *.
 * 2nd one with @daily

 

Why I am getting this? Is it a known issue? 

Is there any solution?


> Jobs running with cron is not working as expected
> -------------------------------------------------
>
>                 Key: AIRFLOW-7020
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-7020
>             Project: Apache Airflow
>          Issue Type: Bug
>          Components: scheduler
>    Affects Versions: 1.10.6
>            Reporter: Rohit
>            Priority: Critical
>
> Job submitted with @daily is finished executing. It worked as expected and finished execution of all tasks like 1 hour ago:
> [https://imgur.com/uqRz8W6|https://imgur.com/uqRz8W6)]
>  
> But another dag running with [15 * * * *|https://w2ec996050d80d4f7-tp.appspot.com/admin/dagrun/?flt2_dag_id_equals=load_num_tasks_t4] is not working as expected all it's task are clogged. (queued not at all running) ![Clogged]([https://imgur.com/rnxvOdw)]
>  
> I waited for hours but still the same result, the job's task is in null state.
>  
> So, I copied the code and just changed the cron from 15 * * * *. to @daily and changed dag  name and started as new dag this one works like a charm
> ![DailyDag]([https://imgur.com/wECr2Qg)]
>  
> As you can see from the following image: 
> ![Difference]([https://imgur.com/ibvA2W3)]
>  * 1st one is dag with 15 * * * *.
>  * 2nd one with @daily
>  
> Why I am getting this? Is it a known issue? 
> Is there any solution?



--
This message was sent by Atlassian Jira
(v8.3.4#803005)