You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "Rohit (Jira)" <ji...@apache.org> on 2020/03/09 18:45:00 UTC
[jira] [Updated] (AIRFLOW-7020) Jobs running with cron is not
working as expected
[ https://issues.apache.org/jira/browse/AIRFLOW-7020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Rohit updated AIRFLOW-7020:
---------------------------
Description:
Job submitted with @daily is finished executing. It worked as expected and finished execution of all tasks like 1 hour ago:
[https://imgur.com/uqRz8W6|https://imgur.com/uqRz8W6)]
But another dag running with [15 * * * *|https://w2ec996050d80d4f7-tp.appspot.com/admin/dagrun/?flt2_dag_id_equals=load_num_tasks_t4] is not working as expected all it's task are clogged. (queued not at all running) ![Clogged]([https://imgur.com/rnxvOdw)]
I waited for hours but still the same result, the job's task is in null state.
So, I copied the code and just changed the cron from 15 * * * *. to @daily and changed dag name and started as new dag this one works like a charm
![DailyDag]([https://imgur.com/wECr2Qg)]
As you can see from the following image:
![Difference]([https://imgur.com/ibvA2W3)]
* 1st one is dag with 15 * * * *.
* 2nd one with @daily
Why I am getting this? Is it a known issue?
Is there any solution?
was:
Job submitted with @daily is finished executing. It worked as expected and finished execution of all tasks like 1 hour ago:
![DailyJob]([https://imgur.com/uqRz8W6)]
But another dag running with [15 * * * *|https://w2ec996050d80d4f7-tp.appspot.com/admin/dagrun/?flt2_dag_id_equals=load_num_tasks_t4] is not working as expected all it's task are clogged. (queued not at all running) ![Clogged]([https://imgur.com/rnxvOdw)]
I waited for hours but still the same result, the job's task is in null state.
So, I copied the code and just changed the cron from 15 * * * *. to @daily and changed dag name and started as new dag this one works like a charm
![DailyDag]([https://imgur.com/wECr2Qg)]
As you can see from the following image:
![Difference]([https://imgur.com/ibvA2W3)]
* 1st one is dag with 15 * * * *.
* 2nd one with @daily
Why I am getting this? Is it a known issue?
Is there any solution?
> Jobs running with cron is not working as expected
> -------------------------------------------------
>
> Key: AIRFLOW-7020
> URL: https://issues.apache.org/jira/browse/AIRFLOW-7020
> Project: Apache Airflow
> Issue Type: Bug
> Components: scheduler
> Affects Versions: 1.10.6
> Reporter: Rohit
> Priority: Critical
>
> Job submitted with @daily is finished executing. It worked as expected and finished execution of all tasks like 1 hour ago:
> [https://imgur.com/uqRz8W6|https://imgur.com/uqRz8W6)]
>
> But another dag running with [15 * * * *|https://w2ec996050d80d4f7-tp.appspot.com/admin/dagrun/?flt2_dag_id_equals=load_num_tasks_t4] is not working as expected all it's task are clogged. (queued not at all running) ![Clogged]([https://imgur.com/rnxvOdw)]
>
> I waited for hours but still the same result, the job's task is in null state.
>
> So, I copied the code and just changed the cron from 15 * * * *. to @daily and changed dag name and started as new dag this one works like a charm
> ![DailyDag]([https://imgur.com/wECr2Qg)]
>
> As you can see from the following image:
> ![Difference]([https://imgur.com/ibvA2W3)]
> * 1st one is dag with 15 * * * *.
> * 2nd one with @daily
>
> Why I am getting this? Is it a known issue?
> Is there any solution?
--
This message was sent by Atlassian Jira
(v8.3.4#803005)