You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@airflow.apache.org by "Raditchkov, Jelez (ETW)" <Je...@nike.com> on 2016/05/15 18:39:02 UTC
Interrupting multi task DAG
I have a with 200 tasks.
1. How can I interrupt the execution of the tasks temporarily while the DAG is running?
2. How can I just stop the DAG execution and reset it in case I find a problem that need to be fixed and then re-run the DAG?
Thanks!
Re: Interrupting multi task DAG
Posted by Chris Riccomini <cr...@apache.org>.
Yea-- occasionally, you'll see a task in a "blue" state on the tree view.
This is a task that's being killed. It's pretty undocumented. It's noted
here:
https://issues.apache.org/jira/browse/AIRFLOW-66
And here:
http://mail-archives.apache.org/mod_mbox/airflow-dev/201605.mbox/%3CCABYbY7cSZvtrA0L13URM=RBSF3=9pVuwMD6-cy4yeDsg_6YUSQ@mail.gmail.com%3E
Actually, looks like you're the one on the email thread. :)
On Mon, May 16, 2016 at 11:39 AM, Lance Norskog <la...@gmail.com>
wrote:
> I didn't know this about the Clear button. Maybe the "Do you really want to
> do this?" screen could include a warning?
>
> Lance
>
> On Mon, May 16, 2016 at 7:38 AM, Chris Riccomini <cr...@apache.org>
> wrote:
>
> > Hey Jelez,
> >
> > > How can I interrupt the execution of the tasks temporarily while the
> DAG
> > is running?
> >
> > There is an on/off toggle next to each DAG in the UI. If you toggle it to
> > off, all execution of the DAG will cease (even if the DAG run is halfway
> > through executing). This will not kill any currently running tasks, but
> no
> > future tasks will get scheduled for it.
> >
> > > How can I just stop the DAG execution and reset it in case I find a
> > problem that need to be fixed and then re-run the DAG?
> >
> > See above on how to stop the DAG execution. You can also use the UI in
> the
> > `tree view` page to clear the status of a task, so that it can be re-run.
> > Do this by clicking on the square of the task that you want to clear, and
> > then clicking the 'Clear' button. Note: if you do this on a task that's
> > currently running (bright green square), Airflow will attempt to kill the
> > task off when it clears the status--this is the second part of the answer
> > to your question above.
> >
> > Cheers,
> > Chris
> >
> > On Sun, May 15, 2016 at 11:39 AM, Raditchkov, Jelez (ETW) <
> > Jelez.Raditchkov@nike.com> wrote:
> >
> > > I have a with 200 tasks.
> > >
> > >
> > > 1. How can I interrupt the execution of the tasks temporarily
> while
> > > the DAG is running?
> > >
> > >
> > > 2. How can I just stop the DAG execution and reset it in case I
> > find
> > > a problem that need to be fixed and then re-run the DAG?
> > >
> > >
> > > Thanks!
> > >
> > >
> >
>
>
>
> --
> Lance Norskog
> lance.norskog@gmail.com
> Redwood City, CA
>
Re: Interrupting multi task DAG
Posted by Lance Norskog <la...@gmail.com>.
I didn't know this about the Clear button. Maybe the "Do you really want to
do this?" screen could include a warning?
Lance
On Mon, May 16, 2016 at 7:38 AM, Chris Riccomini <cr...@apache.org>
wrote:
> Hey Jelez,
>
> > How can I interrupt the execution of the tasks temporarily while the DAG
> is running?
>
> There is an on/off toggle next to each DAG in the UI. If you toggle it to
> off, all execution of the DAG will cease (even if the DAG run is halfway
> through executing). This will not kill any currently running tasks, but no
> future tasks will get scheduled for it.
>
> > How can I just stop the DAG execution and reset it in case I find a
> problem that need to be fixed and then re-run the DAG?
>
> See above on how to stop the DAG execution. You can also use the UI in the
> `tree view` page to clear the status of a task, so that it can be re-run.
> Do this by clicking on the square of the task that you want to clear, and
> then clicking the 'Clear' button. Note: if you do this on a task that's
> currently running (bright green square), Airflow will attempt to kill the
> task off when it clears the status--this is the second part of the answer
> to your question above.
>
> Cheers,
> Chris
>
> On Sun, May 15, 2016 at 11:39 AM, Raditchkov, Jelez (ETW) <
> Jelez.Raditchkov@nike.com> wrote:
>
> > I have a with 200 tasks.
> >
> >
> > 1. How can I interrupt the execution of the tasks temporarily while
> > the DAG is running?
> >
> >
> > 2. How can I just stop the DAG execution and reset it in case I
> find
> > a problem that need to be fixed and then re-run the DAG?
> >
> >
> > Thanks!
> >
> >
>
--
Lance Norskog
lance.norskog@gmail.com
Redwood City, CA
Re: Interrupting multi task DAG
Posted by Chris Riccomini <cr...@apache.org>.
Hey Jelez,
> How can I interrupt the execution of the tasks temporarily while the DAG
is running?
There is an on/off toggle next to each DAG in the UI. If you toggle it to
off, all execution of the DAG will cease (even if the DAG run is halfway
through executing). This will not kill any currently running tasks, but no
future tasks will get scheduled for it.
> How can I just stop the DAG execution and reset it in case I find a
problem that need to be fixed and then re-run the DAG?
See above on how to stop the DAG execution. You can also use the UI in the
`tree view` page to clear the status of a task, so that it can be re-run.
Do this by clicking on the square of the task that you want to clear, and
then clicking the 'Clear' button. Note: if you do this on a task that's
currently running (bright green square), Airflow will attempt to kill the
task off when it clears the status--this is the second part of the answer
to your question above.
Cheers,
Chris
On Sun, May 15, 2016 at 11:39 AM, Raditchkov, Jelez (ETW) <
Jelez.Raditchkov@nike.com> wrote:
> I have a with 200 tasks.
>
>
> 1. How can I interrupt the execution of the tasks temporarily while
> the DAG is running?
>
>
> 2. How can I just stop the DAG execution and reset it in case I find
> a problem that need to be fixed and then re-run the DAG?
>
>
> Thanks!
>
>