You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@oozie.apache.org by Harshal <ha...@komli.com> on 2012/02/17 12:10:46 UTC
Kill coordinator actions ??
Hi,
Is there a way to kill particular actions of a coordinator?
Currently I think, we are only able to kill either a workflow instance
or an entire coordinator job.
Regards,
Re: Kill coordinator actions ??
Posted by Harshal <ha...@komli.com>.
JIRA created :
https://issues.apache.org/jira/browse/OOZIE-709
Regards,
On Wed, 2012-02-22 at 11:39 +0530, Harshal wrote:
> Hey,
>
> If we suspend the coordinator job, I am not sure if we can give rerun
> commands for individual actions when the job is in SUSPENDED state. I
> think the actions re-run only after the job comes out of SUSPENDED
> state.
>
> Regards,
>
> On Tue, 2012-02-21 at 14:53 -0800, Mohammad Islam wrote:
> > Hi Harshal,
> > You are right that a KILLED job can't be rerun in current implementation.
> > (But the doc showed other way!!)
> >
> > Do you think SUSPEND the coord job and then rerun the action could solve your issue?
> >
> > But I agree there should be a way to kill a specific action. Can you pls create a JIRA regarding this?
> >
> > Regards,
> > Mohammad
> >
> >
> >
> >
> >
> > ----- Original Message -----
> > From: Harshal <ha...@komli.com>
> > To: Mohammad Islam <mi...@yahoo.com>
> > Cc: "oozie-users@incubator.apache.org" <oo...@incubator.apache.org>
> > Sent: Tuesday, February 21, 2012 4:27 AM
> > Subject: Re: Kill coordinator actions ??
> >
> > But in that case, the entire coordinator JOB is marked as KILLED. Once
> > the coordinator job is killed, there is no way to re-run the instances
> > within that job, and also new instances will not be spawned. We will
> > have to submit a new coordinator job in that scenario. We would like to
> > kill actions in current coordinator job and rerun them in the same job.
> >
> > Regards,
> >
> > On Tue, 2012-02-21 at 01:37 -0800, Mohammad Islam wrote:
> > > Hi Harshal,
> > > Coordinator kill command should kill only the running instances (i.e. 8-20 of a job). It should not change the status of any succeeded actions(1..7).
> > >
> > > In that case, your current use-case should work without any issue.
> > > Please share if I miss something else.
> > >
> > > Regards,
> > > Mohammad
> > >
> > >
> > > ----- Original Message -----
> > > From: Harshal <ha...@komli.com>
> > > To: oozie-users@incubator.apache.org
> > > Cc:
> > > Sent: Sunday, February 19, 2012 10:09 PM
> > > Subject: Re: Kill coordinator actions ??
> > >
> > > Hi,
> > >
> > > I want to know how to kill a particular action.
> > >
> > > We have a requirement that, one instance of a particular job depends on
> > > the previous instance.
> > >
> > > Say that we have instances 1 - 20 that are materialized and right now
> > > instance number 10 is running.
> > >
> > > We identify that there was an error in instance number 8. We want all
> > > the current instances to stop processing i.e. kill instances from 8 to
> > > 20 and submit a rerun command for these instances.
> > >
> > > Regards,
> > >
> > >
> > >
> > >
> > > On Sun, 2012-02-19 at 19:37 +0530, Idris Ali wrote:
> > > > Hi Harshal,
> > > >
> > > > Check this link,
> > > > http://yahoo.github.com/oozie/releases/3.1.0/WebServicesAPI.html#Re-Runing_a_coordinator_job
> > > >
> > > > Thanks,
> > > > -Idris
> > > >
> > > > On Fri, Feb 17, 2012 at 4:40 PM, Harshal <ha...@komli.com> wrote:
> > > >
> > > > > Hi,
> > > > >
> > > > > Is there a way to kill particular actions of a coordinator?
> > > > >
> > > > > Currently I think, we are only able to kill either a workflow instance
> > > > > or an entire coordinator job.
> > > > >
> > > > > Regards,
> > > > >
> > > > >
>
>
Re: Kill coordinator actions ??
Posted by Harshal <ha...@komli.com>.
Hey,
If we suspend the coordinator job, I am not sure if we can give rerun
commands for individual actions when the job is in SUSPENDED state. I
think the actions re-run only after the job comes out of SUSPENDED
state.
Regards,
On Tue, 2012-02-21 at 14:53 -0800, Mohammad Islam wrote:
> Hi Harshal,
> You are right that a KILLED job can't be rerun in current implementation.
> (But the doc showed other way!!)
>
> Do you think SUSPEND the coord job and then rerun the action could solve your issue?
>
> But I agree there should be a way to kill a specific action. Can you pls create a JIRA regarding this?
>
> Regards,
> Mohammad
>
>
>
>
>
> ----- Original Message -----
> From: Harshal <ha...@komli.com>
> To: Mohammad Islam <mi...@yahoo.com>
> Cc: "oozie-users@incubator.apache.org" <oo...@incubator.apache.org>
> Sent: Tuesday, February 21, 2012 4:27 AM
> Subject: Re: Kill coordinator actions ??
>
> But in that case, the entire coordinator JOB is marked as KILLED. Once
> the coordinator job is killed, there is no way to re-run the instances
> within that job, and also new instances will not be spawned. We will
> have to submit a new coordinator job in that scenario. We would like to
> kill actions in current coordinator job and rerun them in the same job.
>
> Regards,
>
> On Tue, 2012-02-21 at 01:37 -0800, Mohammad Islam wrote:
> > Hi Harshal,
> > Coordinator kill command should kill only the running instances (i.e. 8-20 of a job). It should not change the status of any succeeded actions(1..7).
> >
> > In that case, your current use-case should work without any issue.
> > Please share if I miss something else.
> >
> > Regards,
> > Mohammad
> >
> >
> > ----- Original Message -----
> > From: Harshal <ha...@komli.com>
> > To: oozie-users@incubator.apache.org
> > Cc:
> > Sent: Sunday, February 19, 2012 10:09 PM
> > Subject: Re: Kill coordinator actions ??
> >
> > Hi,
> >
> > I want to know how to kill a particular action.
> >
> > We have a requirement that, one instance of a particular job depends on
> > the previous instance.
> >
> > Say that we have instances 1 - 20 that are materialized and right now
> > instance number 10 is running.
> >
> > We identify that there was an error in instance number 8. We want all
> > the current instances to stop processing i.e. kill instances from 8 to
> > 20 and submit a rerun command for these instances.
> >
> > Regards,
> >
> >
> >
> >
> > On Sun, 2012-02-19 at 19:37 +0530, Idris Ali wrote:
> > > Hi Harshal,
> > >
> > > Check this link,
> > > http://yahoo.github.com/oozie/releases/3.1.0/WebServicesAPI.html#Re-Runing_a_coordinator_job
> > >
> > > Thanks,
> > > -Idris
> > >
> > > On Fri, Feb 17, 2012 at 4:40 PM, Harshal <ha...@komli.com> wrote:
> > >
> > > > Hi,
> > > >
> > > > Is there a way to kill particular actions of a coordinator?
> > > >
> > > > Currently I think, we are only able to kill either a workflow instance
> > > > or an entire coordinator job.
> > > >
> > > > Regards,
> > > >
> > > >
Re: Kill coordinator actions ??
Posted by Mohammad Islam <mi...@yahoo.com>.
Hi Harshal,
You are right that a KILLED job can't be rerun in current implementation.
(But the doc showed other way!!)
Do you think SUSPEND the coord job and then rerun the action could solve your issue?
But I agree there should be a way to kill a specific action. Can you pls create a JIRA regarding this?
Regards,
Mohammad
----- Original Message -----
From: Harshal <ha...@komli.com>
To: Mohammad Islam <mi...@yahoo.com>
Cc: "oozie-users@incubator.apache.org" <oo...@incubator.apache.org>
Sent: Tuesday, February 21, 2012 4:27 AM
Subject: Re: Kill coordinator actions ??
But in that case, the entire coordinator JOB is marked as KILLED. Once
the coordinator job is killed, there is no way to re-run the instances
within that job, and also new instances will not be spawned. We will
have to submit a new coordinator job in that scenario. We would like to
kill actions in current coordinator job and rerun them in the same job.
Regards,
On Tue, 2012-02-21 at 01:37 -0800, Mohammad Islam wrote:
> Hi Harshal,
> Coordinator kill command should kill only the running instances (i.e. 8-20 of a job). It should not change the status of any succeeded actions(1..7).
>
> In that case, your current use-case should work without any issue.
> Please share if I miss something else.
>
> Regards,
> Mohammad
>
>
> ----- Original Message -----
> From: Harshal <ha...@komli.com>
> To: oozie-users@incubator.apache.org
> Cc:
> Sent: Sunday, February 19, 2012 10:09 PM
> Subject: Re: Kill coordinator actions ??
>
> Hi,
>
> I want to know how to kill a particular action.
>
> We have a requirement that, one instance of a particular job depends on
> the previous instance.
>
> Say that we have instances 1 - 20 that are materialized and right now
> instance number 10 is running.
>
> We identify that there was an error in instance number 8. We want all
> the current instances to stop processing i.e. kill instances from 8 to
> 20 and submit a rerun command for these instances.
>
> Regards,
>
>
>
>
> On Sun, 2012-02-19 at 19:37 +0530, Idris Ali wrote:
> > Hi Harshal,
> >
> > Check this link,
> > http://yahoo.github.com/oozie/releases/3.1.0/WebServicesAPI.html#Re-Runing_a_coordinator_job
> >
> > Thanks,
> > -Idris
> >
> > On Fri, Feb 17, 2012 at 4:40 PM, Harshal <ha...@komli.com> wrote:
> >
> > > Hi,
> > >
> > > Is there a way to kill particular actions of a coordinator?
> > >
> > > Currently I think, we are only able to kill either a workflow instance
> > > or an entire coordinator job.
> > >
> > > Regards,
> > >
> > >
Re: Kill coordinator actions ??
Posted by Harshal <ha...@komli.com>.
But in that case, the entire coordinator JOB is marked as KILLED. Once
the coordinator job is killed, there is no way to re-run the instances
within that job, and also new instances will not be spawned. We will
have to submit a new coordinator job in that scenario. We would like to
kill actions in current coordinator job and rerun them in the same job.
Regards,
On Tue, 2012-02-21 at 01:37 -0800, Mohammad Islam wrote:
> Hi Harshal,
> Coordinator kill command should kill only the running instances (i.e. 8-20 of a job). It should not change the status of any succeeded actions(1..7).
>
> In that case, your current use-case should work without any issue.
> Please share if I miss something else.
>
> Regards,
> Mohammad
>
>
> ----- Original Message -----
> From: Harshal <ha...@komli.com>
> To: oozie-users@incubator.apache.org
> Cc:
> Sent: Sunday, February 19, 2012 10:09 PM
> Subject: Re: Kill coordinator actions ??
>
> Hi,
>
> I want to know how to kill a particular action.
>
> We have a requirement that, one instance of a particular job depends on
> the previous instance.
>
> Say that we have instances 1 - 20 that are materialized and right now
> instance number 10 is running.
>
> We identify that there was an error in instance number 8. We want all
> the current instances to stop processing i.e. kill instances from 8 to
> 20 and submit a rerun command for these instances.
>
> Regards,
>
>
>
>
> On Sun, 2012-02-19 at 19:37 +0530, Idris Ali wrote:
> > Hi Harshal,
> >
> > Check this link,
> > http://yahoo.github.com/oozie/releases/3.1.0/WebServicesAPI.html#Re-Runing_a_coordinator_job
> >
> > Thanks,
> > -Idris
> >
> > On Fri, Feb 17, 2012 at 4:40 PM, Harshal <ha...@komli.com> wrote:
> >
> > > Hi,
> > >
> > > Is there a way to kill particular actions of a coordinator?
> > >
> > > Currently I think, we are only able to kill either a workflow instance
> > > or an entire coordinator job.
> > >
> > > Regards,
> > >
> > >
Re: Kill coordinator actions ??
Posted by Mohammad Islam <mi...@yahoo.com>.
Hi Harshal,
Coordinator kill command should kill only the running instances (i.e. 8-20 of a job). It should not change the status of any succeeded actions(1..7).
In that case, your current use-case should work without any issue.
Please share if I miss something else.
Regards,
Mohammad
----- Original Message -----
From: Harshal <ha...@komli.com>
To: oozie-users@incubator.apache.org
Cc:
Sent: Sunday, February 19, 2012 10:09 PM
Subject: Re: Kill coordinator actions ??
Hi,
I want to know how to kill a particular action.
We have a requirement that, one instance of a particular job depends on
the previous instance.
Say that we have instances 1 - 20 that are materialized and right now
instance number 10 is running.
We identify that there was an error in instance number 8. We want all
the current instances to stop processing i.e. kill instances from 8 to
20 and submit a rerun command for these instances.
Regards,
On Sun, 2012-02-19 at 19:37 +0530, Idris Ali wrote:
> Hi Harshal,
>
> Check this link,
> http://yahoo.github.com/oozie/releases/3.1.0/WebServicesAPI.html#Re-Runing_a_coordinator_job
>
> Thanks,
> -Idris
>
> On Fri, Feb 17, 2012 at 4:40 PM, Harshal <ha...@komli.com> wrote:
>
> > Hi,
> >
> > Is there a way to kill particular actions of a coordinator?
> >
> > Currently I think, we are only able to kill either a workflow instance
> > or an entire coordinator job.
> >
> > Regards,
> >
> >
Re: Kill coordinator actions ??
Posted by Harshal <ha...@komli.com>.
Hi,
I want to know how to kill a particular action.
We have a requirement that, one instance of a particular job depends on
the previous instance.
Say that we have instances 1 - 20 that are materialized and right now
instance number 10 is running.
We identify that there was an error in instance number 8. We want all
the current instances to stop processing i.e. kill instances from 8 to
20 and submit a rerun command for these instances.
Regards,
On Sun, 2012-02-19 at 19:37 +0530, Idris Ali wrote:
> Hi Harshal,
>
> Check this link,
> http://yahoo.github.com/oozie/releases/3.1.0/WebServicesAPI.html#Re-Runing_a_coordinator_job
>
> Thanks,
> -Idris
>
> On Fri, Feb 17, 2012 at 4:40 PM, Harshal <ha...@komli.com> wrote:
>
> > Hi,
> >
> > Is there a way to kill particular actions of a coordinator?
> >
> > Currently I think, we are only able to kill either a workflow instance
> > or an entire coordinator job.
> >
> > Regards,
> >
> >
Re: Kill coordinator actions ??
Posted by Idris Ali <ps...@gmail.com>.
Hi Harshal,
Check this link,
http://yahoo.github.com/oozie/releases/3.1.0/WebServicesAPI.html#Re-Runing_a_coordinator_job
Thanks,
-Idris
On Fri, Feb 17, 2012 at 4:40 PM, Harshal <ha...@komli.com> wrote:
> Hi,
>
> Is there a way to kill particular actions of a coordinator?
>
> Currently I think, we are only able to kill either a workflow instance
> or an entire coordinator job.
>
> Regards,
>
>