You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@oozie.apache.org by Laurent H <la...@gmail.com> on 2014/08/28 15:43:15 UTC
Bundle blocked on workflow
Hi all,
I'm new in oozie mailing list. We've a problem with the bundle :
I launch 2 coordinators. Each one launch a workflow.
- the first one fill a hive table named 'toto' with 6 mins frequency
- the second one use 'toto' and launch some parallels actions (with fork
statement) with 30 mins frequency.
The issue is that these treatments never finish and remain in RUNNING
status.
When I check the logs in ressource manager, there's no errors but only
'heart beat' written.
After around one hour the process is killed.
Knowing that each workflow launched separately, they work.
Maybe I'm mistaken, but I think that it could be a lock table issue!
I didn't find any solution on internet...
Is there some configuration we've missing or any idea?
thanks for your help,
--
Laurent HATIER - Consultant Business Intelligence chez CapGemini
fr.linkedin.com/pub/laurent-hatier/25/36b/a86/
<http://fr.linkedin.com/pub/laurent-h/25/36b/a86/>
Re: Bundle blocked on workflow
Posted by Laurent H <la...@gmail.com>.
Hi Mohammed,
We use HDP 2.1 with Hadoop 2.4 and Oozie 4.0.0
--
Laurent HATIER - Consultant Business Intelligence chez CapGemini
fr.linkedin.com/pub/laurent-hatier/25/36b/a86/
<http://fr.linkedin.com/pub/laurent-h/25/36b/a86/>
2014-08-30 4:39 GMT+02:00 Mohammad Islam <mi...@yahoo.com.invalid>:
> What version of Hadoop and Oozie?
> How many nodes are there in the cluster?
>
> Regards,
> Mohammad
>
>
>
> On Friday, August 29, 2014 8:20 AM, Laurent H <la...@gmail.com>
> wrote:
>
>
>
> Hi it's me again!
>
> I solved the issue by splitting my fork into 2 successive forks!
> When I launched more than 8 actions in the same fork, none of the treatment
> progresses and then logs show only heart beat message. But now after
> reducing the number of process in parallel, everything is going right!
>
> How do you explain this? I need to know the reason!
>
> Hope someone could help!
> Thanks,
>
> --
> Laurent HATIER - Consultant Business Intelligence chez CapGemini
> fr.linkedin.com/pub/laurent-hatier/25/36b/a86/
> <http://fr.linkedin.com/pub/laurent-h/25/36b/a86/>
>
>
>
> 2014-08-28 15:43 GMT+02:00 Laurent H <la...@gmail.com>:
>
> > Hi all,
> >
> > I'm new in oozie mailing list. We've a problem with the bundle :
> > I launch 2 coordinators. Each one launch a workflow.
> > - the first one fill a hive table named 'toto' with 6 mins frequency
> > - the second one use 'toto' and launch some parallels actions (with fork
> > statement) with 30 mins frequency.
> >
> > The issue is that these treatments never finish and remain in RUNNING
> > status.
> >
> > When I check the logs in ressource manager, there's no errors but only
> > 'heart beat' written.
> > After around one hour the process is killed.
> > Knowing that each workflow launched separately, they work.
> >
> > Maybe I'm mistaken, but I think that it could be a lock table issue!
> >
> > I didn't find any solution on internet...
> > Is there some configuration we've missing or any idea?
> >
> > thanks for your help,
> >
> >
> > --
> > Laurent HATIER - Consultant Business Intelligence chez CapGemini
> > fr.linkedin.com/pub/laurent-hatier/25/36b/a86/
> > <http://fr.linkedin.com/pub/laurent-h/25/36b/a86/
> >
> >
Re: Bundle blocked on workflow
Posted by Mohammad Islam <mi...@yahoo.com.INVALID>.
What version of Hadoop and Oozie?
How many nodes are there in the cluster?
Regards,
Mohammad
On Friday, August 29, 2014 8:20 AM, Laurent H <la...@gmail.com> wrote:
Hi it's me again!
I solved the issue by splitting my fork into 2 successive forks!
When I launched more than 8 actions in the same fork, none of the treatment
progresses and then logs show only heart beat message. But now after
reducing the number of process in parallel, everything is going right!
How do you explain this? I need to know the reason!
Hope someone could help!
Thanks,
--
Laurent HATIER - Consultant Business Intelligence chez CapGemini
fr.linkedin.com/pub/laurent-hatier/25/36b/a86/
<http://fr.linkedin.com/pub/laurent-h/25/36b/a86/>
2014-08-28 15:43 GMT+02:00 Laurent H <la...@gmail.com>:
> Hi all,
>
> I'm new in oozie mailing list. We've a problem with the bundle :
> I launch 2 coordinators. Each one launch a workflow.
> - the first one fill a hive table named 'toto' with 6 mins frequency
> - the second one use 'toto' and launch some parallels actions (with fork
> statement) with 30 mins frequency.
>
> The issue is that these treatments never finish and remain in RUNNING
> status.
>
> When I check the logs in ressource manager, there's no errors but only
> 'heart beat' written.
> After around one hour the process is killed.
> Knowing that each workflow launched separately, they work.
>
> Maybe I'm mistaken, but I think that it could be a lock table issue!
>
> I didn't find any solution on internet...
> Is there some configuration we've missing or any idea?
>
> thanks for your help,
>
>
> --
> Laurent HATIER - Consultant Business Intelligence chez CapGemini
> fr.linkedin.com/pub/laurent-hatier/25/36b/a86/
> <http://fr.linkedin.com/pub/laurent-h/25/36b/a86/
>
>
Re: Bundle blocked on workflow
Posted by Laurent H <la...@gmail.com>.
Hi it's me again!
I solved the issue by splitting my fork into 2 successive forks!
When I launched more than 8 actions in the same fork, none of the treatment
progresses and then logs show only heart beat message. But now after
reducing the number of process in parallel, everything is going right!
How do you explain this? I need to know the reason!
Hope someone could help!
Thanks,
--
Laurent HATIER - Consultant Business Intelligence chez CapGemini
fr.linkedin.com/pub/laurent-hatier/25/36b/a86/
<http://fr.linkedin.com/pub/laurent-h/25/36b/a86/>
2014-08-28 15:43 GMT+02:00 Laurent H <la...@gmail.com>:
> Hi all,
>
> I'm new in oozie mailing list. We've a problem with the bundle :
> I launch 2 coordinators. Each one launch a workflow.
> - the first one fill a hive table named 'toto' with 6 mins frequency
> - the second one use 'toto' and launch some parallels actions (with fork
> statement) with 30 mins frequency.
>
> The issue is that these treatments never finish and remain in RUNNING
> status.
>
> When I check the logs in ressource manager, there's no errors but only
> 'heart beat' written.
> After around one hour the process is killed.
> Knowing that each workflow launched separately, they work.
>
> Maybe I'm mistaken, but I think that it could be a lock table issue!
>
> I didn't find any solution on internet...
> Is there some configuration we've missing or any idea?
>
> thanks for your help,
>
>
> --
> Laurent HATIER - Consultant Business Intelligence chez CapGemini
> fr.linkedin.com/pub/laurent-hatier/25/36b/a86/
> <http://fr.linkedin.com/pub/laurent-h/25/36b/a86/>
>