You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@oozie.apache.org by ram kumar <ra...@gmail.com> on 2015/09/14 07:47:23 UTC
oozie response slow
Hi,
when trying oozie workflow sequentially,
after first job completion, it shows in hadoop console job succeeded.
But, it takes around 5 minutes to update in oozie console.
can you help me with it?
Thanks
Re: oozie response slow
Posted by ram kumar <ra...@gmail.com>.
thanks for your support
It was port issue while callback
On Tue, Sep 15, 2015 at 10:35 PM, Robert Kanter <rk...@cloudera.com>
wrote:
> Hi Ram,
>
> Like I said in the thread Matteo linked to, when it takes ~10min, that's a
> pretty good indicator that the callbacks are not getting through. Please
> see my explanation of that in the other thread.
>
> You can change the checking interval, but that puts extra stress on
> Yarn/JT.
> See oozie.service.ActionCheckerService.action.check.interval and
> oozie.service.ActionCheckerService.action.check.delay
>
> https://github.com/apache/oozie/blob/master/core/src/main/resources/oozie-default.xml#L1610
>
> - Robert
>
> On Mon, Sep 14, 2015 at 3:17 AM, Matteo Luzzi <ma...@gmail.com>
> wrote:
>
> > I am not sure whether is possible to set an update interval, as far as I
> > know oozie should get updates from hadoop when there is a change in the
> job
> > status via callbacks. Maybe someone with more experience than me can
> > provide a better answer.
> >
> > Matteo
> >
> > 2015-09-14 11:53 GMT+02:00 ram kumar <ra...@gmail.com>:
> >
> > > thanks Matteo,
> > >
> > > Each job gets updated every 10 minutes in oozie console.
> > > It doesn't automatically update, when job completes.
> > > Is it possible to how to change config to like 5 minutes ?
> > >
> > > On Mon, Sep 14, 2015 at 12:12 PM, Matteo Luzzi <matteo.luzzi@gmail.com
> >
> > > wrote:
> > >
> > > > Hi,
> > > > maybe you are facing my same problem, that hadoop notification
> > callbacks
> > > > are not correctly sent to oozie server. Finally I discovered that I
> was
> > > > messing a bit with oozie url properties and I solved my problem. You
> > can
> > > > check here
> > > >
> > > >
> > >
> >
> http://mail-archives.apache.org/mod_mbox/oozie-user/201508.mbox/%3CCALBGZ8qveCuxrmYyX%2BkxO1bYCZA5zf_0p8hJk5t_BUsj44S78w%40mail.gmail.com%3E
> > > >
> > > > regards,
> > > > Matteo
> > > >
> > > > 2015-09-14 7:47 GMT+02:00 ram kumar <ra...@gmail.com>:
> > > >
> > > > > Hi,
> > > > >
> > > > > when trying oozie workflow sequentially,
> > > > > after first job completion, it shows in hadoop console job
> succeeded.
> > > > > But, it takes around 5 minutes to update in oozie console.
> > > > >
> > > > >
> > > > > can you help me with it?
> > > > >
> > > > > Thanks
> > > > >
> > > >
> > > >
> > > >
> > > > --
> > > > Matteo Remo Luzzi
> > > >
> > >
> >
> >
> >
> > --
> > Matteo Remo Luzzi
> >
>
Re: oozie response slow
Posted by Robert Kanter <rk...@cloudera.com>.
Hi Ram,
Like I said in the thread Matteo linked to, when it takes ~10min, that's a
pretty good indicator that the callbacks are not getting through. Please
see my explanation of that in the other thread.
You can change the checking interval, but that puts extra stress on
Yarn/JT.
See oozie.service.ActionCheckerService.action.check.interval and
oozie.service.ActionCheckerService.action.check.delay
https://github.com/apache/oozie/blob/master/core/src/main/resources/oozie-default.xml#L1610
- Robert
On Mon, Sep 14, 2015 at 3:17 AM, Matteo Luzzi <ma...@gmail.com>
wrote:
> I am not sure whether is possible to set an update interval, as far as I
> know oozie should get updates from hadoop when there is a change in the job
> status via callbacks. Maybe someone with more experience than me can
> provide a better answer.
>
> Matteo
>
> 2015-09-14 11:53 GMT+02:00 ram kumar <ra...@gmail.com>:
>
> > thanks Matteo,
> >
> > Each job gets updated every 10 minutes in oozie console.
> > It doesn't automatically update, when job completes.
> > Is it possible to how to change config to like 5 minutes ?
> >
> > On Mon, Sep 14, 2015 at 12:12 PM, Matteo Luzzi <ma...@gmail.com>
> > wrote:
> >
> > > Hi,
> > > maybe you are facing my same problem, that hadoop notification
> callbacks
> > > are not correctly sent to oozie server. Finally I discovered that I was
> > > messing a bit with oozie url properties and I solved my problem. You
> can
> > > check here
> > >
> > >
> >
> http://mail-archives.apache.org/mod_mbox/oozie-user/201508.mbox/%3CCALBGZ8qveCuxrmYyX%2BkxO1bYCZA5zf_0p8hJk5t_BUsj44S78w%40mail.gmail.com%3E
> > >
> > > regards,
> > > Matteo
> > >
> > > 2015-09-14 7:47 GMT+02:00 ram kumar <ra...@gmail.com>:
> > >
> > > > Hi,
> > > >
> > > > when trying oozie workflow sequentially,
> > > > after first job completion, it shows in hadoop console job succeeded.
> > > > But, it takes around 5 minutes to update in oozie console.
> > > >
> > > >
> > > > can you help me with it?
> > > >
> > > > Thanks
> > > >
> > >
> > >
> > >
> > > --
> > > Matteo Remo Luzzi
> > >
> >
>
>
>
> --
> Matteo Remo Luzzi
>
Re: oozie response slow
Posted by Matteo Luzzi <ma...@gmail.com>.
I am not sure whether is possible to set an update interval, as far as I
know oozie should get updates from hadoop when there is a change in the job
status via callbacks. Maybe someone with more experience than me can
provide a better answer.
Matteo
2015-09-14 11:53 GMT+02:00 ram kumar <ra...@gmail.com>:
> thanks Matteo,
>
> Each job gets updated every 10 minutes in oozie console.
> It doesn't automatically update, when job completes.
> Is it possible to how to change config to like 5 minutes ?
>
> On Mon, Sep 14, 2015 at 12:12 PM, Matteo Luzzi <ma...@gmail.com>
> wrote:
>
> > Hi,
> > maybe you are facing my same problem, that hadoop notification callbacks
> > are not correctly sent to oozie server. Finally I discovered that I was
> > messing a bit with oozie url properties and I solved my problem. You can
> > check here
> >
> >
> http://mail-archives.apache.org/mod_mbox/oozie-user/201508.mbox/%3CCALBGZ8qveCuxrmYyX%2BkxO1bYCZA5zf_0p8hJk5t_BUsj44S78w%40mail.gmail.com%3E
> >
> > regards,
> > Matteo
> >
> > 2015-09-14 7:47 GMT+02:00 ram kumar <ra...@gmail.com>:
> >
> > > Hi,
> > >
> > > when trying oozie workflow sequentially,
> > > after first job completion, it shows in hadoop console job succeeded.
> > > But, it takes around 5 minutes to update in oozie console.
> > >
> > >
> > > can you help me with it?
> > >
> > > Thanks
> > >
> >
> >
> >
> > --
> > Matteo Remo Luzzi
> >
>
--
Matteo Remo Luzzi
Re: oozie response slow
Posted by ram kumar <ra...@gmail.com>.
thanks Matteo,
Each job gets updated every 10 minutes in oozie console.
It doesn't automatically update, when job completes.
Is it possible to how to change config to like 5 minutes ?
On Mon, Sep 14, 2015 at 12:12 PM, Matteo Luzzi <ma...@gmail.com>
wrote:
> Hi,
> maybe you are facing my same problem, that hadoop notification callbacks
> are not correctly sent to oozie server. Finally I discovered that I was
> messing a bit with oozie url properties and I solved my problem. You can
> check here
>
> http://mail-archives.apache.org/mod_mbox/oozie-user/201508.mbox/%3CCALBGZ8qveCuxrmYyX%2BkxO1bYCZA5zf_0p8hJk5t_BUsj44S78w%40mail.gmail.com%3E
>
> regards,
> Matteo
>
> 2015-09-14 7:47 GMT+02:00 ram kumar <ra...@gmail.com>:
>
> > Hi,
> >
> > when trying oozie workflow sequentially,
> > after first job completion, it shows in hadoop console job succeeded.
> > But, it takes around 5 minutes to update in oozie console.
> >
> >
> > can you help me with it?
> >
> > Thanks
> >
>
>
>
> --
> Matteo Remo Luzzi
>
Re: oozie response slow
Posted by Matteo Luzzi <ma...@gmail.com>.
Hi,
maybe you are facing my same problem, that hadoop notification callbacks
are not correctly sent to oozie server. Finally I discovered that I was
messing a bit with oozie url properties and I solved my problem. You can
check here
http://mail-archives.apache.org/mod_mbox/oozie-user/201508.mbox/%3CCALBGZ8qveCuxrmYyX%2BkxO1bYCZA5zf_0p8hJk5t_BUsj44S78w%40mail.gmail.com%3E
regards,
Matteo
2015-09-14 7:47 GMT+02:00 ram kumar <ra...@gmail.com>:
> Hi,
>
> when trying oozie workflow sequentially,
> after first job completion, it shows in hadoop console job succeeded.
> But, it takes around 5 minutes to update in oozie console.
>
>
> can you help me with it?
>
> Thanks
>
--
Matteo Remo Luzzi