oozie slowing down

[Amit Patil <ar...@skyhighnetworks.com>]

We are running oozie in our production system with the default config. The
workflow has some ssh actions and some java actions. We run about 8-10 jobs
at any given time. What we are noticing is that the oozie server has slowed
down over a period of time. The ssh actions takes 10 mins to complete even
though they are very simple. There are no other processes running on the
machine.
The console UI has also become more un responsive and takes a long time to
load.
Has anyone faced the issue before? Are there any configs that needs to be
changed? There is no good documentation for the config properties. Any help
is appreciated.

Re: oozie slowing down

[Amit Patil <ar...@skyhighnetworks.com>]

We are using oozie-3.3.0 and mysql metastore. For the purging config, we
have set oozie.service.PurgeService.older.than to 10. Even then, the purge
service doesnt seem to be working. Is there any other config I need to set?


On Tue, Apr 15, 2014 at 12:48 AM, Idris Ali <ps...@gmail.com> wrote:

> Hi Amit,
>
> Which version of oozie and what DB have you configured? You should purge
> the data form DB periodically, oozie already has a purge service. But you
> can easily write a custom service which periodically clears old
> COORD_ACTIONS.
>
> Secondly since you are using SSH action, please note this actions leave lot
> of stale staging files in your local machine where SSH action is invoked,
> so users should take care of clearing this.
>
> /home/{user}/oozie-oozi
>
> Thanks,
>
> -Idris
>
>
>
>
> On Tue, Apr 15, 2014 at 12:03 PM, Amit Patil <arpatil@skyhighnetworks.com
> >wrote:
>
> > We are running oozie in our production system with the default config.
> The
> > workflow has some ssh actions and some java actions. We run about 8-10
> jobs
> > at any given time. What we are noticing is that the oozie server has
> slowed
> > down over a period of time. The ssh actions takes 10 mins to complete
> even
> > though they are very simple. There are no other processes running on the
> > machine.
> > The console UI has also become more un responsive and takes a long time
> to
> > load.
> > Has anyone faced the issue before? Are there any configs that needs to be
> > changed? There is no good documentation for the config properties. Any
> help
> > is appreciated.
> >
>

Re: oozie slowing down

[Idris Ali <ps...@gmail.com>]

Hi Amit,

Which version of oozie and what DB have you configured? You should purge
the data form DB periodically, oozie already has a purge service. But you
can easily write a custom service which periodically clears old
COORD_ACTIONS.

Secondly since you are using SSH action, please note this actions leave lot
of stale staging files in your local machine where SSH action is invoked,
so users should take care of clearing this.

/home/{user}/oozie-oozi

Thanks,

-Idris




On Tue, Apr 15, 2014 at 12:03 PM, Amit Patil <ar...@skyhighnetworks.com>wrote:

> We are running oozie in our production system with the default config. The
> workflow has some ssh actions and some java actions. We run about 8-10 jobs
> at any given time. What we are noticing is that the oozie server has slowed
> down over a period of time. The ssh actions takes 10 mins to complete even
> though they are very simple. There are no other processes running on the
> machine.
> The console UI has also become more un responsive and takes a long time to
> load.
> Has anyone faced the issue before? Are there any configs that needs to be
> changed? There is no good documentation for the config properties. Any help
> is appreciated.
>