You are viewing a plain text version of this content. The canonical link for it is here.
Posted to ivy-user@ant.apache.org by Colin Fleming <co...@gmail.com> on 2007/08/25 18:55:49 UTC

Occasional long Ivy pauses?

Hi all,

We're in the process of migrating our build to Ivy, and we've noticed
that occasionally Ivy will pause for an extremely long time (minutes)
doing a resolve. This is in a build where everything is in either the
cache or a local repo, it shouldn't need to be going to the network.
If I break out and re-run the build it works fine. Has anyone
experienced this? Is there anything I can do to diagnose it?
Unfortunately since it's not repeatable it's not easy to always have
-debug on, the output is huge.

Any help appreciated,
Colin

Re: Occasional long Ivy pauses?

Posted by Colin Fleming <co...@gmail.com>.
For the curious, as detailed in the above JIRA this is actually this
Ant bug: http://issues.apache.org/bugzilla/show_bug.cgi?id=42742. It's
not really an Ivy problem, but is easy to trigger with the recommended
buildlist/subant usage pattern for large builds. Briefly - if you do
this, and re-taskdef your tasks every time, your PermGen space fills
up with unused class definitions that are never released by Ant and
everything slows to a crawl.

The solution for us was to do all our taskdefs once up front in our
master build file. Taskdefs are persistent across subant calls,
luckily. This has the side effect of preventing our inner build files
from being independent, but in our case this wasn't a problem since we
never build our modules independently anyway (in fact, the inner build
files are about to be removed and replaced with the genericantfile
option to subant).

Cheers,
Colin

Re: Occasional long Ivy pauses?

Posted by Colin Fleming <co...@gmail.com>.
https://issues.apache.org/jira/browse/IVY-598

Unless I misunderstand the thread dumps, this appears to be a
low-level deadlock of some kind loading classes. Unfortunately
something that has changed in our build file suddenly triggers this
all the time, and it's affecting everyone in our project (previously
it only affected me).

Thanks for any help,
Colin

Re: Occasional long Ivy pauses?

Posted by Colin Fleming <co...@gmail.com>.
Here we are, thread dump attached. I'll file a JIRA if this isn't
something obvious.

Cheers,
Colin

Re: Occasional long Ivy pauses?

Posted by Colin Fleming <co...@gmail.com>.
No, I didn't - I'll try that next time I see it.

Thanks,
Colin

On 27/08/07, Jing Xue <ji...@digizenstudio.com> wrote:
>
> Quoting Colin Fleming <co...@gmail.com>:
>
> > It's been sitting there for at least 3-4 minutes now. Also even if it
> > is some problem with our remote repo,  the server is in the next room
> > and it's not slow for anything else.
>
> Did you try ctrl-break and take a thread dump to see where each of
> them is standing?
>
> --
> Jing Xue
>
>

Re: Occasional long Ivy pauses?

Posted by Jing Xue <ji...@digizenstudio.com>.
Quoting Colin Fleming <co...@gmail.com>:

> It's been sitting there for at least 3-4 minutes now. Also even if it
> is some problem with our remote repo,  the server is in the next room
> and it's not slow for anything else.

Did you try ctrl-break and take a thread dump to see where each of  
them is standing?

-- 
Jing Xue


Re: Occasional long Ivy pauses?

Posted by Colin Fleming <co...@gmail.com>.
Hi Gilles,

I'm not sure this is the problem - I have one right now, and it's
actually doing an ivy:info:

ivy.configure:

variables:
 [ivy:info] :: Ivy 2.0.0-alpha2-incubating - 20070712142751 ::
http://incubator.apache.org/ivy/ ::

It's been sitting there for at least 3-4 minutes now. Also even if it
is some problem with our remote repo,  the server is in the next room
and it's not slow for anything else.

Cheers,
Colin

On 26/08/07, Gilles Scokart <gs...@gmail.com> wrote:
> Even when everything is in your cache, there are still some cases when
> ivy has to look on the repository.  For example, if your are using
> some of the x.latest, or version ranges.
> It is possible that it is one of your repository that occasionally
> took a long time to respond.
>
> Gilles
>
> 2007/8/25, Colin Fleming <co...@gmail.com>:
> > Hi all,
> >
> > We're in the process of migrating our build to Ivy, and we've noticed
> > that occasionally Ivy will pause for an extremely long time (minutes)
> > doing a resolve. This is in a build where everything is in either the
> > cache or a local repo, it shouldn't need to be going to the network.
> > If I break out and re-run the build it works fine. Has anyone
> > experienced this? Is there anything I can do to diagnose it?
> > Unfortunately since it's not repeatable it's not easy to always have
> > -debug on, the output is huge.
> >
> > Any help appreciated,
> > Colin
> >
>
>
> --
> Gilles SCOKART
>

Re: Occasional long Ivy pauses?

Posted by Gilles Scokart <gs...@gmail.com>.
Even when everything is in your cache, there are still some cases when
ivy has to look on the repository.  For example, if your are using
some of the x.latest, or version ranges.
It is possible that it is one of your repository that occasionally
took a long time to respond.

Gilles

2007/8/25, Colin Fleming <co...@gmail.com>:
> Hi all,
>
> We're in the process of migrating our build to Ivy, and we've noticed
> that occasionally Ivy will pause for an extremely long time (minutes)
> doing a resolve. This is in a build where everything is in either the
> cache or a local repo, it shouldn't need to be going to the network.
> If I break out and re-run the build it works fine. Has anyone
> experienced this? Is there anything I can do to diagnose it?
> Unfortunately since it's not repeatable it's not easy to always have
> -debug on, the output is huge.
>
> Any help appreciated,
> Colin
>


-- 
Gilles SCOKART