You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@maven.apache.org by Craig <su...@gmail.com> on 2008/09/25 02:55:25 UTC

local repository grows indefinitely on CI server

Our CI server builds and deploys snapshots to our nexus repository
server every time someone commits.

During the build of a snapshot multi-module project, it downloads the
previous snapshots of the modules to the local repository, even though
they are in the reactor about to be built. This has the effect of
causing the local repository to very quickly increase in size,
containing every snapshot ever built.

I can easily create a cron job to clean these up, but it does seem
like incorrect behaviour on the part of maven (version 2.0.9).

Will the resolution of this issue
http://jira.codehaus.org/browse/MNG-3685 (Dependency can't be resolved
but has been found in the reactor) fix my problem?

thanks.
Craig

---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@maven.apache.org
For additional commands, e-mail: users-help@maven.apache.org


Re: local repository grows indefinitely on CI server

Posted by Craig <su...@gmail.com>.
Brilliant! Thank you so much. That was it. I have yet to try the
latest release of the enforcer plugin, but commenting out the use of
version 1.0-alpha-3 made the problem go away.

Thanks again,
Craig

On Mon, Nov 3, 2008 at 5:21 PM, Arnaud HERITIER <ah...@gmail.com> wrote:
> Aren't you using i your build a bogus version of the enforcer plugin.
> 1.0-alpha-3 has such a bug (MENFORCER-11) which forced to download
> dependencies.
>
> Arnaud
>
> On Thu, Sep 25, 2008 at 1:55 AM, Craig <su...@gmail.com> wrote:
>
>> Our CI server builds and deploys snapshots to our nexus repository
>> server every time someone commits.
>>
>> During the build of a snapshot multi-module project, it downloads the
>> previous snapshots of the modules to the local repository, even though
>> they are in the reactor about to be built. This has the effect of
>> causing the local repository to very quickly increase in size,
>> containing every snapshot ever built.
>>
>> I can easily create a cron job to clean these up, but it does seem
>> like incorrect behaviour on the part of maven (version 2.0.9).
>>
>> Will the resolution of this issue
>> http://jira.codehaus.org/browse/MNG-3685 (Dependency can't be resolved
>> but has been found in the reactor) fix my problem?
>>
>> thanks.
>> Craig
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: users-unsubscribe@maven.apache.org
>> For additional commands, e-mail: users-help@maven.apache.org
>>
>>
>
>
> --
> ..........................................................
> Arnaud HERITIER
> ..........................................................
> OCTO Technology - aheritier AT octo DOT com
> www.octo.com | blog.octo.com
> ..........................................................
> ASF - aheritier AT apache DOT org
> www.apache.org | maven.apache.org
> ...........................................................
>

---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@maven.apache.org
For additional commands, e-mail: users-help@maven.apache.org


Re: local repository grows indefinitely on CI server

Posted by Arnaud HERITIER <ah...@gmail.com>.
Aren't you using i your build a bogus version of the enforcer plugin.
1.0-alpha-3 has such a bug (MENFORCER-11) which forced to download
dependencies.

Arnaud

On Thu, Sep 25, 2008 at 1:55 AM, Craig <su...@gmail.com> wrote:

> Our CI server builds and deploys snapshots to our nexus repository
> server every time someone commits.
>
> During the build of a snapshot multi-module project, it downloads the
> previous snapshots of the modules to the local repository, even though
> they are in the reactor about to be built. This has the effect of
> causing the local repository to very quickly increase in size,
> containing every snapshot ever built.
>
> I can easily create a cron job to clean these up, but it does seem
> like incorrect behaviour on the part of maven (version 2.0.9).
>
> Will the resolution of this issue
> http://jira.codehaus.org/browse/MNG-3685 (Dependency can't be resolved
> but has been found in the reactor) fix my problem?
>
> thanks.
> Craig
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe@maven.apache.org
> For additional commands, e-mail: users-help@maven.apache.org
>
>


-- 
..........................................................
Arnaud HERITIER
..........................................................
OCTO Technology - aheritier AT octo DOT com
www.octo.com | blog.octo.com
..........................................................
ASF - aheritier AT apache DOT org
www.apache.org | maven.apache.org
...........................................................

Re: local repository grows indefinitely on CI server

Posted by Craig <su...@gmail.com>.
Hi guys....thought I would revisit this issue, as I still believe it is a bug.

On Thu, Sep 25, 2008 at 11:17 PM, Emmanuel Venisse
<em...@gmail.com> wrote:
> Yes, it's a common problem on CI server but on developer workstation too if
> builds are intensive.
> About CI server, it is necessary to clean sometimes old snapshots because
> they are generally not used. Continuum have this features since 1.2, I don't
> know for other CI servers and if they doesn't exist, a cron job is necessary
> to do the clean.

I understand that, in general, snapshots will build up in a local
repository...this is expected behaviour. And a option for a CI server
to clean these up is a good thing, but I am talking about a specific
scenario.

> On Thu, Sep 25, 2008 at 2:03 PM, Baptiste MATHUS <ml...@batmat.net> wrote:
>
>> Hi Craig,
>>
>> Well, no, I don't think the bug you're referring to is related.
>> Your problem is a quite common one.
>>
>> See this bug http://jira.codehaus.org/browse/MNG-233 and the
>> dependency:purge-local-repository goal of the maven-dependency-plugin.
>> You will also find interesting relating information here:
>> http://jira.codehaus.org/browse/CONTINUUM-1693. In fact, though it's a
>> continuum bug, it's not a problem limited to this continuous integration
>> server.

I looked at both these issues. http://jira.codehaus.org/browse/MNG-233
is related, but doesn't address my issue.
http://jira.codehaus.org/browse/CONTINUUM-1693 may or may not be
talking about the same thing, but is lacking in details.

I am talking about the specific situation of a multi-module snapshot
project build where the dependencies of a given module X exist
alongside it in the reactor. In this scenario, with 2.0.9, maven will
download the previous snapshots of X's dependencies into the local
repository using a timestamped filename, even though *it is about to
build to them*. This behaviour seems most definitely wrong because it
is possible to delete all of the dependencies listed in the reactor
from the local repository, then build in offline mode, and the build
will succeed. In this case you get the warning from maven saying:

"The dependency X can't be resolved but has been found in the reactor.
etc, etc."

This issue causes problems because everytime the CI builds the
multi-module project, it downloads the previous build, causing rapid
buildup of snapshots. It shouldn't do this - it should simply
*overwrite* the previous build with a *non-timestamped* snapshot
version.

Anyway, if no one else knows anything about this, I guess I will put
together an example project and take it further on
http://jira.codehaus.org/browse/MNG-233. Actually, I should probably
test the upcoming 2.0.10 builds...there is every chance it has already
been addressed, knowingly or unknowingly.

thanks,
Craig

---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@maven.apache.org
For additional commands, e-mail: users-help@maven.apache.org


Re: local repository grows indefinitely on CI server

Posted by Emmanuel Venisse <em...@gmail.com>.
Yes, it's a common problem on CI server but on developer workstation too if
builds are intensive.
About CI server, it is necessary to clean sometimes old snapshots because
they are generally not used. Continuum have this features since 1.2, I don't
know for other CI servers and if they doesn't exist, a cron job is necessary
to do the clean.

Emmanuel

On Thu, Sep 25, 2008 at 2:03 PM, Baptiste MATHUS <ml...@batmat.net> wrote:

> Hi Craig,
>
> Well, no, I don't think the bug you're referring to is related.
> Your problem is a quite common one.
>
> See this bug http://jira.codehaus.org/browse/MNG-233 and the
> dependency:purge-local-repository goal of the maven-dependency-plugin.
> You will also find interesting relating information here:
> http://jira.codehaus.org/browse/CONTINUUM-1693. In fact, though it's a
> continuum bug, it's not a problem limited to this continuous integration
> server.
>
> Cheers.
>
> 2008/9/25 Craig <su...@gmail.com>
>
> > Our CI server builds and deploys snapshots to our nexus repository
> > server every time someone commits.
> >
> > During the build of a snapshot multi-module project, it downloads the
> > previous snapshots of the modules to the local repository, even though
> > they are in the reactor about to be built. This has the effect of
> > causing the local repository to very quickly increase in size,
> > containing every snapshot ever built.
> >
> > I can easily create a cron job to clean these up, but it does seem
> > like incorrect behaviour on the part of maven (version 2.0.9).
> >
> > Will the resolution of this issue
> > http://jira.codehaus.org/browse/MNG-3685 (Dependency can't be resolved
> > but has been found in the reactor) fix my problem?
> >
> > thanks.
> > Craig
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: users-unsubscribe@maven.apache.org
> > For additional commands, e-mail: users-help@maven.apache.org
> >
> >
>
>
> --
> Baptiste <Batmat> MATHUS - http://batmat.net
> Sauvez un arbre,
> Mangez un castor !
>

Re: local repository grows indefinitely on CI server

Posted by Baptiste MATHUS <ml...@batmat.net>.
Hi Craig,

Well, no, I don't think the bug you're referring to is related.
Your problem is a quite common one.

See this bug http://jira.codehaus.org/browse/MNG-233 and the
dependency:purge-local-repository goal of the maven-dependency-plugin.
You will also find interesting relating information here:
http://jira.codehaus.org/browse/CONTINUUM-1693. In fact, though it's a
continuum bug, it's not a problem limited to this continuous integration
server.

Cheers.

2008/9/25 Craig <su...@gmail.com>

> Our CI server builds and deploys snapshots to our nexus repository
> server every time someone commits.
>
> During the build of a snapshot multi-module project, it downloads the
> previous snapshots of the modules to the local repository, even though
> they are in the reactor about to be built. This has the effect of
> causing the local repository to very quickly increase in size,
> containing every snapshot ever built.
>
> I can easily create a cron job to clean these up, but it does seem
> like incorrect behaviour on the part of maven (version 2.0.9).
>
> Will the resolution of this issue
> http://jira.codehaus.org/browse/MNG-3685 (Dependency can't be resolved
> but has been found in the reactor) fix my problem?
>
> thanks.
> Craig
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe@maven.apache.org
> For additional commands, e-mail: users-help@maven.apache.org
>
>


-- 
Baptiste <Batmat> MATHUS - http://batmat.net
Sauvez un arbre,
Mangez un castor !