You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@maven.apache.org by Vivin Suresh Paliath <vi...@gmail.com> on 2011/07/19 18:27:58 UTC
Maven 3 builds take much longer to run in 3.0.3 than in 3.0b1
I'm trying to track down the reason that our builds take much longer to
build under 3.0.3 rather than 3.0b1. Under 3.0.3, our build takes around 9
minutes, whereas under 3.0b1, it's 3 minutes and 30 seconds. While using
jconsole, I saw that most of the time (in 3.0.3) is spent inside
DefaultProjectDependenciesResolver.java. So I downloaded the source to both
3.0b1 and 3.0.3 to see what's happening. I noticed that in 3.0.3 there are
two versions of the class. One is in org.apache.maven.project, while the
other is in org.apache.maven. It also appears that in 3.0.3, the former is
being used. While stepping through the code, I saw that bulk of the time is
spent when it reaches this statement:
node = repoSystem.collectDependencies( session, collect ).getRoot();
In 3.0b1, the code does:
ArtifactResolutionResult result = repositorySystem.resolve( request );
I also noticed that respositorySystem is of type RepositorySystem, and the
concrete implementation is LegacyRepositorySystem. I'm assuming that this
was being used while the Maven 3 was in beta until the new implementation
was created? Going back to 3.0.3, the collectDependencies method lives in
DefaultRepositorySystem.java which is part of
org.sonatype.aether.impl.internal. This eventually calls
collectDependenciesinside
DefaultDependencyCollector.java which is also part of
org.sonatype.aether.impl.internal. I'm assuming that this is how the
dependency graph is built. My question is if there is a way to make this
process faster? Could there be something wrong in the way we've set up our
dependencies in our project which could cause this process to be so slow?
Or, is this a performance regression? If this is the case, I can open an
Jira issue.
--
Ruin untold;
And thine own sadness,
Sing in the grass,
When eve has forgot, that no more hear common things that gleam and pass;
But seek alone to lip, sad Rose of love and ruin untold;
And thine own mother
Can know it as I know
More than another
What makes your own sadness,
Set in her eyes.
$s="01:11:02:11:01:11:02:13:01:11:01:11:01:13:02:12:01:13:01:11:
04:11:06:12:04:11:01:12:01:13:02:12:01:14:01:13:01:11:03:12:
01:11:04:12:02:11:01:11:01:13:02:11:03:11:06:11:01:11:05:12:
02:11:01:11:01:13:02:11:02:12:01:12:04:11:06:12:01:11:04:12:
04:11:01:12:03:12:01:12:01:11:01:12:01:12:02:11:01:11:01:13:
02:11:01:02:11:01:12:02";
@a=split(/:/,$s);$j="";foreach$c(@a) {@n=split(//,$c);$j.=$n[0]x$n[1];}
for($i=0;$i<$j=~y///c;$i+=8){print
chr(unpack("N",pack("B32",substr("0"x32 .substr($j,$i,8),-32))));}
Re: Maven 3 builds take much longer to run in 3.0.3 than in 3.0b1
Posted by Vivin Suresh Paliath <vi...@gmail.com>.
As far as I know, we're not using ranges. However, I don't know if we're
pulling anything in that does use ranges. What's a good way to find out?
As far as the aether stuff, I noticed as much from looking at the source.
I'm just trying to figure out if there is a way to make the
dependency-resolution process faster.
Thanks!
Vivin
On Tue, Jul 19, 2011 at 1:06 PM, Kristian Rosenvold <
kristian.rosenvold@gmail.com> wrote:
> Are you using version ranges ? There seems to be an issue with a
> combinatorial explosion of sorts with version ranges, I am not sure if
> there has been a jira submitted anywhere for that with a reproducible
> test case, though.
>
> The version range jump (3.0b1 to 3.0.3 include aether), so there's some
> pretty substantial changes to the dependency resolution stuff.
>
> Kristian
>
>
>
> ti., 19.07.2011 kl. 09.27 -0700, skrev Vivin Suresh Paliath:
> > I'm trying to track down the reason that our builds take much longer to
> > build under 3.0.3 rather than 3.0b1. Under 3.0.3, our build takes around
> 9
> > minutes, whereas under 3.0b1, it's 3 minutes and 30 seconds. While using
> > jconsole, I saw that most of the time (in 3.0.3) is spent inside
> > DefaultProjectDependenciesResolver.java. So I downloaded the source to
> both
> > 3.0b1 and 3.0.3 to see what's happening. I noticed that in 3.0.3 there
> are
> > two versions of the class. One is in org.apache.maven.project, while the
> > other is in org.apache.maven. It also appears that in 3.0.3, the former
> is
> > being used. While stepping through the code, I saw that bulk of the time
> is
> > spent when it reaches this statement:
> >
> > node = repoSystem.collectDependencies( session, collect ).getRoot();
> >
> > In 3.0b1, the code does:
> >
> > ArtifactResolutionResult result = repositorySystem.resolve( request );
> >
> > I also noticed that respositorySystem is of type RepositorySystem, and
> the
> > concrete implementation is LegacyRepositorySystem. I'm assuming that this
> > was being used while the Maven 3 was in beta until the new implementation
> > was created? Going back to 3.0.3, the collectDependencies method lives in
> > DefaultRepositorySystem.java which is part of
> > org.sonatype.aether.impl.internal. This eventually calls
> > collectDependenciesinside
> > DefaultDependencyCollector.java which is also part of
> > org.sonatype.aether.impl.internal. I'm assuming that this is how the
> > dependency graph is built. My question is if there is a way to make this
> > process faster? Could there be something wrong in the way we've set up
> our
> > dependencies in our project which could cause this process to be so slow?
> >
> > Or, is this a performance regression? If this is the case, I can open an
> > Jira issue.
> >
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@maven.apache.org
> For additional commands, e-mail: dev-help@maven.apache.org
>
>
--
Ruin untold;
And thine own sadness,
Sing in the grass,
When eve has forgot, that no more hear common things that gleam and pass;
But seek alone to lip, sad Rose of love and ruin untold;
And thine own mother
Can know it as I know
More than another
What makes your own sadness,
Set in her eyes.
$s="01:11:02:11:01:11:02:13:01:11:01:11:01:13:02:12:01:13:01:11:
04:11:06:12:04:11:01:12:01:13:02:12:01:14:01:13:01:11:03:12:
01:11:04:12:02:11:01:11:01:13:02:11:03:11:06:11:01:11:05:12:
02:11:01:11:01:13:02:11:02:12:01:12:04:11:06:12:01:11:04:12:
04:11:01:12:03:12:01:12:01:11:01:12:01:12:02:11:01:11:01:13:
02:11:01:02:11:01:12:02";
@a=split(/:/,$s);$j="";foreach$c(@a) {@n=split(//,$c);$j.=$n[0]x$n[1];}
for($i=0;$i<$j=~y///c;$i+=8){print
chr(unpack("N",pack("B32",substr("0"x32 .substr($j,$i,8),-32))));}
Re: Maven 3 builds take much longer to run in 3.0.3 than in 3.0b1
Posted by Vivin Suresh Paliath <vi...@gmail.com>.
Thanks Jörg! JIRA was the first place I searched to see if anyone else had
noticed this, but I couldn't find anything. Thank you for pointing me to the
issue! Is it possible for me to edit or add to the ticket?
Vivin
On Tue, Jul 19, 2011 at 2:50 PM, Jörg Schaible <jo...@gmx.de>wrote:
> Hi Vivin,
>
> Vivin Suresh Paliath wrote:
>
> > As far as I know, we're not using ranges. However, I don't know if we're
> > pulling anything in that does use ranges. What's a good way to find out?
> >
> > As far as the aether stuff, I noticed as much from looking at the source.
> > I'm just trying to figure out if there is a way to make the
> > dependency-resolution process faster.
>
> You're not the first one reporting this:
> http://jira.codehaus.org/browse/MNG-5125
>
> - Jörg
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@maven.apache.org
> For additional commands, e-mail: dev-help@maven.apache.org
>
>
--
Ruin untold;
And thine own sadness,
Sing in the grass,
When eve has forgot, that no more hear common things that gleam and pass;
But seek alone to lip, sad Rose of love and ruin untold;
And thine own mother
Can know it as I know
More than another
What makes your own sadness,
Set in her eyes.
$s="01:11:02:11:01:11:02:13:01:11:01:11:01:13:02:12:01:13:01:11:
04:11:06:12:04:11:01:12:01:13:02:12:01:14:01:13:01:11:03:12:
01:11:04:12:02:11:01:11:01:13:02:11:03:11:06:11:01:11:05:12:
02:11:01:11:01:13:02:11:02:12:01:12:04:11:06:12:01:11:04:12:
04:11:01:12:03:12:01:12:01:11:01:12:01:12:02:11:01:11:01:13:
02:11:01:02:11:01:12:02";
@a=split(/:/,$s);$j="";foreach$c(@a) {@n=split(//,$c);$j.=$n[0]x$n[1];}
for($i=0;$i<$j=~y///c;$i+=8){print
chr(unpack("N",pack("B32",substr("0"x32 .substr($j,$i,8),-32))));}
Re: Maven 3 builds take much longer to run in 3.0.3 than in 3.0b1
Posted by Jörg Schaible <jo...@gmx.de>.
Vivin Suresh Paliath wrote:
> Thanks Jörg! JIRA was the first place I searched to see if anyone else had
> noticed this, but I couldn't find anything. Thank you for pointing me to
> the issue! Is it possible for me to edit or add to the ticket?
Everyone can add comments, but you have to create an account in JIRA if you
do not have one yet. Simply follow the login.
- Jörg
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@maven.apache.org
For additional commands, e-mail: dev-help@maven.apache.org
Re: Maven 3 builds take much longer to run in 3.0.3 than in 3.0b1
Posted by Jörg Schaible <jo...@gmx.de>.
Hi Vivin,
Vivin Suresh Paliath wrote:
> As far as I know, we're not using ranges. However, I don't know if we're
> pulling anything in that does use ranges. What's a good way to find out?
>
> As far as the aether stuff, I noticed as much from looking at the source.
> I'm just trying to figure out if there is a way to make the
> dependency-resolution process faster.
You're not the first one reporting this:
http://jira.codehaus.org/browse/MNG-5125
- Jörg
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@maven.apache.org
For additional commands, e-mail: dev-help@maven.apache.org
Re: Maven 3 builds take much longer to run in 3.0.3 than in 3.0b1
Posted by Kristian Rosenvold <kr...@gmail.com>.
Are you using version ranges ? There seems to be an issue with a
combinatorial explosion of sorts with version ranges, I am not sure if
there has been a jira submitted anywhere for that with a reproducible
test case, though.
The version range jump (3.0b1 to 3.0.3 include aether), so there's some
pretty substantial changes to the dependency resolution stuff.
Kristian
ti., 19.07.2011 kl. 09.27 -0700, skrev Vivin Suresh Paliath:
> I'm trying to track down the reason that our builds take much longer to
> build under 3.0.3 rather than 3.0b1. Under 3.0.3, our build takes around 9
> minutes, whereas under 3.0b1, it's 3 minutes and 30 seconds. While using
> jconsole, I saw that most of the time (in 3.0.3) is spent inside
> DefaultProjectDependenciesResolver.java. So I downloaded the source to both
> 3.0b1 and 3.0.3 to see what's happening. I noticed that in 3.0.3 there are
> two versions of the class. One is in org.apache.maven.project, while the
> other is in org.apache.maven. It also appears that in 3.0.3, the former is
> being used. While stepping through the code, I saw that bulk of the time is
> spent when it reaches this statement:
>
> node = repoSystem.collectDependencies( session, collect ).getRoot();
>
> In 3.0b1, the code does:
>
> ArtifactResolutionResult result = repositorySystem.resolve( request );
>
> I also noticed that respositorySystem is of type RepositorySystem, and the
> concrete implementation is LegacyRepositorySystem. I'm assuming that this
> was being used while the Maven 3 was in beta until the new implementation
> was created? Going back to 3.0.3, the collectDependencies method lives in
> DefaultRepositorySystem.java which is part of
> org.sonatype.aether.impl.internal. This eventually calls
> collectDependenciesinside
> DefaultDependencyCollector.java which is also part of
> org.sonatype.aether.impl.internal. I'm assuming that this is how the
> dependency graph is built. My question is if there is a way to make this
> process faster? Could there be something wrong in the way we've set up our
> dependencies in our project which could cause this process to be so slow?
>
> Or, is this a performance regression? If this is the case, I can open an
> Jira issue.
>
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@maven.apache.org
For additional commands, e-mail: dev-help@maven.apache.org