You are viewing a plain text version of this content. The canonical link for it is here.
Posted to ivy-user@ant.apache.org by Ross Clewley <ro...@oracle.com> on 2007/08/15 11:53:37 UTC

NPE whilst resolving transitive configurations.

Hi

I need some help sorting out a NullPointerException that I'm getting 
during resolution. The stack looks like this.

java.lang.NullPointerException
        at fr.jayasoft.ivy.IvyNode.isEvicted(IvyNode.java:367)
        at fr.jayasoft.ivy.IvyNode.loadData(IvyNode.java:590)
        at fr.jayasoft.ivy.Ivy.fetchDependencies(Ivy.java:1417)
        at fr.jayasoft.ivy.Ivy.fetchDependencies(Ivy.java:1443)
        at fr.jayasoft.ivy.Ivy.doFetchDependencies(Ivy.java:1492)
        at fr.jayasoft.ivy.Ivy.fetchDependencies(Ivy.java:1424)
        at fr.jayasoft.ivy.Ivy.doFetchDependencies(Ivy.java:1492)
        at fr.jayasoft.ivy.Ivy.fetchDependencies(Ivy.java:1424)
        at fr.jayasoft.ivy.Ivy.doFetchDependencies(Ivy.java:1492)
        at fr.jayasoft.ivy.Ivy.fetchDependencies(Ivy.java:1433)
        at fr.jayasoft.ivy.Ivy.doFetchDependencies(Ivy.java:1476)
        at fr.jayasoft.ivy.Ivy.fetchDependencies(Ivy.java:1424)
        at fr.jayasoft.ivy.Ivy.getDependencies(Ivy.java:1343)
        at fr.jayasoft.ivy.Ivy.resolve(Ivy.java:1136)
        at fr.jayasoft.ivy.Ivy.resolve(Ivy.java:1093)
        at fr.jayasoft.ivy.ant.IvyResolve.execute(IvyResolve.java:167)

I'd like to be able to figure out a minimal testcase to reproduce this 
so I can log a Jira issue and also hopefully work around it. The trouble 
is I'm having problems figuring out what that minimal testcase is. The 
problem occurs with certain sets of dependencies and can go away again 
when those dependencies are changed, or even when the dependencies are 
re-ordered. I'm hoping someone may be able to give me some pointers 
about what to look at to help nail this down a bit more firmly.

The problem occurs whilst resolving transitive configurations. We have a 
build systems comprising 170 or so modules, each of which have the 
following configurations

    <conf name="default"   extends="package" transitive="true"/>
    <conf name="compile"   extends="default" visibility="private" 
transitive="false"/>
    <conf name="runtime"   extends="default" visibility="public"  
transitive="true"/>
    <conf name="test"      extends="runtime"/>

These modules declare dependencies amongst themselves or third party 
dependencies in their own filesystem repository with Ivy files that just 
have the default conf. Incase it's relevant the defaultconfmapping used 
throughout is "compile->default(*);*->@(*)".

It's when resolving the transitive runtime of test configurations that 
the NPE occurs.

It's difficult for me to give you a selection of the modules and their 
dependencies that cause the problem as there would be too many. That is 
why I want to try to understand the issue better and produce that 
minimal testcase. Any ideas?

thanks

Ross



Re: NPE whilst resolving transitive configurations.

Posted by Xavier Hanin <xa...@gmail.com>.
On 8/16/07, Ross Clewley <ro...@oracle.com> wrote:
>
> Hi
>
> I also see the following NullPointerException under similar conditions
> whilst resolving transitive configurations and can also be influenced by
> the order of the dependencies.
>
> java.lang.NullPointerException
>         at
> org.apache.ivy.core.resolve.ResolveEngine.downloadArtifacts(
> ResolveEngine.java:310)
>         at
> org.apache.ivy.core.resolve.ResolveEngine.resolve(ResolveEngine.java:271)
>         at
> org.apache.ivy.core.resolve.ResolveEngine.resolve(ResolveEngine.java:193)
>         at org.apache.ivy.Ivy.resolve(Ivy.java:256)
>         at org.apache.ivy.ant.IvyResolve.doExecute(IvyResolve.java:212)
>         at org.apache.ivy.ant.IvyTask.execute(IvyTask.java:281)
>
> I can't find that stack in jira. Do you think this is a related to the
> previous issue or needing it's own issue?


I think another stack deserves its own issue, with a link to the other one.
We'll mark all of them as resolved if fix them at once.

Thanks for reporting,

Xavier

thanks
>
> Ross
>
> Ross Clewley wrote:
> > Hi Xavier
> >
> > Thanks for taking a look. I've logged IVY-590.
> >
> > thanks
> >
> > Ross
> >
> > Xavier Hanin wrote:
> >
> >> On 8/15/07, Ross Clewley <ro...@oracle.com> wrote:
> >>
> >>
> >>> Hi
> >>>
> >>> I should also say that this is with 1.4.1. I've tried with 2.0-alpha2
> >>> and I still get the NPE.
> >>>
> >>>
> >> I can't easily browse the 1.4.1 source right now, so I've just given a
> >> glance at the trunk, and you've found a pretty big issue:  in
> >> ResolveEngine.java:523 we call mark evicted with a null collection of
> >> selected module revisions, which is passed down to the EvictionData
> >> constructor which causes the NPE. This is pretty easy to solve though
> >> (adding a check for nullity in the constructor). Could you open an
> issue for
> >> that?
> >>
> >> Besides finding the problem in 2.x, this may also help to narrow down
> the
> >> problem in 1.4. Indeed we have no unit test testing the case handled by
> >> ResolveEngine.java:523, so it may be a cause of the NPE in 1.4 too.
> >>
> >> Xavier
> >>
> >> The stack this time is
> >>
> >>
> >>> java.lang.NullPointerException
> >>>         at
> >>> org.apache.ivy.core.resolve.IvyNodeEviction$EvictionData.<init>(
> >>> IvyNodeEviction.java:48)
> >>>         at
> >>> org.apache.ivy.core.resolve.IvyNodeEviction.markEvicted(
> >>> IvyNodeEviction.java:266)
> >>>         at
> >>> org.apache.ivy.core.resolve.IvyNode.markEvicted(IvyNode.java:1101)
> >>>         at
> >>> org.apache.ivy.core.resolve.ResolveEngine.getDependencies(
> >>> ResolveEngine.java:523)
> >>>         at
> >>> org.apache.ivy.core.resolve.ResolveEngine.resolve(ResolveEngine.java
> :236)
> >>>         at
> >>> org.apache.ivy.core.resolve.ResolveEngine.resolve(ResolveEngine.java
> :194)
> >>>         at org.apache.ivy.Ivy.resolve(Ivy.java:256)
> >>>         at org.apache.ivy.ant.IvyResolve.doExecute(IvyResolve.java
> :207)
> >>>         at org.apache.ivy.ant.IvyTask.execute(IvyTask.java:281)
> >>>         at
> >>> org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:288)
> >>>         at sun.reflect.GeneratedMethodAccessor2.invoke(Unknown Source)
> >>>         at
> >>> sun.reflect.DelegatingMethodAccessorImpl.invoke(
> >>> DelegatingMethodAccessorImpl.java:25)
> >>>         at java.lang.reflect.Method.invoke(Method.java:585)
> >>>         at
> >>> org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java
> >>> :105)
> >>>         at org.apache.tools.ant.Task.perform(Task.java:348)
> >>>         at org.apache.tools.ant.Target.execute(Target.java:357)
> >>>         at org.apache.tools.ant.Target.performTasks(Target.java:385)
> >>>         at
> >>> org.apache.tools.ant.Project.executeSortedTargets(Project.java:1329)
> >>>         at org.apache.tools.ant.Project.executeTarget(Project.java
> :1298)
> >>>         at
> >>> org.apache.tools.ant.helper.DefaultExecutor.executeTargets(
> >>> DefaultExecutor.java:41)
> >>>         at org.apache.tools.ant.Project.executeTargets(Project.java
> :1181)
> >>>         at org.apache.tools.ant.Main.runBuild(Main.java:698)
> >>>         at org.apache.tools.ant.Main.startAnt(Main.java:199)
> >>>         at org.apache.tools.ant.launch.Launcher.run(Launcher.java:257)
> >>>         at org.apache.tools.ant.launch.Launcher.main(Launcher.java
> :104)
> >>>
> >>> However, there is a slight difference in the behaviour. With
> 2.0-alpha2,
> >>> if I do the resolve a second time without cleaning the cache it works.
> >>> If I clean the cache again and do the resolve I get the NPE again.
> With
> >>> 1.4.1 I get it every time, regardless of whether the cache is clean or
> >>> not.
> >>>
> >>> regards
> >>>
> >>> Ross
> >>>
> >>> Ross Clewley wrote:
> >>>
> >>>
> >>>> Hi
> >>>>
> >>>> I need some help sorting out a NullPointerException that I'm getting
> >>>> during resolution. The stack looks like this.
> >>>>
> >>>> java.lang.NullPointerException
> >>>>        at fr.jayasoft.ivy.IvyNode.isEvicted(IvyNode.java:367)
> >>>>        at fr.jayasoft.ivy.IvyNode.loadData(IvyNode.java:590)
> >>>>        at fr.jayasoft.ivy.Ivy.fetchDependencies(Ivy.java:1417)
> >>>>        at fr.jayasoft.ivy.Ivy.fetchDependencies(Ivy.java:1443)
> >>>>        at fr.jayasoft.ivy.Ivy.doFetchDependencies(Ivy.java:1492)
> >>>>        at fr.jayasoft.ivy.Ivy.fetchDependencies(Ivy.java:1424)
> >>>>        at fr.jayasoft.ivy.Ivy.doFetchDependencies(Ivy.java:1492)
> >>>>        at fr.jayasoft.ivy.Ivy.fetchDependencies(Ivy.java:1424)
> >>>>        at fr.jayasoft.ivy.Ivy.doFetchDependencies(Ivy.java:1492)
> >>>>        at fr.jayasoft.ivy.Ivy.fetchDependencies(Ivy.java:1433)
> >>>>        at fr.jayasoft.ivy.Ivy.doFetchDependencies(Ivy.java:1476)
> >>>>        at fr.jayasoft.ivy.Ivy.fetchDependencies(Ivy.java:1424)
> >>>>        at fr.jayasoft.ivy.Ivy.getDependencies(Ivy.java:1343)
> >>>>        at fr.jayasoft.ivy.Ivy.resolve(Ivy.java:1136)
> >>>>        at fr.jayasoft.ivy.Ivy.resolve(Ivy.java:1093)
> >>>>        at fr.jayasoft.ivy.ant.IvyResolve.execute(IvyResolve.java:167)
> >>>>
> >>>> I'd like to be able to figure out a minimal testcase to reproduce
> this
> >>>> so I can log a Jira issue and also hopefully work around it. The
> >>>> trouble is I'm having problems figuring out what that minimal
> testcase
> >>>> is. The problem occurs with certain sets of dependencies and can go
> >>>> away again when those dependencies are changed, or even when the
> >>>> dependencies are re-ordered. I'm hoping someone may be able to give
> me
> >>>> some pointers about what to look at to help nail this down a bit more
> >>>> firmly.
> >>>>
> >>>> The problem occurs whilst resolving transitive configurations. We
> have
> >>>> a build systems comprising 170 or so modules, each of which have the
> >>>> following configurations
> >>>>
> >>>>    <conf name="default"   extends="package" transitive="true"/>
> >>>>    <conf name="compile"   extends="default" visibility="private"
> >>>> transitive="false"/>
> >>>>    <conf name="runtime"   extends="default" visibility="public"
> >>>> transitive="true"/>
> >>>>    <conf name="test"      extends="runtime"/>
> >>>>
> >>>> These modules declare dependencies amongst themselves or third party
> >>>> dependencies in their own filesystem repository with Ivy files that
> >>>> just have the default conf. Incase it's relevant the
> >>>> defaultconfmapping used throughout is "compile->default(*);*->@(*)".
> >>>>
> >>>> It's when resolving the transitive runtime of test configurations
> that
> >>>> the NPE occurs.
> >>>>
> >>>> It's difficult for me to give you a selection of the modules and
> their
> >>>> dependencies that cause the problem as there would be too many. That
> >>>> is why I want to try to understand the issue better and produce that
> >>>> minimal testcase. Any ideas?
> >>>>
> >>>> thanks
> >>>>
> >>>> Ross
> >>>>
> >>>>
> >>>>
> >>>>
> >>>
> >>>
> >>
> >>
> >
> >
> >
>
>


-- 
Xavier Hanin - Independent Java Consultant
http://xhab.blogspot.com/
http://incubator.apache.org/ivy/
http://www.xoocode.org/

Re: NPE whilst resolving transitive configurations.

Posted by Ross Clewley <ro...@oracle.com>.
Hi

I also see the following NullPointerException under similar conditions
whilst resolving transitive configurations and can also be influenced by
the order of the dependencies.

java.lang.NullPointerException
        at
org.apache.ivy.core.resolve.ResolveEngine.downloadArtifacts(ResolveEngine.java:310)
        at
org.apache.ivy.core.resolve.ResolveEngine.resolve(ResolveEngine.java:271)
        at
org.apache.ivy.core.resolve.ResolveEngine.resolve(ResolveEngine.java:193)
        at org.apache.ivy.Ivy.resolve(Ivy.java:256)
        at org.apache.ivy.ant.IvyResolve.doExecute(IvyResolve.java:212)
        at org.apache.ivy.ant.IvyTask.execute(IvyTask.java:281)

I can't find that stack in jira. Do you think this is a related to the
previous issue or needing it's own issue?

thanks

Ross

Ross Clewley wrote:
> Hi Xavier
>
> Thanks for taking a look. I've logged IVY-590.
>
> thanks
>
> Ross
>
> Xavier Hanin wrote:
>   
>> On 8/15/07, Ross Clewley <ro...@oracle.com> wrote:
>>   
>>     
>>> Hi
>>>
>>> I should also say that this is with 1.4.1. I've tried with 2.0-alpha2
>>> and I still get the NPE.
>>>     
>>>       
>> I can't easily browse the 1.4.1 source right now, so I've just given a
>> glance at the trunk, and you've found a pretty big issue:  in
>> ResolveEngine.java:523 we call mark evicted with a null collection of
>> selected module revisions, which is passed down to the EvictionData
>> constructor which causes the NPE. This is pretty easy to solve though
>> (adding a check for nullity in the constructor). Could you open an issue for
>> that?
>>
>> Besides finding the problem in 2.x, this may also help to narrow down the
>> problem in 1.4. Indeed we have no unit test testing the case handled by
>> ResolveEngine.java:523, so it may be a cause of the NPE in 1.4 too.
>>
>> Xavier
>>
>> The stack this time is
>>   
>>     
>>> java.lang.NullPointerException
>>>         at
>>> org.apache.ivy.core.resolve.IvyNodeEviction$EvictionData.<init>(
>>> IvyNodeEviction.java:48)
>>>         at
>>> org.apache.ivy.core.resolve.IvyNodeEviction.markEvicted(
>>> IvyNodeEviction.java:266)
>>>         at
>>> org.apache.ivy.core.resolve.IvyNode.markEvicted(IvyNode.java:1101)
>>>         at
>>> org.apache.ivy.core.resolve.ResolveEngine.getDependencies(
>>> ResolveEngine.java:523)
>>>         at
>>> org.apache.ivy.core.resolve.ResolveEngine.resolve(ResolveEngine.java:236)
>>>         at
>>> org.apache.ivy.core.resolve.ResolveEngine.resolve(ResolveEngine.java:194)
>>>         at org.apache.ivy.Ivy.resolve(Ivy.java:256)
>>>         at org.apache.ivy.ant.IvyResolve.doExecute(IvyResolve.java:207)
>>>         at org.apache.ivy.ant.IvyTask.execute(IvyTask.java:281)
>>>         at
>>> org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:288)
>>>         at sun.reflect.GeneratedMethodAccessor2.invoke(Unknown Source)
>>>         at
>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(
>>> DelegatingMethodAccessorImpl.java:25)
>>>         at java.lang.reflect.Method.invoke(Method.java:585)
>>>         at
>>> org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java
>>> :105)
>>>         at org.apache.tools.ant.Task.perform(Task.java:348)
>>>         at org.apache.tools.ant.Target.execute(Target.java:357)
>>>         at org.apache.tools.ant.Target.performTasks(Target.java:385)
>>>         at
>>> org.apache.tools.ant.Project.executeSortedTargets(Project.java:1329)
>>>         at org.apache.tools.ant.Project.executeTarget(Project.java:1298)
>>>         at
>>> org.apache.tools.ant.helper.DefaultExecutor.executeTargets(
>>> DefaultExecutor.java:41)
>>>         at org.apache.tools.ant.Project.executeTargets(Project.java:1181)
>>>         at org.apache.tools.ant.Main.runBuild(Main.java:698)
>>>         at org.apache.tools.ant.Main.startAnt(Main.java:199)
>>>         at org.apache.tools.ant.launch.Launcher.run(Launcher.java:257)
>>>         at org.apache.tools.ant.launch.Launcher.main(Launcher.java:104)
>>>
>>> However, there is a slight difference in the behaviour. With 2.0-alpha2,
>>> if I do the resolve a second time without cleaning the cache it works.
>>> If I clean the cache again and do the resolve I get the NPE again. With
>>> 1.4.1 I get it every time, regardless of whether the cache is clean or
>>> not.
>>>
>>> regards
>>>
>>> Ross
>>>
>>> Ross Clewley wrote:
>>>     
>>>       
>>>> Hi
>>>>
>>>> I need some help sorting out a NullPointerException that I'm getting
>>>> during resolution. The stack looks like this.
>>>>
>>>> java.lang.NullPointerException
>>>>        at fr.jayasoft.ivy.IvyNode.isEvicted(IvyNode.java:367)
>>>>        at fr.jayasoft.ivy.IvyNode.loadData(IvyNode.java:590)
>>>>        at fr.jayasoft.ivy.Ivy.fetchDependencies(Ivy.java:1417)
>>>>        at fr.jayasoft.ivy.Ivy.fetchDependencies(Ivy.java:1443)
>>>>        at fr.jayasoft.ivy.Ivy.doFetchDependencies(Ivy.java:1492)
>>>>        at fr.jayasoft.ivy.Ivy.fetchDependencies(Ivy.java:1424)
>>>>        at fr.jayasoft.ivy.Ivy.doFetchDependencies(Ivy.java:1492)
>>>>        at fr.jayasoft.ivy.Ivy.fetchDependencies(Ivy.java:1424)
>>>>        at fr.jayasoft.ivy.Ivy.doFetchDependencies(Ivy.java:1492)
>>>>        at fr.jayasoft.ivy.Ivy.fetchDependencies(Ivy.java:1433)
>>>>        at fr.jayasoft.ivy.Ivy.doFetchDependencies(Ivy.java:1476)
>>>>        at fr.jayasoft.ivy.Ivy.fetchDependencies(Ivy.java:1424)
>>>>        at fr.jayasoft.ivy.Ivy.getDependencies(Ivy.java:1343)
>>>>        at fr.jayasoft.ivy.Ivy.resolve(Ivy.java:1136)
>>>>        at fr.jayasoft.ivy.Ivy.resolve(Ivy.java:1093)
>>>>        at fr.jayasoft.ivy.ant.IvyResolve.execute(IvyResolve.java:167)
>>>>
>>>> I'd like to be able to figure out a minimal testcase to reproduce this
>>>> so I can log a Jira issue and also hopefully work around it. The
>>>> trouble is I'm having problems figuring out what that minimal testcase
>>>> is. The problem occurs with certain sets of dependencies and can go
>>>> away again when those dependencies are changed, or even when the
>>>> dependencies are re-ordered. I'm hoping someone may be able to give me
>>>> some pointers about what to look at to help nail this down a bit more
>>>> firmly.
>>>>
>>>> The problem occurs whilst resolving transitive configurations. We have
>>>> a build systems comprising 170 or so modules, each of which have the
>>>> following configurations
>>>>
>>>>    <conf name="default"   extends="package" transitive="true"/>
>>>>    <conf name="compile"   extends="default" visibility="private"
>>>> transitive="false"/>
>>>>    <conf name="runtime"   extends="default" visibility="public"
>>>> transitive="true"/>
>>>>    <conf name="test"      extends="runtime"/>
>>>>
>>>> These modules declare dependencies amongst themselves or third party
>>>> dependencies in their own filesystem repository with Ivy files that
>>>> just have the default conf. Incase it's relevant the
>>>> defaultconfmapping used throughout is "compile->default(*);*->@(*)".
>>>>
>>>> It's when resolving the transitive runtime of test configurations that
>>>> the NPE occurs.
>>>>
>>>> It's difficult for me to give you a selection of the modules and their
>>>> dependencies that cause the problem as there would be too many. That
>>>> is why I want to try to understand the issue better and produce that
>>>> minimal testcase. Any ideas?
>>>>
>>>> thanks
>>>>
>>>> Ross
>>>>
>>>>
>>>>       
>>>>         
>>>     
>>>       
>>   
>>     
>
>
>   


RE: Best Practices for Version Convergence

Posted by Nascif Abousalh-Neto <Na...@sas.com>.
Thanks for all the replies. I agree that in the end, technology can't
solve what is basically a human communication problem... but some of the
tips were very interesting. I don't know if centralizing the version
decisions by reviewing warnings or using variables will scale to the
size of our organization, but it is worth investigating.

Regards,
  /Nascif 

-----Original Message-----
From: Xavier Hanin [mailto:xavier.hanin@gmail.com] 
Sent: Thursday, August 16, 2007 3:09 AM
To: ivy-user@incubator.apache.org
Subject: Re: Best Practices for Version Convergence

On 8/15/07, Stephane Bailliez <sb...@gmail.com> wrote:
>
> Nascif Abousalh-Neto wrote:
> > One of the features that attracted me to Ivy was the possibility to 
> > switch between dynamic and fixed versions. While dynamic versions 
> > can help you to keep your code always integrated with the latest and

> > greatest from your dependencies (specially if backed up by a 
> > Continuous Integration server), a static version can protect you 
> > from a buggy new version and allow you some stability to develop a 
> > new feature while your dependency is churning.
> >
> > But I got worried after a conversation with a friend from a large 
> > company, which told me that they gave up on using static versions 
> > because they would never converge. Complex products typically have 
> > many "diamond-shape" subgraphs embedded in their dependency graphs, 
> > which creates lateral dependencies that are hard if not impossible 
> > to catch locally. Even if you can detect them early by using tools 
> > that can pinpoint the affected areas in the dependency graph, they 
> > are still hard to solve if they cross team boundaries.
> >
> [...]
> > Has anybody working on a similar scenario faced this issue? Any 
> > advise or suggestion?
> >
> There is not one size fit all answer for this I'm afraid. It depends a

> lot on the team process. They type of products you are building 
> internally and if all these products obey the same type of deadline 
> and focus, team experience, etc...
>
> I have always found that the barrier to any dependency management is 
> not the tools in any way or any technical issue but it is mostly a 
> human process. You will spend a full year of frustration of people not

> listening and continuously doing weird things and complexify the 
> builds and processes in amazing way.
>
> I have experienced that several times and it is _always_ the same 
> story as frustrating as this is. (and large software companies doing 
> IT work are not any better, I have seen very very very very silly 
> things in 150+ developer projects)
>
> It all depends as well how much the team in question has had to 
> product development in comparison to short-term IT-type development. 
> The approach and mindset will be very different between all those
people.
> Sometimes you will have no choice than to let people do the wrong 
> thing until they are knee deep in a terrible mess and willing to 
> accept the obvious.
>
> Human is the most painful part to change management.


I agree with you, stephane.

To go a little bit further about your question, Nascif, I'd say that
there are some practices which may be interesting for you. For example,
you can use a flexible conflict manager like the default one, and add
warnings when a conflict occur, requiring someone to review the
decisions of the conflict manager. If you disagree with one of these
decisions, you can always use the conflict management section of your
ivy file to make a static choice instead of relying on the conflict
manager for this case. This requires some development on a custom
conflict manager, but can be interesting.

An easier way to do something pretty similar is to review Ivy
dependencies report regularly, or at least whenever you release a
product.

You can also use only static revisions but use variables for the actual
revisions to use. Then you can keep control over the versions you use
for a product in a single property file for instance.

That's only some ideas, as Stephane said, it really depends a lot on
your teams and processes.

HTH,

Xavier

-- stephane
>
>


--
Xavier Hanin - Independent Java Consultant http://xhab.blogspot.com/
http://incubator.apache.org/ivy/ http://www.xoocode.org/

Re: Best Practices for Version Convergence

Posted by Xavier Hanin <xa...@gmail.com>.
On 8/15/07, Stephane Bailliez <sb...@gmail.com> wrote:
>
> Nascif Abousalh-Neto wrote:
> > One of the features that attracted me to Ivy was the possibility to
> > switch between dynamic and fixed versions. While dynamic versions can
> > help you to keep your code always integrated with the latest and
> > greatest from your dependencies (specially if backed up by a Continuous
> > Integration server), a static version can protect you from a buggy new
> > version and allow you some stability to develop a new feature while your
> > dependency is churning.
> >
> > But I got worried after a conversation with a friend from a large
> > company, which told me that they gave up on using static versions
> > because they would never converge. Complex products typically have many
> > "diamond-shape" subgraphs embedded in their dependency graphs, which
> > creates lateral dependencies that are hard if not impossible to catch
> > locally. Even if you can detect them early by using tools that can
> > pinpoint the affected areas in the dependency graph, they are still hard
> > to solve if they cross team boundaries.
> >
> [...]
> > Has anybody working on a similar scenario faced this issue? Any advise
> > or suggestion?
> >
> There is not one size fit all answer for this I'm afraid. It depends a
> lot on the team process. They type of products you are building
> internally and if all these products obey the same type of deadline and
> focus, team experience, etc...
>
> I have always found that the barrier to any dependency management is not
> the tools in any way or any technical issue but it is mostly a human
> process. You will spend a full year of frustration of people not
> listening and continuously doing weird things and complexify the builds
> and processes in amazing way.
>
> I have experienced that several times and it is _always_ the same story
> as frustrating as this is. (and large software companies doing IT work
> are not any better, I have seen very very very very silly things in 150+
> developer projects)
>
> It all depends as well how much the team in question has had to product
> development in comparison to short-term IT-type development. The
> approach and mindset will be very different between all those people.
> Sometimes you will have no choice than to let people do the wrong thing
> until they are knee deep in a terrible mess and willing to accept the
> obvious.
>
> Human is the most painful part to change management.


I agree with you, stephane.

To go a little bit further about your question, Nascif, I'd say that there
are some practices which may be interesting for you. For example, you can
use a flexible conflict manager like the default one, and add warnings when
a conflict occur, requiring someone to review the decisions of the conflict
manager. If you disagree with one of these decisions, you can always use the
conflict management section of your ivy file to make a static choice instead
of relying on the conflict manager for this case. This requires some
development on a custom conflict manager, but can be interesting.

An easier way to do something pretty similar is to review Ivy dependencies
report regularly, or at least whenever you release a product.

You can also use only static revisions but use variables for the actual
revisions to use. Then you can keep control over the versions you use for a
product in a single property file for instance.

That's only some ideas, as Stephane said, it really depends a lot on your
teams and processes.

HTH,

Xavier

-- stephane
>
>


-- 
Xavier Hanin - Independent Java Consultant
http://xhab.blogspot.com/
http://incubator.apache.org/ivy/
http://www.xoocode.org/

Re: Best Practices for Version Convergence

Posted by Stephane Bailliez <sb...@gmail.com>.
Nascif Abousalh-Neto wrote:
> One of the features that attracted me to Ivy was the possibility to
> switch between dynamic and fixed versions. While dynamic versions can
> help you to keep your code always integrated with the latest and
> greatest from your dependencies (specially if backed up by a Continuous
> Integration server), a static version can protect you from a buggy new
> version and allow you some stability to develop a new feature while your
> dependency is churning.
>
> But I got worried after a conversation with a friend from a large
> company, which told me that they gave up on using static versions
> because they would never converge. Complex products typically have many
> "diamond-shape" subgraphs embedded in their dependency graphs, which
> creates lateral dependencies that are hard if not impossible to catch
> locally. Even if you can detect them early by using tools that can
> pinpoint the affected areas in the dependency graph, they are still hard
> to solve if they cross team boundaries.
>   
[...]
> Has anybody working on a similar scenario faced this issue? Any advise
> or suggestion? 
>   
There is not one size fit all answer for this I'm afraid. It depends a 
lot on the team process. They type of products you are building 
internally and if all these products obey the same type of deadline and 
focus, team experience, etc...

I have always found that the barrier to any dependency management is not 
the tools in any way or any technical issue but it is mostly a human 
process. You will spend a full year of frustration of people not 
listening and continuously doing weird things and complexify the builds 
and processes in amazing way.

I have experienced that several times and it is _always_ the same story 
as frustrating as this is. (and large software companies doing IT work 
are not any better, I have seen very very very very silly things in 150+ 
developer projects)

It all depends as well how much the team in question has had to product 
development in comparison to short-term IT-type development. The 
approach and mindset will be very different between all those people. 
Sometimes you will have no choice than to let people do the wrong thing 
until they are knee deep in a terrible mess and willing to accept the 
obvious.

Human is the most painful part to change management.

-- stephane


Best Practices for Version Convergence

Posted by Nascif Abousalh-Neto <Na...@sas.com>.
One of the features that attracted me to Ivy was the possibility to
switch between dynamic and fixed versions. While dynamic versions can
help you to keep your code always integrated with the latest and
greatest from your dependencies (specially if backed up by a Continuous
Integration server), a static version can protect you from a buggy new
version and allow you some stability to develop a new feature while your
dependency is churning.

But I got worried after a conversation with a friend from a large
company, which told me that they gave up on using static versions
because they would never converge. Complex products typically have many
"diamond-shape" subgraphs embedded in their dependency graphs, which
creates lateral dependencies that are hard if not impossible to catch
locally. Even if you can detect them early by using tools that can
pinpoint the affected areas in the dependency graph, they are still hard
to solve if they cross team boundaries.

For example: let's say we have the following dependency graph, where all
components are supported by different teams:
A -> B
A -> C
A -> D

B -> E
C -> E
D -> E

When using a "strict" conflict manager, A will only be able to resolve
succesfully if B, C and D are using the same versions of E. Getting them
all to agree on using the same version might not be trivial - and
meanwhile A is stuck on its previous working configuration.

I don't like the idea of using other, more flexible conflict managers
because they create configurations that were not validated by the
dependency teams. So if B was published using an old version of E, I
don't think it is a good idea to allow A->B->E with the latest version
of E - it might result in unpredictable behavior in A's runtime.

Using dynamic versions ('latest.*') would prevent this problem but it
denies the advantage of using Ivy to create a stable (if temporary)
environment for development.

Has anybody working on a similar scenario faced this issue? Any advise
or suggestion? 
Thanks,
  Nascif

Re: NPE whilst resolving transitive configurations.

Posted by Ross Clewley <ro...@oracle.com>.
Hi Xavier

Thanks for taking a look. I've logged IVY-590.

thanks

Ross

Xavier Hanin wrote:
> On 8/15/07, Ross Clewley <ro...@oracle.com> wrote:
>   
>> Hi
>>
>> I should also say that this is with 1.4.1. I've tried with 2.0-alpha2
>> and I still get the NPE.
>>     
>
>
> I can't easily browse the 1.4.1 source right now, so I've just given a
> glance at the trunk, and you've found a pretty big issue:  in
> ResolveEngine.java:523 we call mark evicted with a null collection of
> selected module revisions, which is passed down to the EvictionData
> constructor which causes the NPE. This is pretty easy to solve though
> (adding a check for nullity in the constructor). Could you open an issue for
> that?
>
> Besides finding the problem in 2.x, this may also help to narrow down the
> problem in 1.4. Indeed we have no unit test testing the case handled by
> ResolveEngine.java:523, so it may be a cause of the NPE in 1.4 too.
>
> Xavier
>
> The stack this time is
>   
>> java.lang.NullPointerException
>>         at
>> org.apache.ivy.core.resolve.IvyNodeEviction$EvictionData.<init>(
>> IvyNodeEviction.java:48)
>>         at
>> org.apache.ivy.core.resolve.IvyNodeEviction.markEvicted(
>> IvyNodeEviction.java:266)
>>         at
>> org.apache.ivy.core.resolve.IvyNode.markEvicted(IvyNode.java:1101)
>>         at
>> org.apache.ivy.core.resolve.ResolveEngine.getDependencies(
>> ResolveEngine.java:523)
>>         at
>> org.apache.ivy.core.resolve.ResolveEngine.resolve(ResolveEngine.java:236)
>>         at
>> org.apache.ivy.core.resolve.ResolveEngine.resolve(ResolveEngine.java:194)
>>         at org.apache.ivy.Ivy.resolve(Ivy.java:256)
>>         at org.apache.ivy.ant.IvyResolve.doExecute(IvyResolve.java:207)
>>         at org.apache.ivy.ant.IvyTask.execute(IvyTask.java:281)
>>         at
>> org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:288)
>>         at sun.reflect.GeneratedMethodAccessor2.invoke(Unknown Source)
>>         at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(
>> DelegatingMethodAccessorImpl.java:25)
>>         at java.lang.reflect.Method.invoke(Method.java:585)
>>         at
>> org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java
>> :105)
>>         at org.apache.tools.ant.Task.perform(Task.java:348)
>>         at org.apache.tools.ant.Target.execute(Target.java:357)
>>         at org.apache.tools.ant.Target.performTasks(Target.java:385)
>>         at
>> org.apache.tools.ant.Project.executeSortedTargets(Project.java:1329)
>>         at org.apache.tools.ant.Project.executeTarget(Project.java:1298)
>>         at
>> org.apache.tools.ant.helper.DefaultExecutor.executeTargets(
>> DefaultExecutor.java:41)
>>         at org.apache.tools.ant.Project.executeTargets(Project.java:1181)
>>         at org.apache.tools.ant.Main.runBuild(Main.java:698)
>>         at org.apache.tools.ant.Main.startAnt(Main.java:199)
>>         at org.apache.tools.ant.launch.Launcher.run(Launcher.java:257)
>>         at org.apache.tools.ant.launch.Launcher.main(Launcher.java:104)
>>
>> However, there is a slight difference in the behaviour. With 2.0-alpha2,
>> if I do the resolve a second time without cleaning the cache it works.
>> If I clean the cache again and do the resolve I get the NPE again. With
>> 1.4.1 I get it every time, regardless of whether the cache is clean or
>> not.
>>
>> regards
>>
>> Ross
>>
>> Ross Clewley wrote:
>>     
>>> Hi
>>>
>>> I need some help sorting out a NullPointerException that I'm getting
>>> during resolution. The stack looks like this.
>>>
>>> java.lang.NullPointerException
>>>        at fr.jayasoft.ivy.IvyNode.isEvicted(IvyNode.java:367)
>>>        at fr.jayasoft.ivy.IvyNode.loadData(IvyNode.java:590)
>>>        at fr.jayasoft.ivy.Ivy.fetchDependencies(Ivy.java:1417)
>>>        at fr.jayasoft.ivy.Ivy.fetchDependencies(Ivy.java:1443)
>>>        at fr.jayasoft.ivy.Ivy.doFetchDependencies(Ivy.java:1492)
>>>        at fr.jayasoft.ivy.Ivy.fetchDependencies(Ivy.java:1424)
>>>        at fr.jayasoft.ivy.Ivy.doFetchDependencies(Ivy.java:1492)
>>>        at fr.jayasoft.ivy.Ivy.fetchDependencies(Ivy.java:1424)
>>>        at fr.jayasoft.ivy.Ivy.doFetchDependencies(Ivy.java:1492)
>>>        at fr.jayasoft.ivy.Ivy.fetchDependencies(Ivy.java:1433)
>>>        at fr.jayasoft.ivy.Ivy.doFetchDependencies(Ivy.java:1476)
>>>        at fr.jayasoft.ivy.Ivy.fetchDependencies(Ivy.java:1424)
>>>        at fr.jayasoft.ivy.Ivy.getDependencies(Ivy.java:1343)
>>>        at fr.jayasoft.ivy.Ivy.resolve(Ivy.java:1136)
>>>        at fr.jayasoft.ivy.Ivy.resolve(Ivy.java:1093)
>>>        at fr.jayasoft.ivy.ant.IvyResolve.execute(IvyResolve.java:167)
>>>
>>> I'd like to be able to figure out a minimal testcase to reproduce this
>>> so I can log a Jira issue and also hopefully work around it. The
>>> trouble is I'm having problems figuring out what that minimal testcase
>>> is. The problem occurs with certain sets of dependencies and can go
>>> away again when those dependencies are changed, or even when the
>>> dependencies are re-ordered. I'm hoping someone may be able to give me
>>> some pointers about what to look at to help nail this down a bit more
>>> firmly.
>>>
>>> The problem occurs whilst resolving transitive configurations. We have
>>> a build systems comprising 170 or so modules, each of which have the
>>> following configurations
>>>
>>>    <conf name="default"   extends="package" transitive="true"/>
>>>    <conf name="compile"   extends="default" visibility="private"
>>> transitive="false"/>
>>>    <conf name="runtime"   extends="default" visibility="public"
>>> transitive="true"/>
>>>    <conf name="test"      extends="runtime"/>
>>>
>>> These modules declare dependencies amongst themselves or third party
>>> dependencies in their own filesystem repository with Ivy files that
>>> just have the default conf. Incase it's relevant the
>>> defaultconfmapping used throughout is "compile->default(*);*->@(*)".
>>>
>>> It's when resolving the transitive runtime of test configurations that
>>> the NPE occurs.
>>>
>>> It's difficult for me to give you a selection of the modules and their
>>> dependencies that cause the problem as there would be too many. That
>>> is why I want to try to understand the issue better and produce that
>>> minimal testcase. Any ideas?
>>>
>>> thanks
>>>
>>> Ross
>>>
>>>
>>>       
>>     
>
>
>   


Re: NPE whilst resolving transitive configurations.

Posted by Xavier Hanin <xa...@gmail.com>.
On 8/15/07, Ross Clewley <ro...@oracle.com> wrote:
>
> Hi
>
> I should also say that this is with 1.4.1. I've tried with 2.0-alpha2
> and I still get the NPE.


I can't easily browse the 1.4.1 source right now, so I've just given a
glance at the trunk, and you've found a pretty big issue:  in
ResolveEngine.java:523 we call mark evicted with a null collection of
selected module revisions, which is passed down to the EvictionData
constructor which causes the NPE. This is pretty easy to solve though
(adding a check for nullity in the constructor). Could you open an issue for
that?

Besides finding the problem in 2.x, this may also help to narrow down the
problem in 1.4. Indeed we have no unit test testing the case handled by
ResolveEngine.java:523, so it may be a cause of the NPE in 1.4 too.

Xavier

The stack this time is
>
> java.lang.NullPointerException
>         at
> org.apache.ivy.core.resolve.IvyNodeEviction$EvictionData.<init>(
> IvyNodeEviction.java:48)
>         at
> org.apache.ivy.core.resolve.IvyNodeEviction.markEvicted(
> IvyNodeEviction.java:266)
>         at
> org.apache.ivy.core.resolve.IvyNode.markEvicted(IvyNode.java:1101)
>         at
> org.apache.ivy.core.resolve.ResolveEngine.getDependencies(
> ResolveEngine.java:523)
>         at
> org.apache.ivy.core.resolve.ResolveEngine.resolve(ResolveEngine.java:236)
>         at
> org.apache.ivy.core.resolve.ResolveEngine.resolve(ResolveEngine.java:194)
>         at org.apache.ivy.Ivy.resolve(Ivy.java:256)
>         at org.apache.ivy.ant.IvyResolve.doExecute(IvyResolve.java:207)
>         at org.apache.ivy.ant.IvyTask.execute(IvyTask.java:281)
>         at
> org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:288)
>         at sun.reflect.GeneratedMethodAccessor2.invoke(Unknown Source)
>         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(
> DelegatingMethodAccessorImpl.java:25)
>         at java.lang.reflect.Method.invoke(Method.java:585)
>         at
> org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java
> :105)
>         at org.apache.tools.ant.Task.perform(Task.java:348)
>         at org.apache.tools.ant.Target.execute(Target.java:357)
>         at org.apache.tools.ant.Target.performTasks(Target.java:385)
>         at
> org.apache.tools.ant.Project.executeSortedTargets(Project.java:1329)
>         at org.apache.tools.ant.Project.executeTarget(Project.java:1298)
>         at
> org.apache.tools.ant.helper.DefaultExecutor.executeTargets(
> DefaultExecutor.java:41)
>         at org.apache.tools.ant.Project.executeTargets(Project.java:1181)
>         at org.apache.tools.ant.Main.runBuild(Main.java:698)
>         at org.apache.tools.ant.Main.startAnt(Main.java:199)
>         at org.apache.tools.ant.launch.Launcher.run(Launcher.java:257)
>         at org.apache.tools.ant.launch.Launcher.main(Launcher.java:104)
>
> However, there is a slight difference in the behaviour. With 2.0-alpha2,
> if I do the resolve a second time without cleaning the cache it works.
> If I clean the cache again and do the resolve I get the NPE again. With
> 1.4.1 I get it every time, regardless of whether the cache is clean or
> not.
>
> regards
>
> Ross
>
> Ross Clewley wrote:
> > Hi
> >
> > I need some help sorting out a NullPointerException that I'm getting
> > during resolution. The stack looks like this.
> >
> > java.lang.NullPointerException
> >        at fr.jayasoft.ivy.IvyNode.isEvicted(IvyNode.java:367)
> >        at fr.jayasoft.ivy.IvyNode.loadData(IvyNode.java:590)
> >        at fr.jayasoft.ivy.Ivy.fetchDependencies(Ivy.java:1417)
> >        at fr.jayasoft.ivy.Ivy.fetchDependencies(Ivy.java:1443)
> >        at fr.jayasoft.ivy.Ivy.doFetchDependencies(Ivy.java:1492)
> >        at fr.jayasoft.ivy.Ivy.fetchDependencies(Ivy.java:1424)
> >        at fr.jayasoft.ivy.Ivy.doFetchDependencies(Ivy.java:1492)
> >        at fr.jayasoft.ivy.Ivy.fetchDependencies(Ivy.java:1424)
> >        at fr.jayasoft.ivy.Ivy.doFetchDependencies(Ivy.java:1492)
> >        at fr.jayasoft.ivy.Ivy.fetchDependencies(Ivy.java:1433)
> >        at fr.jayasoft.ivy.Ivy.doFetchDependencies(Ivy.java:1476)
> >        at fr.jayasoft.ivy.Ivy.fetchDependencies(Ivy.java:1424)
> >        at fr.jayasoft.ivy.Ivy.getDependencies(Ivy.java:1343)
> >        at fr.jayasoft.ivy.Ivy.resolve(Ivy.java:1136)
> >        at fr.jayasoft.ivy.Ivy.resolve(Ivy.java:1093)
> >        at fr.jayasoft.ivy.ant.IvyResolve.execute(IvyResolve.java:167)
> >
> > I'd like to be able to figure out a minimal testcase to reproduce this
> > so I can log a Jira issue and also hopefully work around it. The
> > trouble is I'm having problems figuring out what that minimal testcase
> > is. The problem occurs with certain sets of dependencies and can go
> > away again when those dependencies are changed, or even when the
> > dependencies are re-ordered. I'm hoping someone may be able to give me
> > some pointers about what to look at to help nail this down a bit more
> > firmly.
> >
> > The problem occurs whilst resolving transitive configurations. We have
> > a build systems comprising 170 or so modules, each of which have the
> > following configurations
> >
> >    <conf name="default"   extends="package" transitive="true"/>
> >    <conf name="compile"   extends="default" visibility="private"
> > transitive="false"/>
> >    <conf name="runtime"   extends="default" visibility="public"
> > transitive="true"/>
> >    <conf name="test"      extends="runtime"/>
> >
> > These modules declare dependencies amongst themselves or third party
> > dependencies in their own filesystem repository with Ivy files that
> > just have the default conf. Incase it's relevant the
> > defaultconfmapping used throughout is "compile->default(*);*->@(*)".
> >
> > It's when resolving the transitive runtime of test configurations that
> > the NPE occurs.
> >
> > It's difficult for me to give you a selection of the modules and their
> > dependencies that cause the problem as there would be too many. That
> > is why I want to try to understand the issue better and produce that
> > minimal testcase. Any ideas?
> >
> > thanks
> >
> > Ross
> >
> >
>
>


-- 
Xavier Hanin - Independent Java Consultant
http://xhab.blogspot.com/
http://incubator.apache.org/ivy/
http://www.xoocode.org/

Re: NPE whilst resolving transitive configurations.

Posted by Ross Clewley <ro...@oracle.com>.
Hi

I should also say that this is with 1.4.1. I've tried with 2.0-alpha2 
and I still get the NPE. The stack this time is

java.lang.NullPointerException
        at 
org.apache.ivy.core.resolve.IvyNodeEviction$EvictionData.<init>(IvyNodeEviction.java:48)
        at 
org.apache.ivy.core.resolve.IvyNodeEviction.markEvicted(IvyNodeEviction.java:266)
        at 
org.apache.ivy.core.resolve.IvyNode.markEvicted(IvyNode.java:1101)
        at 
org.apache.ivy.core.resolve.ResolveEngine.getDependencies(ResolveEngine.java:523)
        at 
org.apache.ivy.core.resolve.ResolveEngine.resolve(ResolveEngine.java:236)
        at 
org.apache.ivy.core.resolve.ResolveEngine.resolve(ResolveEngine.java:194)
        at org.apache.ivy.Ivy.resolve(Ivy.java:256)
        at org.apache.ivy.ant.IvyResolve.doExecute(IvyResolve.java:207)
        at org.apache.ivy.ant.IvyTask.execute(IvyTask.java:281)
        at 
org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:288)
        at sun.reflect.GeneratedMethodAccessor2.invoke(Unknown Source)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:585)
        at 
org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java:105)
        at org.apache.tools.ant.Task.perform(Task.java:348)
        at org.apache.tools.ant.Target.execute(Target.java:357)
        at org.apache.tools.ant.Target.performTasks(Target.java:385)
        at 
org.apache.tools.ant.Project.executeSortedTargets(Project.java:1329)
        at org.apache.tools.ant.Project.executeTarget(Project.java:1298)
        at 
org.apache.tools.ant.helper.DefaultExecutor.executeTargets(DefaultExecutor.java:41)
        at org.apache.tools.ant.Project.executeTargets(Project.java:1181)
        at org.apache.tools.ant.Main.runBuild(Main.java:698)
        at org.apache.tools.ant.Main.startAnt(Main.java:199)
        at org.apache.tools.ant.launch.Launcher.run(Launcher.java:257)
        at org.apache.tools.ant.launch.Launcher.main(Launcher.java:104)

However, there is a slight difference in the behaviour. With 2.0-alpha2, 
if I do the resolve a second time without cleaning the cache it works. 
If I clean the cache again and do the resolve I get the NPE again. With 
1.4.1 I get it every time, regardless of whether the cache is clean or not.

regards

Ross

Ross Clewley wrote:
> Hi
>
> I need some help sorting out a NullPointerException that I'm getting 
> during resolution. The stack looks like this.
>
> java.lang.NullPointerException
>        at fr.jayasoft.ivy.IvyNode.isEvicted(IvyNode.java:367)
>        at fr.jayasoft.ivy.IvyNode.loadData(IvyNode.java:590)
>        at fr.jayasoft.ivy.Ivy.fetchDependencies(Ivy.java:1417)
>        at fr.jayasoft.ivy.Ivy.fetchDependencies(Ivy.java:1443)
>        at fr.jayasoft.ivy.Ivy.doFetchDependencies(Ivy.java:1492)
>        at fr.jayasoft.ivy.Ivy.fetchDependencies(Ivy.java:1424)
>        at fr.jayasoft.ivy.Ivy.doFetchDependencies(Ivy.java:1492)
>        at fr.jayasoft.ivy.Ivy.fetchDependencies(Ivy.java:1424)
>        at fr.jayasoft.ivy.Ivy.doFetchDependencies(Ivy.java:1492)
>        at fr.jayasoft.ivy.Ivy.fetchDependencies(Ivy.java:1433)
>        at fr.jayasoft.ivy.Ivy.doFetchDependencies(Ivy.java:1476)
>        at fr.jayasoft.ivy.Ivy.fetchDependencies(Ivy.java:1424)
>        at fr.jayasoft.ivy.Ivy.getDependencies(Ivy.java:1343)
>        at fr.jayasoft.ivy.Ivy.resolve(Ivy.java:1136)
>        at fr.jayasoft.ivy.Ivy.resolve(Ivy.java:1093)
>        at fr.jayasoft.ivy.ant.IvyResolve.execute(IvyResolve.java:167)
>
> I'd like to be able to figure out a minimal testcase to reproduce this 
> so I can log a Jira issue and also hopefully work around it. The 
> trouble is I'm having problems figuring out what that minimal testcase 
> is. The problem occurs with certain sets of dependencies and can go 
> away again when those dependencies are changed, or even when the 
> dependencies are re-ordered. I'm hoping someone may be able to give me 
> some pointers about what to look at to help nail this down a bit more 
> firmly.
>
> The problem occurs whilst resolving transitive configurations. We have 
> a build systems comprising 170 or so modules, each of which have the 
> following configurations
>
>    <conf name="default"   extends="package" transitive="true"/>
>    <conf name="compile"   extends="default" visibility="private" 
> transitive="false"/>
>    <conf name="runtime"   extends="default" visibility="public"  
> transitive="true"/>
>    <conf name="test"      extends="runtime"/>
>
> These modules declare dependencies amongst themselves or third party 
> dependencies in their own filesystem repository with Ivy files that 
> just have the default conf. Incase it's relevant the 
> defaultconfmapping used throughout is "compile->default(*);*->@(*)".
>
> It's when resolving the transitive runtime of test configurations that 
> the NPE occurs.
>
> It's difficult for me to give you a selection of the modules and their 
> dependencies that cause the problem as there would be too many. That 
> is why I want to try to understand the issue better and produce that 
> minimal testcase. Any ideas?
>
> thanks
>
> Ross
>
>