You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@ant.apache.org by "Steve Loughran (JIRA)" <ji...@apache.org> on 2008/05/13 12:38:55 UTC

[jira] Created: (IVY-817) If DNS is playing up, Ivy takes a lot longer to sort project dependencies

If DNS is playing up, Ivy takes a lot longer to sort project dependencies
-------------------------------------------------------------------------

                 Key: IVY-817
                 URL: https://issues.apache.org/jira/browse/IVY-817
             Project: Ivy
          Issue Type: Bug
          Components: Core
    Affects Versions: 2.0.0-beta-2
         Environment: Ubuntu 8.04 with messed up DNS
            Reporter: Steve Loughran


I've just upgraded to Ubuntu 8.04, and for reasons I dont fully understand. DNS is now very patchy; long pauses before responses coming in

running at -d level, the pauses happen after printing all the pauses, finishing when the Sort dependencies response comes in
[ivy-projects] Module descriptor is processed : org.smartfrog#sf-tasks;working@k2
[ivy-projects] Module descriptor is processed : org.smartfrog#smartfrog;working@k2

//insert 30s pause here

[ivy-projects] Sort dependencies of : org.smartfrog#sf-m32;working@k2 / Number of dependencies = 9


During resolution, the delay happens after the sort

[ivy:resolve] Module descriptor is processed : org.apache.ant#ant;1.7.0
[ivy:resolve] Sort done for : org.apache.ant#ant-apache-regexp;1.7.0
[ivy:resolve] Sort dependencies of : org.apache.ant#ant-apache-resolver;1.7.0 / Number of dependencies = 3

//here is where the delay is

[ivy:resolve] Module descriptor is processed : org.apache.ant#ant;1.7.0
[ivy:resolve] Sort done for : org.apache.ant#ant-apache-resolver;1.7.0
[ivy:resolve] Sort dependencies of : org.apache.ant#ant-commons-logging;1.7.0 / Number of dependencies = 3


-I'm not sure why dns/rdns should be needed during a sort, unless remote repositories are being polled. I'm also surprised, as java caches DNS responses by default. 


-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (IVY-817) If DNS is playing up, Ivy takes a lot longer to sort project dependencies

Posted by "Nicolas Lalevée (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/IVY-817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12597372#action_12597372 ] 

Nicolas Lalevée commented on IVY-817:
-------------------------------------

Could it be a kernel config issue or bug ? maybe somehow the cpu scheduling for your hardware is stuck while trying to do some networking stuff...

> If DNS is playing up, Ivy takes a lot longer to sort project dependencies
> -------------------------------------------------------------------------
>
>                 Key: IVY-817
>                 URL: https://issues.apache.org/jira/browse/IVY-817
>             Project: Ivy
>          Issue Type: Bug
>          Components: Core
>    Affects Versions: 2.0.0-beta-2
>         Environment: Ubuntu 8.04 with messed up DNS
>            Reporter: Steve Loughran
>
> I've just upgraded to Ubuntu 8.04, and for reasons I dont fully understand. DNS is now very patchy; long pauses before responses coming in
> running at -d level, the pauses happen after printing all the pauses, finishing when the Sort dependencies response comes in
> [ivy-projects] Module descriptor is processed : org.smartfrog#sf-tasks;working@k2
> [ivy-projects] Module descriptor is processed : org.smartfrog#smartfrog;working@k2
> //insert 30s pause here
> [ivy-projects] Sort dependencies of : org.smartfrog#sf-m32;working@k2 / Number of dependencies = 9
> During resolution, the delay happens after the sort
> [ivy:resolve] Module descriptor is processed : org.apache.ant#ant;1.7.0
> [ivy:resolve] Sort done for : org.apache.ant#ant-apache-regexp;1.7.0
> [ivy:resolve] Sort dependencies of : org.apache.ant#ant-apache-resolver;1.7.0 / Number of dependencies = 3
> //here is where the delay is
> [ivy:resolve] Module descriptor is processed : org.apache.ant#ant;1.7.0
> [ivy:resolve] Sort done for : org.apache.ant#ant-apache-resolver;1.7.0
> [ivy:resolve] Sort dependencies of : org.apache.ant#ant-commons-logging;1.7.0 / Number of dependencies = 3
> -I'm not sure why dns/rdns should be needed during a sort, unless remote repositories are being polled. I'm also surprised, as java caches DNS responses by default. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (IVY-817) If DNS is playing up, Ivy takes a lot longer to sort project dependencies

Posted by "Steve Loughran (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/IVY-817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12596748#action_12596748 ] 

Steve Loughran commented on IVY-817:
------------------------------------

>What makes you think that this is the DNS lookup which is slowing down Ivy ?

That's a good question. how about

The only way to eliminate 30s pauses from every "sort" stage in my build is to turn the network card off, at which point the build suddenly returns to full speed. I can also see that things like firefox and dig are pausing in the hostname lookup -I'm assuming that is what is causing ivy to hang. 

I havent yet attached a packet sniffer to find out what is going on at the ethernet level, but that is clearly what I will have to do just to fix my home network

> If DNS is playing up, Ivy takes a lot longer to sort project dependencies
> -------------------------------------------------------------------------
>
>                 Key: IVY-817
>                 URL: https://issues.apache.org/jira/browse/IVY-817
>             Project: Ivy
>          Issue Type: Bug
>          Components: Core
>    Affects Versions: 2.0.0-beta-2
>         Environment: Ubuntu 8.04 with messed up DNS
>            Reporter: Steve Loughran
>
> I've just upgraded to Ubuntu 8.04, and for reasons I dont fully understand. DNS is now very patchy; long pauses before responses coming in
> running at -d level, the pauses happen after printing all the pauses, finishing when the Sort dependencies response comes in
> [ivy-projects] Module descriptor is processed : org.smartfrog#sf-tasks;working@k2
> [ivy-projects] Module descriptor is processed : org.smartfrog#smartfrog;working@k2
> //insert 30s pause here
> [ivy-projects] Sort dependencies of : org.smartfrog#sf-m32;working@k2 / Number of dependencies = 9
> During resolution, the delay happens after the sort
> [ivy:resolve] Module descriptor is processed : org.apache.ant#ant;1.7.0
> [ivy:resolve] Sort done for : org.apache.ant#ant-apache-regexp;1.7.0
> [ivy:resolve] Sort dependencies of : org.apache.ant#ant-apache-resolver;1.7.0 / Number of dependencies = 3
> //here is where the delay is
> [ivy:resolve] Module descriptor is processed : org.apache.ant#ant;1.7.0
> [ivy:resolve] Sort done for : org.apache.ant#ant-apache-resolver;1.7.0
> [ivy:resolve] Sort dependencies of : org.apache.ant#ant-commons-logging;1.7.0 / Number of dependencies = 3
> -I'm not sure why dns/rdns should be needed during a sort, unless remote repositories are being polled. I'm also surprised, as java caches DNS responses by default. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (IVY-817) If DNS is playing up, Ivy takes a lot longer to sort project dependencies

Posted by "Steve Loughran (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/IVY-817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12597479#action_12597479 ] 

Steve Loughran commented on IVY-817:
------------------------------------

may be related to this SmartFrog bug from february
"regression: Sf daemon longer works on my home machine due to networking changes"
http://jira.smartfrog.org/jira/browse/SFOS-697

> If DNS is playing up, Ivy takes a lot longer to sort project dependencies
> -------------------------------------------------------------------------
>
>                 Key: IVY-817
>                 URL: https://issues.apache.org/jira/browse/IVY-817
>             Project: Ivy
>          Issue Type: Bug
>          Components: Core
>    Affects Versions: 2.0.0-beta-2
>         Environment: Ubuntu 8.04 with messed up DNS
>            Reporter: Steve Loughran
>
> I've just upgraded to Ubuntu 8.04, and for reasons I dont fully understand. DNS is now very patchy; long pauses before responses coming in
> running at -d level, the pauses happen after printing all the pauses, finishing when the Sort dependencies response comes in
> [ivy-projects] Module descriptor is processed : org.smartfrog#sf-tasks;working@k2
> [ivy-projects] Module descriptor is processed : org.smartfrog#smartfrog;working@k2
> //insert 30s pause here
> [ivy-projects] Sort dependencies of : org.smartfrog#sf-m32;working@k2 / Number of dependencies = 9
> During resolution, the delay happens after the sort
> [ivy:resolve] Module descriptor is processed : org.apache.ant#ant;1.7.0
> [ivy:resolve] Sort done for : org.apache.ant#ant-apache-regexp;1.7.0
> [ivy:resolve] Sort dependencies of : org.apache.ant#ant-apache-resolver;1.7.0 / Number of dependencies = 3
> //here is where the delay is
> [ivy:resolve] Module descriptor is processed : org.apache.ant#ant;1.7.0
> [ivy:resolve] Sort done for : org.apache.ant#ant-apache-resolver;1.7.0
> [ivy:resolve] Sort dependencies of : org.apache.ant#ant-commons-logging;1.7.0 / Number of dependencies = 3
> -I'm not sure why dns/rdns should be needed during a sort, unless remote repositories are being polled. I'm also surprised, as java caches DNS responses by default. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (IVY-817) If DNS is playing up, Ivy takes a lot longer to sort project dependencies

Posted by "Maarten Coene (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/IVY-817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12597607#action_12597607 ] 

Maarten Coene commented on IVY-817:
-----------------------------------

I've made a change in SVN trunk to cache the local host name.
Could you try again to see if the situation has improved?

> If DNS is playing up, Ivy takes a lot longer to sort project dependencies
> -------------------------------------------------------------------------
>
>                 Key: IVY-817
>                 URL: https://issues.apache.org/jira/browse/IVY-817
>             Project: Ivy
>          Issue Type: Bug
>          Components: Core
>    Affects Versions: 2.0.0-beta-2
>         Environment: Ubuntu 8.04 with messed up DNS
>            Reporter: Steve Loughran
>
> I've just upgraded to Ubuntu 8.04, and for reasons I dont fully understand. DNS is now very patchy; long pauses before responses coming in
> running at -d level, the pauses happen after printing all the pauses, finishing when the Sort dependencies response comes in
> [ivy-projects] Module descriptor is processed : org.smartfrog#sf-tasks;working@k2
> [ivy-projects] Module descriptor is processed : org.smartfrog#smartfrog;working@k2
> //insert 30s pause here
> [ivy-projects] Sort dependencies of : org.smartfrog#sf-m32;working@k2 / Number of dependencies = 9
> During resolution, the delay happens after the sort
> [ivy:resolve] Module descriptor is processed : org.apache.ant#ant;1.7.0
> [ivy:resolve] Sort done for : org.apache.ant#ant-apache-regexp;1.7.0
> [ivy:resolve] Sort dependencies of : org.apache.ant#ant-apache-resolver;1.7.0 / Number of dependencies = 3
> //here is where the delay is
> [ivy:resolve] Module descriptor is processed : org.apache.ant#ant;1.7.0
> [ivy:resolve] Sort done for : org.apache.ant#ant-apache-resolver;1.7.0
> [ivy:resolve] Sort dependencies of : org.apache.ant#ant-commons-logging;1.7.0 / Number of dependencies = 3
> -I'm not sure why dns/rdns should be needed during a sort, unless remote repositories are being polled. I'm also surprised, as java caches DNS responses by default. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (IVY-817) If DNS is playing up, Ivy takes a lot longer to sort project dependencies

Posted by "Gilles Scokart (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/IVY-817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12597242#action_12597242 ] 

Gilles Scokart commented on IVY-817:
------------------------------------

It is pretty strange, indeed...  The sort operation is a pure memory operation.  All the module descriptors are alreay loaded.  The only IO I see are the traces.

I'm wondering if it is not the entire jvm that is frozen.

If you still have your broken DNS, you can may be try to generate a thread dump when the build is hanging.  It could indicates what happen in the sort, but also in the other threads

> If DNS is playing up, Ivy takes a lot longer to sort project dependencies
> -------------------------------------------------------------------------
>
>                 Key: IVY-817
>                 URL: https://issues.apache.org/jira/browse/IVY-817
>             Project: Ivy
>          Issue Type: Bug
>          Components: Core
>    Affects Versions: 2.0.0-beta-2
>         Environment: Ubuntu 8.04 with messed up DNS
>            Reporter: Steve Loughran
>
> I've just upgraded to Ubuntu 8.04, and for reasons I dont fully understand. DNS is now very patchy; long pauses before responses coming in
> running at -d level, the pauses happen after printing all the pauses, finishing when the Sort dependencies response comes in
> [ivy-projects] Module descriptor is processed : org.smartfrog#sf-tasks;working@k2
> [ivy-projects] Module descriptor is processed : org.smartfrog#smartfrog;working@k2
> //insert 30s pause here
> [ivy-projects] Sort dependencies of : org.smartfrog#sf-m32;working@k2 / Number of dependencies = 9
> During resolution, the delay happens after the sort
> [ivy:resolve] Module descriptor is processed : org.apache.ant#ant;1.7.0
> [ivy:resolve] Sort done for : org.apache.ant#ant-apache-regexp;1.7.0
> [ivy:resolve] Sort dependencies of : org.apache.ant#ant-apache-resolver;1.7.0 / Number of dependencies = 3
> //here is where the delay is
> [ivy:resolve] Module descriptor is processed : org.apache.ant#ant;1.7.0
> [ivy:resolve] Sort done for : org.apache.ant#ant-apache-resolver;1.7.0
> [ivy:resolve] Sort dependencies of : org.apache.ant#ant-commons-logging;1.7.0 / Number of dependencies = 3
> -I'm not sure why dns/rdns should be needed during a sort, unless remote repositories are being polled. I'm also surprised, as java caches DNS responses by default. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Resolved: (IVY-817) If DNS is playing up, Ivy takes a lot longer to sort project dependencies

Posted by "Steve Loughran (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/IVY-817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Steve Loughran resolved IVY-817.
--------------------------------

       Resolution: Fixed
    Fix Version/s: 2.0-RC1

This is fixed in SVN head...there may be a delay in the first sort, but after that it flies. 

BUILD SUCCESSFUL - at 19/05/08 18:35
Total time: 2 minutes 30 seconds

Caching may even provide a slight speedup for everyone, if the JDK is recalculating the hostname every time it is asked.

> If DNS is playing up, Ivy takes a lot longer to sort project dependencies
> -------------------------------------------------------------------------
>
>                 Key: IVY-817
>                 URL: https://issues.apache.org/jira/browse/IVY-817
>             Project: Ivy
>          Issue Type: Bug
>          Components: Core
>    Affects Versions: 2.0.0-beta-2
>         Environment: Ubuntu 8.04 with messed up DNS
>            Reporter: Steve Loughran
>             Fix For: 2.0-RC1
>
>
> I've just upgraded to Ubuntu 8.04, and for reasons I dont fully understand. DNS is now very patchy; long pauses before responses coming in
> running at -d level, the pauses happen after printing all the pauses, finishing when the Sort dependencies response comes in
> [ivy-projects] Module descriptor is processed : org.smartfrog#sf-tasks;working@k2
> [ivy-projects] Module descriptor is processed : org.smartfrog#smartfrog;working@k2
> //insert 30s pause here
> [ivy-projects] Sort dependencies of : org.smartfrog#sf-m32;working@k2 / Number of dependencies = 9
> During resolution, the delay happens after the sort
> [ivy:resolve] Module descriptor is processed : org.apache.ant#ant;1.7.0
> [ivy:resolve] Sort done for : org.apache.ant#ant-apache-regexp;1.7.0
> [ivy:resolve] Sort dependencies of : org.apache.ant#ant-apache-resolver;1.7.0 / Number of dependencies = 3
> //here is where the delay is
> [ivy:resolve] Module descriptor is processed : org.apache.ant#ant;1.7.0
> [ivy:resolve] Sort done for : org.apache.ant#ant-apache-resolver;1.7.0
> [ivy:resolve] Sort dependencies of : org.apache.ant#ant-commons-logging;1.7.0 / Number of dependencies = 3
> -I'm not sure why dns/rdns should be needed during a sort, unless remote repositories are being polled. I'm also surprised, as java caches DNS responses by default. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (IVY-817) If DNS is playing up, Ivy takes a lot longer to sort project dependencies

Posted by "Steve Loughran (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/IVY-817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12597478#action_12597478 ] 

Steve Loughran commented on IVY-817:
------------------------------------

I have a stack trace, I was right, it really is DNS.

[ivy:resolve] == resolving dependencies org.smartfrog#sf-loggingservices;latest.integration->org.smartfrog#smartfrog;latest.integration [runtime->services-master]
2008-05-16 14:36:23
Full thread dump Java HotSpot(TM) Client VM (10.0-b22 mixed mode, sharing):

"Low Memory Detector" daemon prio=10 tid=0x08097000 nid=0x1ddf runnable [0x00000000..0x00000000]
   java.lang.Thread.State: RUNNABLE

"CompilerThread0" daemon prio=10 tid=0x0808c400 nid=0x1dde waiting on condition [0x00000000..0xb5a29a78]
   java.lang.Thread.State: RUNNABLE

"Signal Dispatcher" daemon prio=10 tid=0x0808b000 nid=0x1ddd waiting on condition [0x00000000..0x00000000]
   java.lang.Thread.State: RUNNABLE

"Finalizer" daemon prio=10 tid=0x08081c00 nid=0x1ddc in Object.wait() [0xb5b11000..0xb5b11ec0]
   java.lang.Thread.State: WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	- waiting on <0x8c4d2e60> (a java.lang.ref.ReferenceQueue$Lock)
	at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:116)
	- locked <0x8c4d2e60> (a java.lang.ref.ReferenceQueue$Lock)
	at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:132)
	at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:159)

"Reference Handler" daemon prio=10 tid=0x08080c00 nid=0x1ddb in Object.wait() [0xb5b62000..0xb5b62e40]
   java.lang.Thread.State: WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	- waiting on <0x8c4d2ee8> (a java.lang.ref.Reference$Lock)
	at java.lang.Object.wait(Object.java:485)
	at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:116)
	- locked <0x8c4d2ee8> (a java.lang.ref.Reference$Lock)

"main" prio=10 tid=0x08058c00 nid=0x1dd9 runnable [0xb7dc1000..0xb7dc2218]
   java.lang.Thread.State: RUNNABLE
	at java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method)
	at java.net.InetAddress$1.lookupAllHostAddr(InetAddress.java:849)
	at java.net.InetAddress.getAddressFromNameService(InetAddress.java:1200)
	at java.net.InetAddress.getLocalHost(InetAddress.java:1350)
	at org.apache.ivy.util.HostUtil.getLocalHostName(HostUtil.java:42)
	at org.apache.ivy.Ivy.getWorkingRevision(Ivy.java:808)
	at org.apache.ivy.core.sort.ModuleInSort.match(ModuleInSort.java:180)
	at org.apache.ivy.core.sort.CollectionOfModulesToSort.getModuleDescriptorDependency(CollectionOfModulesToSort.java:103)
	at org.apache.ivy.core.sort.ModuleDescriptorSorter.sortModuleDescriptorsHelp(ModuleDescriptorSorter.java:97)
	at org.apache.ivy.core.sort.ModuleDescriptorSorter.sortModuleDescriptors(ModuleDescriptorSorter.java:66)
	at org.apache.ivy.core.sort.SortEngine.sortModuleDescriptors(SortEngine.java:106)
	at org.apache.ivy.core.sort.SortEngine.sortNodes(SortEngine.java:69)
	at org.apache.ivy.core.resolve.ResolveEngine.getDependencies(ResolveEngine.java:522)
	at org.apache.ivy.core.resolve.ResolveEngine.resolve(ResolveEngine.java:233)
	at org.apache.ivy.core.resolve.ResolveEngine.resolve(ResolveEngine.java:191)
	at org.apache.ivy.Ivy.resolve(Ivy.java:506)
	at org.apache.ivy.ant.IvyResolve.doExecute(IvyResolve.java:230)
	at org.apache.ivy.ant.IvyTask.execute(IvyTask.java:275)
	at org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:288)
	at sun.reflect.GeneratedMethodAccessor4.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java:106)
	at org.apache.tools.ant.Task.perform(Task.java:348)
	at org.apache.tools.ant.Target.execute(Target.java:354)
	at org.apache.tools.ant.Target.performTasks(Target.java:379)
	at org.apache.tools.ant.Project.executeSortedTargets(Project.java:1324)
	at org.apache.tools.ant.Project.executeTarget(Project.java:1293)
	at org.apache.tools.ant.helper.DefaultExecutor.executeTargets(DefaultExecutor.java:41)
	at org.apache.tools.ant.Project.executeTargets(Project.java:1176)
	at org.apache.tools.ant.Main.runBuild(Main.java:758)
	at org.apache.tools.ant.Main.startAnt(Main.java:217)
	at org.apache.tools.ant.launch.Launcher.run(Launcher.java:257)
	at org.apache.tools.ant.launch.Launcher.main(Launcher.java:104)

"VM Thread" prio=10 tid=0x0807f400 nid=0x1dda runnable 

"VM Periodic Task Thread" prio=10 tid=0x080aa800 nid=0x1de0 waiting on condition 

JNI global references: 991

Heap
 def new generation   total 960K, used 793K [0x8bfd0000, 0x8c0d0000, 0x8c4b0000)
  eden space 896K,  83% used [0x8bfd0000, 0x8c089f60, 0x8c0b0000)
  from space 64K,  77% used [0x8c0b0000, 0x8c0bc658, 0x8c0c0000)
  to   space 64K,   0% used [0x8c0c0000, 0x8c0c0000, 0x8c0d0000)
 tenured generation   total 4096K, used 3746K [0x8c4b0000, 0x8c8b0000, 0x8ffd0000)
   the space 4096K,  91% used [0x8c4b0000, 0x8c858898, 0x8c858a00, 0x8c8b0000)
 compacting perm gen  total 12288K, used 4757K [0x8ffd0000, 0x90bd0000, 0x93fd0000)
   the space 12288K,  38% used [0x8ffd0000, 0x90475598, 0x90475600, 0x90bd0000)
    ro space 8192K,  73% used [0x93fd0000, 0x945b34a0, 0x945b3600, 0x947d0000)
    rw space 12288K,  58% used [0x947d0000, 0x94ec8668, 0x94ec8800, 0x953d0000)

Its in looking up the local host address. Clearly the networking is in trouble, and this is a good time for a system rebuild. But 
(a) do you have to look up the hostname
(b) can you cache it?

In SmartFrog we cache it, and we even handle a failure of lookup to resolve any hostname


            try {
                //this can still do a network reverse DNS lookup, and hence fail
                hostInetAddress = InetAddress.getLocalHost();
            } catch (UnknownHostException e) {
                //no, nothing there either
                hostInetAddress = InetAddress.getByName(null);

            }






> If DNS is playing up, Ivy takes a lot longer to sort project dependencies
> -------------------------------------------------------------------------
>
>                 Key: IVY-817
>                 URL: https://issues.apache.org/jira/browse/IVY-817
>             Project: Ivy
>          Issue Type: Bug
>          Components: Core
>    Affects Versions: 2.0.0-beta-2
>         Environment: Ubuntu 8.04 with messed up DNS
>            Reporter: Steve Loughran
>
> I've just upgraded to Ubuntu 8.04, and for reasons I dont fully understand. DNS is now very patchy; long pauses before responses coming in
> running at -d level, the pauses happen after printing all the pauses, finishing when the Sort dependencies response comes in
> [ivy-projects] Module descriptor is processed : org.smartfrog#sf-tasks;working@k2
> [ivy-projects] Module descriptor is processed : org.smartfrog#smartfrog;working@k2
> //insert 30s pause here
> [ivy-projects] Sort dependencies of : org.smartfrog#sf-m32;working@k2 / Number of dependencies = 9
> During resolution, the delay happens after the sort
> [ivy:resolve] Module descriptor is processed : org.apache.ant#ant;1.7.0
> [ivy:resolve] Sort done for : org.apache.ant#ant-apache-regexp;1.7.0
> [ivy:resolve] Sort dependencies of : org.apache.ant#ant-apache-resolver;1.7.0 / Number of dependencies = 3
> //here is where the delay is
> [ivy:resolve] Module descriptor is processed : org.apache.ant#ant;1.7.0
> [ivy:resolve] Sort done for : org.apache.ant#ant-apache-resolver;1.7.0
> [ivy:resolve] Sort dependencies of : org.apache.ant#ant-commons-logging;1.7.0 / Number of dependencies = 3
> -I'm not sure why dns/rdns should be needed during a sort, unless remote repositories are being polled. I'm also surprised, as java caches DNS responses by default. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (IVY-817) If DNS is playing up, Ivy takes a lot longer to sort project dependencies

Posted by "Steve Loughran (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/IVY-817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12597399#action_12597399 ] 

Steve Loughran commented on IVY-817:
------------------------------------

1. it may be something just after the sort, some check of the repository list -just something that doesnt get printed out. For all I know, it could be the java5/6 proxy stuff trying reverse-dns when a URL gets created; I remember some bugrep on that subject once.

2. No, I havent fixed my machine yet. I will go for a thread dump and see where we are. I will leave the machine broken until we've got this bug fixed. 

> If DNS is playing up, Ivy takes a lot longer to sort project dependencies
> -------------------------------------------------------------------------
>
>                 Key: IVY-817
>                 URL: https://issues.apache.org/jira/browse/IVY-817
>             Project: Ivy
>          Issue Type: Bug
>          Components: Core
>    Affects Versions: 2.0.0-beta-2
>         Environment: Ubuntu 8.04 with messed up DNS
>            Reporter: Steve Loughran
>
> I've just upgraded to Ubuntu 8.04, and for reasons I dont fully understand. DNS is now very patchy; long pauses before responses coming in
> running at -d level, the pauses happen after printing all the pauses, finishing when the Sort dependencies response comes in
> [ivy-projects] Module descriptor is processed : org.smartfrog#sf-tasks;working@k2
> [ivy-projects] Module descriptor is processed : org.smartfrog#smartfrog;working@k2
> //insert 30s pause here
> [ivy-projects] Sort dependencies of : org.smartfrog#sf-m32;working@k2 / Number of dependencies = 9
> During resolution, the delay happens after the sort
> [ivy:resolve] Module descriptor is processed : org.apache.ant#ant;1.7.0
> [ivy:resolve] Sort done for : org.apache.ant#ant-apache-regexp;1.7.0
> [ivy:resolve] Sort dependencies of : org.apache.ant#ant-apache-resolver;1.7.0 / Number of dependencies = 3
> //here is where the delay is
> [ivy:resolve] Module descriptor is processed : org.apache.ant#ant;1.7.0
> [ivy:resolve] Sort done for : org.apache.ant#ant-apache-resolver;1.7.0
> [ivy:resolve] Sort dependencies of : org.apache.ant#ant-commons-logging;1.7.0 / Number of dependencies = 3
> -I'm not sure why dns/rdns should be needed during a sort, unless remote repositories are being polled. I'm also surprised, as java caches DNS responses by default. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (IVY-817) If DNS is playing up, Ivy takes a lot longer to sort project dependencies

Posted by "Nicolas Lalevée (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/IVY-817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12596356#action_12596356 ] 

Nicolas Lalevée commented on IVY-817:
-------------------------------------

What makes you think that this is the DNS lookup which is slowing down Ivy ?

> If DNS is playing up, Ivy takes a lot longer to sort project dependencies
> -------------------------------------------------------------------------
>
>                 Key: IVY-817
>                 URL: https://issues.apache.org/jira/browse/IVY-817
>             Project: Ivy
>          Issue Type: Bug
>          Components: Core
>    Affects Versions: 2.0.0-beta-2
>         Environment: Ubuntu 8.04 with messed up DNS
>            Reporter: Steve Loughran
>
> I've just upgraded to Ubuntu 8.04, and for reasons I dont fully understand. DNS is now very patchy; long pauses before responses coming in
> running at -d level, the pauses happen after printing all the pauses, finishing when the Sort dependencies response comes in
> [ivy-projects] Module descriptor is processed : org.smartfrog#sf-tasks;working@k2
> [ivy-projects] Module descriptor is processed : org.smartfrog#smartfrog;working@k2
> //insert 30s pause here
> [ivy-projects] Sort dependencies of : org.smartfrog#sf-m32;working@k2 / Number of dependencies = 9
> During resolution, the delay happens after the sort
> [ivy:resolve] Module descriptor is processed : org.apache.ant#ant;1.7.0
> [ivy:resolve] Sort done for : org.apache.ant#ant-apache-regexp;1.7.0
> [ivy:resolve] Sort dependencies of : org.apache.ant#ant-apache-resolver;1.7.0 / Number of dependencies = 3
> //here is where the delay is
> [ivy:resolve] Module descriptor is processed : org.apache.ant#ant;1.7.0
> [ivy:resolve] Sort done for : org.apache.ant#ant-apache-resolver;1.7.0
> [ivy:resolve] Sort dependencies of : org.apache.ant#ant-commons-logging;1.7.0 / Number of dependencies = 3
> -I'm not sure why dns/rdns should be needed during a sort, unless remote repositories are being polled. I'm also surprised, as java caches DNS responses by default. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.