You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@river.apache.org by Peter Firmstone <ji...@zeus.net.au> on 2013/02/19 11:14:14 UTC
Test failures - concurrency bugs or Socket problems?
Before I get into the details, let me just say that I'm unable to
reproduce the test failures seen on OSX and Solaris x64 on local
hardware, I don't have access to a debugger or thread dumps.
The tests that fail on OSX and Solaris x64 (the tests pass on sparc),
are practically identical. The basic problem is discovery event's are
either not received or only some discovery events are received. The
tests allow very long time frames for these events to be received, on
other OS's these tests pass rapidly.
Increasing debugging output has the effect of increasing the number of
events received.
The tests and their details can be viewed on Jenkins.
Over the last few months I've been inspecting code manually and fixing
synchronization issues.
River has a large legacy codebase, there are many examples of inadequate
synchronization.
Ironically some of the changes I've made, although reducing test
failures on Linux and Windows has exacerbated test failures on OSX and
Solaris x64.
Is there anyone on this list with access to this hardware who can
reproduce these bugs?
Regards,
Peter.
Re: Test failures - concurrency bugs or Socket problems?
Posted by Bryan Thompson <br...@systap.com>.
Peter,
Here is the summary from the end of the run. Please let me know what else
you would like to see. I can also mail you the compressed output (1.5MB).
I assume that the test results are in the file system somewhereŠ.
Thanks,
Bryan
[java]
[java] # of tests started = 1412
[java] # of tests completed = 1412
[java] # of tests skipped = 46
[java] # of tests passed = 1364
[java] # of tests failed = 48
[java]
[java] -----------------------------------------
[java]
[java] Date finished:
[java] Wed Feb 20 07:28:52 EST 2013
[java] Time elapsed:
[java] 65079 seconds
[java]
[java] Java Result: 1
collect-result:
BUILD FAILED
/Users/bryan/Documents/workspace/river/trunk/build.xml:2093: The following
error occurred while executing this line:
/Users/bryan/Documents/workspace/river/trunk/qa/build.xml:406: The
following error occurred while executing this line:
/Users/bryan/Documents/workspace/river/trunk/qa/build.xml:380: condition
satisfied
Total time: 1089 minutes 43 seconds
Re: Test failures - concurrency bugs or Socket problems?
Posted by Peter <ji...@zeus.net.au>.
>From memory, there's not too much required to set up.
You need to set your env variable JAVA_HOME and export it, if it isn't already set.
After checking out, execute
ant qa.run
from the command line.
Hopefully that should do it.
You've got plenty of memory. If some tests fail, I'll explain how to execute individual tests with debugging enabled, then you can step through or dump thread stacks.
Thank you,
Peter.
----- Original message -----
> We have a 10.8.2 on a recent intel mini with 16G RAM. Does the test suite
> require much memory to run? If not, we also have some other machines with
> less memory and earlier OS revisions.
>
> Are there specific tests to run?
>
> Any guidance on running the test suite?
>
> Thanks,
> Bryan
>
> On 2/19/13 6:28 AM, "Peter Firmstone" <ji...@zeus.net.au> wrote:
>
> > Any chance of checking out and giving her a run?
> >
> > checkout:
> >
> > http://svn.apache.org/repos/asf/river/jtsk/skunk/qa_refactor/trunk
> >
> >
> > Be much appreciated if you can.
> >
> > Cheers,
> >
> > Peter.
> >
> >
> > On 19/02/2013 9:19 PM, Dan Creswell wrote:
> > > Mmm, well I have intel kit but all of mine is on 10.8.x, actually
> > > might be time to revise our minimum support platforms...
> > >
> > > On 19 February 2013 11:08, Peter Firmstone<ji...@zeus.net.au> wrote:
> > > > On 19/02/2013 8:27 PM, Dan Creswell wrote:
> > > > > Which variety of OS X are we talking?
> > > > OSX 10.6.8 little endian, so it's Intel arch.
> > > >
> > > > [diagnostics] System properties
> > > > [diagnostics] -------------------------------------------
> > > > [diagnostics] java.runtime.name : Java(TM) SE Runtime Environment
> > > > [diagnostics] sun.boot.library.path :
> > > > /System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Libraries
> > > > [diagnostics] java.vm.version : 20.1-b02-384
> > > > [diagnostics] awt.nativeDoubleBuffering : true
> > > > [diagnostics] ant.library.dir :
> > > >
> > > > /Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.
> > > > 8.4/lib
> > > > [diagnostics] gopherProxySet : false
> > > > [diagnostics] mrj.build : 10M3425
> > > > [diagnostics] java.vm.vendor : Apple Inc.
> > > > [diagnostics] java.vendor.url :http://www.apple.com/
> > > > [diagnostics] path.separator : :
> > > > [diagnostics] java.vm.name : Java HotSpot(TM) 64-Bit Server VM
> > > > [diagnostics] file.encoding.pkg : sun.io
> > > > [diagnostics] user.country : US
> > > > [diagnostics] sun.java.launcher : SUN_STANDARD
> > > > [diagnostics] sun.os.patch.level : unknown
> > > > [diagnostics] java.vm.specification.name : Java Virtual Machine
> > > > Specification
> > > > [diagnostics] user.dir :
> > > > /Users/hudson/hudson-slave/workspace/river-qa-refactor-osx/trunk
> > > > [diagnostics] java.runtime.version : 1.6.0_26-b03-384-10M3425
> > > > [diagnostics] java.awt.graphicsenv : apple.awt.CGraphicsEnvironment
> > > > [diagnostics] java.endorsed.dirs :
> > > >
> > > > /System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Home/lib/end
> > > > orsed
> > > > [diagnostics] os.arch : x86_64
> > > > [diagnostics] java.io.tmpdir :
> > > > /var/folders/aq/aqP130n7Eua3MGAcL598bE+++TY/-Tmp-/
> > > > [diagnostics] line.separator :
> > > > [diagnostics]
> > > > [diagnostics] java.vm.specification.vendor : Sun Microsystems Inc.
> > > > [diagnostics] os.name : Mac OS X
> > > > [diagnostics] ant.home :
> > > >
> > > > /Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.
> > > > 8.4
> > > > [diagnostics] sun.jnu.encoding : MacRoman
> > > > [diagnostics] java.library.path :
> > > >
> > > > .:/Library/Java/Extensions:/System/Library/Java/Extensions:/usr/lib/java
> > > > [diagnostics] java.specification.name : Java Platform API Specification
> > > > [diagnostics] java.class.version : 50.0
> > > > [diagnostics] sun.management.compiler : HotSpot 64-Bit Tiered Compilers
> > > > [diagnostics] os.version : 10.6.8
> > > > [diagnostics] http.nonProxyHosts :
> > > > local|*.local|169.254/16|*.169.254/16
> > > > [diagnostics] user.home : /Users/hudson
> > > > [diagnostics] user.timezone : America/Los_Angeles
> > > > [diagnostics] java.awt.printerjob : apple.awt.CPrinterJob
> > > > [diagnostics] java.specification.version : 1.6
> > > > [diagnostics] file.encoding : MacRoman
> > > > [diagnostics] user.name : hudson
> > > > [diagnostics] java.class.path :
> > > >
> > > > /Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.
> > > > 8.4/lib/ant-launcher.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.A
> > > > nt_AntInstallation/ant-1.8.4/lib/ant-antlr.jar:/Users/hudson/hudson-slav
> > > > e/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-apache-bcel.j
> > > > ar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant
> > > > -1.8.4/lib/ant-apache-bsf.jar:/Users/hudson/hudson-slave/tools/hudson.ta
> > > > sks.Ant_AntInstallation/ant-1.8.4/lib/ant-apache-log4j.jar:/Users/hudson
> > > > /hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-a
> > > > pache-oro.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInsta
> > > > llation/ant-1.8.4/lib/ant-apache-regexp.jar:/Users/hudson/hudson-slave/t
> > > > ools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-apache-resolver.
> > > > jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/an
> > > > t-1.8.4/lib/ant-apache-xalan2.jar:/Users/hudson/hudson-slave/tools/hudso
> > > > n.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-commons-logging.jar:/Users
> > > > /hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/li
> > > > b/ant-commons-net.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_
> > > > AntInstallation/ant-1.8.4/lib/ant-jai.jar:/Users/hudson/hudson-slave/too
> > > > ls/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-javamail.jar:/User
> > > > s/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/l
> > > > ib/ant-jdepend.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_Ant
> > > > Installation/ant-1.8.4/lib/ant-jmf.jar:/Users/hudson/hudson-slave/tools/
> > > > hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-jsch.jar:/Users/hudso
> > > > n/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-
> > > > junit.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallat
> > > > ion/ant-1.8.4/lib/ant-junit4.jar:/Users/hudson/hudson-slave/tools/hudson
> > > > .tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-launcher.jar:/Users/hudson/
> > > > hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-ne
> > > > trexx.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallat
> > > > ion/ant-1.8.4/lib/ant-swing.jar:/Users/hudson/hudson-slave/tools/hudson.
> > > > tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-testutil.jar:/Users/hudson/h
> > > > udson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant.jar
> > > > [diagnostics] java.vm.specification.version : 1.0
> > > > [diagnostics] sun.arch.data.model : 64
> > > > [diagnostics] java.home :
> > > > /System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Home
> > > > [diagnostics] sun.java.command : org.apache.tools.ant.launch.Launcher
> > > > -cp
> > > > hudson-qa
> > > > [diagnostics] java.specification.vendor : Sun Microsystems Inc.
> > > > [diagnostics] user.language : en
> > > > [diagnostics] awt.toolkit : apple.awt.CToolkit
> > > > [diagnostics] java.vm.info : mixed mode
> > > > [diagnostics] java.version : 1.6.0_26
> > > > [diagnostics] java.ext.dirs :
> > > >
> > > > /Library/Java/Extensions:/System/Library/Java/Extensions:/System/Library
> > > > /Java/JavaVirtualMachines/1.6.0.jdk/Contents/Home/lib/ext
> > > > [diagnostics] sun.boot.class.path :
> > > >
> > > > /System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Classes/jsfd
> > > > .jar:/System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Classes
> > > > /classes.jar:/System/Library/Frameworks/JavaVM.framework/Frameworks/Java
> > > > RuntimeSupport.framework/Resources/Java/JavaRuntimeSupport.jar:/System/L
> > > > ibrary/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Classes/ui.jar:/Syste
> > > > m/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Classes/laf.jar:/S
> > > > ystem/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Classes/sunrsa
> > > > sign.jar:/System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Cla
> > > > sses/jsse.jar:/System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Content
> > > > s/Classes/jce.jar:/System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Con
> > > > tents/Classes/charsets.jar
> > > > [diagnostics] java.vendor : Apple Inc.
> > > > [diagnostics] file.separator : /
> > > > [diagnostics] java.vendor.url.bug :http://bugreport.apple.com/
> > > > [diagnostics] sun.cpu.endian : little
> > > > [diagnostics] sun.io.unicode.encoding : UnicodeLittle
> > > > [diagnostics] mrj.version : 1060.1.6.0_26-384
> > > > [diagnostics] socksNonProxyHosts :
> > > > local|*.local|169.254/16|*.169.254/16
> > > > [diagnostics] jikes.class.path :
> > > >
> > > > :/System/Library/Frameworks/JavaVM.framework/Home/../Classes/alt-rt.jar:
> > > > /System/Library/Frameworks/JavaVM.framework/Home/../Classes/alt-string.j
> > > > ar:/System/Library/Frameworks/JavaVM.framework/Home/../Classes/charsets.
> > > > jar:/System/Library/Frameworks/JavaVM.framework/Home/../Classes/classes.
> > > > jar:/System/Library/Frameworks/JavaVM.framework/Home/../Classes/dt.jar:/
> > > > System/Library/Frameworks/JavaVM.framework/Home/../Classes/jce.jar:/Syst
> > > > em/Library/Frameworks/JavaVM.framework/Home/../Classes/jconsole.jar:/Sys
> > > > tem/Library/Frameworks/JavaVM.framework/Home/../Classes/jsse.jar:/System
> > > > /Library/Frameworks/JavaVM.framework/Home/../Classes/management-agent.ja
> > > > r:/System/Library/Frameworks/JavaVM.framework/Home/../Classes/ui.jar
> > > > [diagnostics] ftp.nonProxyHosts : local|*.local|169.254/16|*.169.254/16
> > > > [diagnostics] sun.cpu.isalist :
> > > >
> > > >
> > > >
> > > > > On 19 February 2013 10:14, Peter Firmstone<ji...@zeus.net.au> wrote:
> > > > > > Before I get into the details, let me just say that I'm unable to
> > > > > > reproduce
> > > > > > the test failures seen on OSX and Solaris x64 on local hardware, I
> > > > > > don't
> > > > > > have access to a debugger or thread dumps.
> > > > > >
> > > > > > The tests that fail on OSX and Solaris x64 (the tests pass on
> > > > > > sparc), are
> > > > > > practically identical. The basic problem is discovery event's are
> > > > > > either
> > > > > > not received or only some discovery events are received. The tests
> > > > > > allow
> > > > > > very long time frames for these events to be received, on other OS's
> > > > > > these
> > > > > > tests pass rapidly.
> > > > > >
> > > > > > Increasing debugging output has the effect of increasing the number
> > > > > > of
> > > > > > events received.
> > > > > >
> > > > > > The tests and their details can be viewed on Jenkins.
> > > > > >
> > > > > > Over the last few months I've been inspecting code manually and
> > > > > > fixing
> > > > > > synchronization issues.
> > > > > >
> > > > > > River has a large legacy codebase, there are many examples of
> > > > > > inadequate
> > > > > > synchronization.
> > > > > >
> > > > > > Ironically some of the changes I've made, although reducing test
> > > > > > failures
> > > > > > on
> > > > > > Linux and Windows has exacerbated test failures on OSX and Solaris
> > > > > > x64.
> > > > > >
> > > > > > Is there anyone on this list with access to this hardware who can
> > > > > > reproduce
> > > > > > these bugs?
> > > > > >
> > > > > > Regards,
> > > > > >
> > > > > > Peter.
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > >
> >
> >
>
Re: Test failures - concurrency bugs or Socket problems?
Posted by Bryan Thompson <br...@systap.com>.
We have a 10.8.2 on a recent intel mini with 16G RAM. Does the test suite
require much memory to run? If not, we also have some other machines with
less memory and earlier OS revisions.
Are there specific tests to run?
Any guidance on running the test suite?
Thanks,
Bryan
On 2/19/13 6:28 AM, "Peter Firmstone" <ji...@zeus.net.au> wrote:
>Any chance of checking out and giving her a run?
>
>checkout:
>
>http://svn.apache.org/repos/asf/river/jtsk/skunk/qa_refactor/trunk
>
>
>Be much appreciated if you can.
>
>Cheers,
>
>Peter.
>
>
>On 19/02/2013 9:19 PM, Dan Creswell wrote:
>> Mmm, well I have intel kit but all of mine is on 10.8.x, actually
>> might be time to revise our minimum support platforms...
>>
>> On 19 February 2013 11:08, Peter Firmstone<ji...@zeus.net.au> wrote:
>>> On 19/02/2013 8:27 PM, Dan Creswell wrote:
>>>> Which variety of OS X are we talking?
>>> OSX 10.6.8 little endian, so it's Intel arch.
>>>
>>> [diagnostics] System properties
>>> [diagnostics] -------------------------------------------
>>> [diagnostics] java.runtime.name : Java(TM) SE Runtime Environment
>>> [diagnostics] sun.boot.library.path :
>>> /System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Libraries
>>> [diagnostics] java.vm.version : 20.1-b02-384
>>> [diagnostics] awt.nativeDoubleBuffering : true
>>> [diagnostics] ant.library.dir :
>>>
>>>/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.
>>>8.4/lib
>>> [diagnostics] gopherProxySet : false
>>> [diagnostics] mrj.build : 10M3425
>>> [diagnostics] java.vm.vendor : Apple Inc.
>>> [diagnostics] java.vendor.url :http://www.apple.com/
>>> [diagnostics] path.separator : :
>>> [diagnostics] java.vm.name : Java HotSpot(TM) 64-Bit Server VM
>>> [diagnostics] file.encoding.pkg : sun.io
>>> [diagnostics] user.country : US
>>> [diagnostics] sun.java.launcher : SUN_STANDARD
>>> [diagnostics] sun.os.patch.level : unknown
>>> [diagnostics] java.vm.specification.name : Java Virtual Machine
>>> Specification
>>> [diagnostics] user.dir :
>>> /Users/hudson/hudson-slave/workspace/river-qa-refactor-osx/trunk
>>> [diagnostics] java.runtime.version : 1.6.0_26-b03-384-10M3425
>>> [diagnostics] java.awt.graphicsenv : apple.awt.CGraphicsEnvironment
>>> [diagnostics] java.endorsed.dirs :
>>>
>>>/System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Home/lib/end
>>>orsed
>>> [diagnostics] os.arch : x86_64
>>> [diagnostics] java.io.tmpdir :
>>> /var/folders/aq/aqP130n7Eua3MGAcL598bE+++TY/-Tmp-/
>>> [diagnostics] line.separator :
>>> [diagnostics]
>>> [diagnostics] java.vm.specification.vendor : Sun Microsystems Inc.
>>> [diagnostics] os.name : Mac OS X
>>> [diagnostics] ant.home :
>>>
>>>/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.
>>>8.4
>>> [diagnostics] sun.jnu.encoding : MacRoman
>>> [diagnostics] java.library.path :
>>>
>>>.:/Library/Java/Extensions:/System/Library/Java/Extensions:/usr/lib/java
>>> [diagnostics] java.specification.name : Java Platform API Specification
>>> [diagnostics] java.class.version : 50.0
>>> [diagnostics] sun.management.compiler : HotSpot 64-Bit Tiered Compilers
>>> [diagnostics] os.version : 10.6.8
>>> [diagnostics] http.nonProxyHosts :
>>>local|*.local|169.254/16|*.169.254/16
>>> [diagnostics] user.home : /Users/hudson
>>> [diagnostics] user.timezone : America/Los_Angeles
>>> [diagnostics] java.awt.printerjob : apple.awt.CPrinterJob
>>> [diagnostics] java.specification.version : 1.6
>>> [diagnostics] file.encoding : MacRoman
>>> [diagnostics] user.name : hudson
>>> [diagnostics] java.class.path :
>>>
>>>/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.
>>>8.4/lib/ant-launcher.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.A
>>>nt_AntInstallation/ant-1.8.4/lib/ant-antlr.jar:/Users/hudson/hudson-slav
>>>e/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-apache-bcel.j
>>>ar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant
>>>-1.8.4/lib/ant-apache-bsf.jar:/Users/hudson/hudson-slave/tools/hudson.ta
>>>sks.Ant_AntInstallation/ant-1.8.4/lib/ant-apache-log4j.jar:/Users/hudson
>>>/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-a
>>>pache-oro.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInsta
>>>llation/ant-1.8.4/lib/ant-apache-regexp.jar:/Users/hudson/hudson-slave/t
>>>ools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-apache-resolver.
>>>jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/an
>>>t-1.8.4/lib/ant-apache-xalan2.jar:/Users/hudson/hudson-slave/tools/hudso
>>>n.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-commons-logging.jar:/Users
>>>/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/li
>>>b/ant-commons-net.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_
>>>AntInstallation/ant-1.8.4/lib/ant-jai.jar:/Users/hudson/hudson-slave/too
>>>ls/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-javamail.jar:/User
>>>s/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/l
>>>ib/ant-jdepend.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_Ant
>>>Installation/ant-1.8.4/lib/ant-jmf.jar:/Users/hudson/hudson-slave/tools/
>>>hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-jsch.jar:/Users/hudso
>>>n/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-
>>>junit.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallat
>>>ion/ant-1.8.4/lib/ant-junit4.jar:/Users/hudson/hudson-slave/tools/hudson
>>>.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-launcher.jar:/Users/hudson/
>>>hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-ne
>>>trexx.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallat
>>>ion/ant-1.8.4/lib/ant-swing.jar:/Users/hudson/hudson-slave/tools/hudson.
>>>tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-testutil.jar:/Users/hudson/h
>>>udson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant.jar
>>> [diagnostics] java.vm.specification.version : 1.0
>>> [diagnostics] sun.arch.data.model : 64
>>> [diagnostics] java.home :
>>> /System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Home
>>> [diagnostics] sun.java.command : org.apache.tools.ant.launch.Launcher
>>>-cp
>>> hudson-qa
>>> [diagnostics] java.specification.vendor : Sun Microsystems Inc.
>>> [diagnostics] user.language : en
>>> [diagnostics] awt.toolkit : apple.awt.CToolkit
>>> [diagnostics] java.vm.info : mixed mode
>>> [diagnostics] java.version : 1.6.0_26
>>> [diagnostics] java.ext.dirs :
>>>
>>>/Library/Java/Extensions:/System/Library/Java/Extensions:/System/Library
>>>/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Home/lib/ext
>>> [diagnostics] sun.boot.class.path :
>>>
>>>/System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Classes/jsfd
>>>.jar:/System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Classes
>>>/classes.jar:/System/Library/Frameworks/JavaVM.framework/Frameworks/Java
>>>RuntimeSupport.framework/Resources/Java/JavaRuntimeSupport.jar:/System/L
>>>ibrary/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Classes/ui.jar:/Syste
>>>m/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Classes/laf.jar:/S
>>>ystem/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Classes/sunrsa
>>>sign.jar:/System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Cla
>>>sses/jsse.jar:/System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Content
>>>s/Classes/jce.jar:/System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Con
>>>tents/Classes/charsets.jar
>>> [diagnostics] java.vendor : Apple Inc.
>>> [diagnostics] file.separator : /
>>> [diagnostics] java.vendor.url.bug :http://bugreport.apple.com/
>>> [diagnostics] sun.cpu.endian : little
>>> [diagnostics] sun.io.unicode.encoding : UnicodeLittle
>>> [diagnostics] mrj.version : 1060.1.6.0_26-384
>>> [diagnostics] socksNonProxyHosts :
>>>local|*.local|169.254/16|*.169.254/16
>>> [diagnostics] jikes.class.path :
>>>
>>>:/System/Library/Frameworks/JavaVM.framework/Home/../Classes/alt-rt.jar:
>>>/System/Library/Frameworks/JavaVM.framework/Home/../Classes/alt-string.j
>>>ar:/System/Library/Frameworks/JavaVM.framework/Home/../Classes/charsets.
>>>jar:/System/Library/Frameworks/JavaVM.framework/Home/../Classes/classes.
>>>jar:/System/Library/Frameworks/JavaVM.framework/Home/../Classes/dt.jar:/
>>>System/Library/Frameworks/JavaVM.framework/Home/../Classes/jce.jar:/Syst
>>>em/Library/Frameworks/JavaVM.framework/Home/../Classes/jconsole.jar:/Sys
>>>tem/Library/Frameworks/JavaVM.framework/Home/../Classes/jsse.jar:/System
>>>/Library/Frameworks/JavaVM.framework/Home/../Classes/management-agent.ja
>>>r:/System/Library/Frameworks/JavaVM.framework/Home/../Classes/ui.jar
>>> [diagnostics] ftp.nonProxyHosts : local|*.local|169.254/16|*.169.254/16
>>> [diagnostics] sun.cpu.isalist :
>>>
>>>
>>>
>>>> On 19 February 2013 10:14, Peter Firmstone<ji...@zeus.net.au> wrote:
>>>>> Before I get into the details, let me just say that I'm unable to
>>>>> reproduce
>>>>> the test failures seen on OSX and Solaris x64 on local hardware, I
>>>>>don't
>>>>> have access to a debugger or thread dumps.
>>>>>
>>>>> The tests that fail on OSX and Solaris x64 (the tests pass on
>>>>>sparc), are
>>>>> practically identical. The basic problem is discovery event's are
>>>>>either
>>>>> not received or only some discovery events are received. The tests
>>>>> allow
>>>>> very long time frames for these events to be received, on other OS's
>>>>> these
>>>>> tests pass rapidly.
>>>>>
>>>>> Increasing debugging output has the effect of increasing the number
>>>>>of
>>>>> events received.
>>>>>
>>>>> The tests and their details can be viewed on Jenkins.
>>>>>
>>>>> Over the last few months I've been inspecting code manually and
>>>>>fixing
>>>>> synchronization issues.
>>>>>
>>>>> River has a large legacy codebase, there are many examples of
>>>>>inadequate
>>>>> synchronization.
>>>>>
>>>>> Ironically some of the changes I've made, although reducing test
>>>>>failures
>>>>> on
>>>>> Linux and Windows has exacerbated test failures on OSX and Solaris
>>>>>x64.
>>>>>
>>>>> Is there anyone on this list with access to this hardware who can
>>>>> reproduce
>>>>> these bugs?
>>>>>
>>>>> Regards,
>>>>>
>>>>> Peter.
>>>>>
>>>>>
>>>>>
>>>>>
>>>
>
>
Re: Test failures - concurrency bugs or Socket problems?
Posted by Peter Firmstone <ji...@zeus.net.au>.
Any chance of checking out and giving her a run?
checkout:
http://svn.apache.org/repos/asf/river/jtsk/skunk/qa_refactor/trunk
Be much appreciated if you can.
Cheers,
Peter.
On 19/02/2013 9:19 PM, Dan Creswell wrote:
> Mmm, well I have intel kit but all of mine is on 10.8.x, actually
> might be time to revise our minimum support platforms...
>
> On 19 February 2013 11:08, Peter Firmstone<ji...@zeus.net.au> wrote:
>> On 19/02/2013 8:27 PM, Dan Creswell wrote:
>>> Which variety of OS X are we talking?
>> OSX 10.6.8 little endian, so it's Intel arch.
>>
>> [diagnostics] System properties
>> [diagnostics] -------------------------------------------
>> [diagnostics] java.runtime.name : Java(TM) SE Runtime Environment
>> [diagnostics] sun.boot.library.path :
>> /System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Libraries
>> [diagnostics] java.vm.version : 20.1-b02-384
>> [diagnostics] awt.nativeDoubleBuffering : true
>> [diagnostics] ant.library.dir :
>> /Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib
>> [diagnostics] gopherProxySet : false
>> [diagnostics] mrj.build : 10M3425
>> [diagnostics] java.vm.vendor : Apple Inc.
>> [diagnostics] java.vendor.url :http://www.apple.com/
>> [diagnostics] path.separator : :
>> [diagnostics] java.vm.name : Java HotSpot(TM) 64-Bit Server VM
>> [diagnostics] file.encoding.pkg : sun.io
>> [diagnostics] user.country : US
>> [diagnostics] sun.java.launcher : SUN_STANDARD
>> [diagnostics] sun.os.patch.level : unknown
>> [diagnostics] java.vm.specification.name : Java Virtual Machine
>> Specification
>> [diagnostics] user.dir :
>> /Users/hudson/hudson-slave/workspace/river-qa-refactor-osx/trunk
>> [diagnostics] java.runtime.version : 1.6.0_26-b03-384-10M3425
>> [diagnostics] java.awt.graphicsenv : apple.awt.CGraphicsEnvironment
>> [diagnostics] java.endorsed.dirs :
>> /System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Home/lib/endorsed
>> [diagnostics] os.arch : x86_64
>> [diagnostics] java.io.tmpdir :
>> /var/folders/aq/aqP130n7Eua3MGAcL598bE+++TY/-Tmp-/
>> [diagnostics] line.separator :
>> [diagnostics]
>> [diagnostics] java.vm.specification.vendor : Sun Microsystems Inc.
>> [diagnostics] os.name : Mac OS X
>> [diagnostics] ant.home :
>> /Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4
>> [diagnostics] sun.jnu.encoding : MacRoman
>> [diagnostics] java.library.path :
>> .:/Library/Java/Extensions:/System/Library/Java/Extensions:/usr/lib/java
>> [diagnostics] java.specification.name : Java Platform API Specification
>> [diagnostics] java.class.version : 50.0
>> [diagnostics] sun.management.compiler : HotSpot 64-Bit Tiered Compilers
>> [diagnostics] os.version : 10.6.8
>> [diagnostics] http.nonProxyHosts : local|*.local|169.254/16|*.169.254/16
>> [diagnostics] user.home : /Users/hudson
>> [diagnostics] user.timezone : America/Los_Angeles
>> [diagnostics] java.awt.printerjob : apple.awt.CPrinterJob
>> [diagnostics] java.specification.version : 1.6
>> [diagnostics] file.encoding : MacRoman
>> [diagnostics] user.name : hudson
>> [diagnostics] java.class.path :
>> /Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-launcher.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-antlr.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-apache-bcel.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-apache-bsf.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-apache-log4j.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-apache-oro.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-apache-regexp.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-apache-resolver.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-apache-xalan2.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-commons-logging.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-commons-net.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-jai.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-javamail.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-jdepend.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-jmf.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-jsch.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-junit.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-junit4.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-launcher.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-netrexx.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-swing.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-testutil.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant.jar
>> [diagnostics] java.vm.specification.version : 1.0
>> [diagnostics] sun.arch.data.model : 64
>> [diagnostics] java.home :
>> /System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Home
>> [diagnostics] sun.java.command : org.apache.tools.ant.launch.Launcher -cp
>> hudson-qa
>> [diagnostics] java.specification.vendor : Sun Microsystems Inc.
>> [diagnostics] user.language : en
>> [diagnostics] awt.toolkit : apple.awt.CToolkit
>> [diagnostics] java.vm.info : mixed mode
>> [diagnostics] java.version : 1.6.0_26
>> [diagnostics] java.ext.dirs :
>> /Library/Java/Extensions:/System/Library/Java/Extensions:/System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Home/lib/ext
>> [diagnostics] sun.boot.class.path :
>> /System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Classes/jsfd.jar:/System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Classes/classes.jar:/System/Library/Frameworks/JavaVM.framework/Frameworks/JavaRuntimeSupport.framework/Resources/Java/JavaRuntimeSupport.jar:/System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Classes/ui.jar:/System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Classes/laf.jar:/System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Classes/sunrsasign.jar:/System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Classes/jsse.jar:/System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Classes/jce.jar:/System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Classes/charsets.jar
>> [diagnostics] java.vendor : Apple Inc.
>> [diagnostics] file.separator : /
>> [diagnostics] java.vendor.url.bug :http://bugreport.apple.com/
>> [diagnostics] sun.cpu.endian : little
>> [diagnostics] sun.io.unicode.encoding : UnicodeLittle
>> [diagnostics] mrj.version : 1060.1.6.0_26-384
>> [diagnostics] socksNonProxyHosts : local|*.local|169.254/16|*.169.254/16
>> [diagnostics] jikes.class.path :
>> :/System/Library/Frameworks/JavaVM.framework/Home/../Classes/alt-rt.jar:/System/Library/Frameworks/JavaVM.framework/Home/../Classes/alt-string.jar:/System/Library/Frameworks/JavaVM.framework/Home/../Classes/charsets.jar:/System/Library/Frameworks/JavaVM.framework/Home/../Classes/classes.jar:/System/Library/Frameworks/JavaVM.framework/Home/../Classes/dt.jar:/System/Library/Frameworks/JavaVM.framework/Home/../Classes/jce.jar:/System/Library/Frameworks/JavaVM.framework/Home/../Classes/jconsole.jar:/System/Library/Frameworks/JavaVM.framework/Home/../Classes/jsse.jar:/System/Library/Frameworks/JavaVM.framework/Home/../Classes/management-agent.jar:/System/Library/Frameworks/JavaVM.framework/Home/../Classes/ui.jar
>> [diagnostics] ftp.nonProxyHosts : local|*.local|169.254/16|*.169.254/16
>> [diagnostics] sun.cpu.isalist :
>>
>>
>>
>>> On 19 February 2013 10:14, Peter Firmstone<ji...@zeus.net.au> wrote:
>>>> Before I get into the details, let me just say that I'm unable to
>>>> reproduce
>>>> the test failures seen on OSX and Solaris x64 on local hardware, I don't
>>>> have access to a debugger or thread dumps.
>>>>
>>>> The tests that fail on OSX and Solaris x64 (the tests pass on sparc), are
>>>> practically identical. The basic problem is discovery event's are either
>>>> not received or only some discovery events are received. The tests
>>>> allow
>>>> very long time frames for these events to be received, on other OS's
>>>> these
>>>> tests pass rapidly.
>>>>
>>>> Increasing debugging output has the effect of increasing the number of
>>>> events received.
>>>>
>>>> The tests and their details can be viewed on Jenkins.
>>>>
>>>> Over the last few months I've been inspecting code manually and fixing
>>>> synchronization issues.
>>>>
>>>> River has a large legacy codebase, there are many examples of inadequate
>>>> synchronization.
>>>>
>>>> Ironically some of the changes I've made, although reducing test failures
>>>> on
>>>> Linux and Windows has exacerbated test failures on OSX and Solaris x64.
>>>>
>>>> Is there anyone on this list with access to this hardware who can
>>>> reproduce
>>>> these bugs?
>>>>
>>>> Regards,
>>>>
>>>> Peter.
>>>>
>>>>
>>>>
>>>>
>>
Re: Test failures - concurrency bugs or Socket problems?
Posted by Dan Creswell <da...@gmail.com>.
Mmm, well I have intel kit but all of mine is on 10.8.x, actually
might be time to revise our minimum support platforms...
On 19 February 2013 11:08, Peter Firmstone <ji...@zeus.net.au> wrote:
> On 19/02/2013 8:27 PM, Dan Creswell wrote:
>>
>> Which variety of OS X are we talking?
>
> OSX 10.6.8 little endian, so it's Intel arch.
>
> [diagnostics] System properties
> [diagnostics] -------------------------------------------
> [diagnostics] java.runtime.name : Java(TM) SE Runtime Environment
> [diagnostics] sun.boot.library.path :
> /System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Libraries
> [diagnostics] java.vm.version : 20.1-b02-384
> [diagnostics] awt.nativeDoubleBuffering : true
> [diagnostics] ant.library.dir :
> /Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib
> [diagnostics] gopherProxySet : false
> [diagnostics] mrj.build : 10M3425
> [diagnostics] java.vm.vendor : Apple Inc.
> [diagnostics] java.vendor.url :http://www.apple.com/
> [diagnostics] path.separator : :
> [diagnostics] java.vm.name : Java HotSpot(TM) 64-Bit Server VM
> [diagnostics] file.encoding.pkg : sun.io
> [diagnostics] user.country : US
> [diagnostics] sun.java.launcher : SUN_STANDARD
> [diagnostics] sun.os.patch.level : unknown
> [diagnostics] java.vm.specification.name : Java Virtual Machine
> Specification
> [diagnostics] user.dir :
> /Users/hudson/hudson-slave/workspace/river-qa-refactor-osx/trunk
> [diagnostics] java.runtime.version : 1.6.0_26-b03-384-10M3425
> [diagnostics] java.awt.graphicsenv : apple.awt.CGraphicsEnvironment
> [diagnostics] java.endorsed.dirs :
> /System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Home/lib/endorsed
> [diagnostics] os.arch : x86_64
> [diagnostics] java.io.tmpdir :
> /var/folders/aq/aqP130n7Eua3MGAcL598bE+++TY/-Tmp-/
> [diagnostics] line.separator :
> [diagnostics]
> [diagnostics] java.vm.specification.vendor : Sun Microsystems Inc.
> [diagnostics] os.name : Mac OS X
> [diagnostics] ant.home :
> /Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4
> [diagnostics] sun.jnu.encoding : MacRoman
> [diagnostics] java.library.path :
> .:/Library/Java/Extensions:/System/Library/Java/Extensions:/usr/lib/java
> [diagnostics] java.specification.name : Java Platform API Specification
> [diagnostics] java.class.version : 50.0
> [diagnostics] sun.management.compiler : HotSpot 64-Bit Tiered Compilers
> [diagnostics] os.version : 10.6.8
> [diagnostics] http.nonProxyHosts : local|*.local|169.254/16|*.169.254/16
> [diagnostics] user.home : /Users/hudson
> [diagnostics] user.timezone : America/Los_Angeles
> [diagnostics] java.awt.printerjob : apple.awt.CPrinterJob
> [diagnostics] java.specification.version : 1.6
> [diagnostics] file.encoding : MacRoman
> [diagnostics] user.name : hudson
> [diagnostics] java.class.path :
> /Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-launcher.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-antlr.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-apache-bcel.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-apache-bsf.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-apache-log4j.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-apache-oro.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-apache-regexp.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-apache-resolver.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-apache-xalan2.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-commons-logging.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-commons-net.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-jai.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-javamail.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-jdepend.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-jmf.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-jsch.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-junit.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-junit4.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-launcher.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-netrexx.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-swing.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-testutil.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant.jar
> [diagnostics] java.vm.specification.version : 1.0
> [diagnostics] sun.arch.data.model : 64
> [diagnostics] java.home :
> /System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Home
> [diagnostics] sun.java.command : org.apache.tools.ant.launch.Launcher -cp
> hudson-qa
> [diagnostics] java.specification.vendor : Sun Microsystems Inc.
> [diagnostics] user.language : en
> [diagnostics] awt.toolkit : apple.awt.CToolkit
> [diagnostics] java.vm.info : mixed mode
> [diagnostics] java.version : 1.6.0_26
> [diagnostics] java.ext.dirs :
> /Library/Java/Extensions:/System/Library/Java/Extensions:/System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Home/lib/ext
> [diagnostics] sun.boot.class.path :
> /System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Classes/jsfd.jar:/System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Classes/classes.jar:/System/Library/Frameworks/JavaVM.framework/Frameworks/JavaRuntimeSupport.framework/Resources/Java/JavaRuntimeSupport.jar:/System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Classes/ui.jar:/System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Classes/laf.jar:/System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Classes/sunrsasign.jar:/System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Classes/jsse.jar:/System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Classes/jce.jar:/System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Classes/charsets.jar
> [diagnostics] java.vendor : Apple Inc.
> [diagnostics] file.separator : /
> [diagnostics] java.vendor.url.bug :http://bugreport.apple.com/
> [diagnostics] sun.cpu.endian : little
> [diagnostics] sun.io.unicode.encoding : UnicodeLittle
> [diagnostics] mrj.version : 1060.1.6.0_26-384
> [diagnostics] socksNonProxyHosts : local|*.local|169.254/16|*.169.254/16
> [diagnostics] jikes.class.path :
> :/System/Library/Frameworks/JavaVM.framework/Home/../Classes/alt-rt.jar:/System/Library/Frameworks/JavaVM.framework/Home/../Classes/alt-string.jar:/System/Library/Frameworks/JavaVM.framework/Home/../Classes/charsets.jar:/System/Library/Frameworks/JavaVM.framework/Home/../Classes/classes.jar:/System/Library/Frameworks/JavaVM.framework/Home/../Classes/dt.jar:/System/Library/Frameworks/JavaVM.framework/Home/../Classes/jce.jar:/System/Library/Frameworks/JavaVM.framework/Home/../Classes/jconsole.jar:/System/Library/Frameworks/JavaVM.framework/Home/../Classes/jsse.jar:/System/Library/Frameworks/JavaVM.framework/Home/../Classes/management-agent.jar:/System/Library/Frameworks/JavaVM.framework/Home/../Classes/ui.jar
> [diagnostics] ftp.nonProxyHosts : local|*.local|169.254/16|*.169.254/16
> [diagnostics] sun.cpu.isalist :
>
>
>
>> On 19 February 2013 10:14, Peter Firmstone<ji...@zeus.net.au> wrote:
>>>
>>> Before I get into the details, let me just say that I'm unable to
>>> reproduce
>>> the test failures seen on OSX and Solaris x64 on local hardware, I don't
>>> have access to a debugger or thread dumps.
>>>
>>> The tests that fail on OSX and Solaris x64 (the tests pass on sparc), are
>>> practically identical. The basic problem is discovery event's are either
>>> not received or only some discovery events are received. The tests
>>> allow
>>> very long time frames for these events to be received, on other OS's
>>> these
>>> tests pass rapidly.
>>>
>>> Increasing debugging output has the effect of increasing the number of
>>> events received.
>>>
>>> The tests and their details can be viewed on Jenkins.
>>>
>>> Over the last few months I've been inspecting code manually and fixing
>>> synchronization issues.
>>>
>>> River has a large legacy codebase, there are many examples of inadequate
>>> synchronization.
>>>
>>> Ironically some of the changes I've made, although reducing test failures
>>> on
>>> Linux and Windows has exacerbated test failures on OSX and Solaris x64.
>>>
>>> Is there anyone on this list with access to this hardware who can
>>> reproduce
>>> these bugs?
>>>
>>> Regards,
>>>
>>> Peter.
>>>
>>>
>>>
>>>
>
>
Re: Test failures - concurrency bugs or Socket problems?
Posted by Peter Firmstone <ji...@zeus.net.au>.
On 19/02/2013 8:27 PM, Dan Creswell wrote:
> Which variety of OS X are we talking?
OSX 10.6.8 little endian, so it's Intel arch.
[diagnostics] System properties
[diagnostics] -------------------------------------------
[diagnostics] java.runtime.name : Java(TM) SE Runtime Environment
[diagnostics] sun.boot.library.path : /System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Libraries
[diagnostics] java.vm.version : 20.1-b02-384
[diagnostics] awt.nativeDoubleBuffering : true
[diagnostics] ant.library.dir : /Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib
[diagnostics] gopherProxySet : false
[diagnostics] mrj.build : 10M3425
[diagnostics] java.vm.vendor : Apple Inc.
[diagnostics] java.vendor.url :http://www.apple.com/
[diagnostics] path.separator : :
[diagnostics] java.vm.name : Java HotSpot(TM) 64-Bit Server VM
[diagnostics] file.encoding.pkg : sun.io
[diagnostics] user.country : US
[diagnostics] sun.java.launcher : SUN_STANDARD
[diagnostics] sun.os.patch.level : unknown
[diagnostics] java.vm.specification.name : Java Virtual Machine Specification
[diagnostics] user.dir : /Users/hudson/hudson-slave/workspace/river-qa-refactor-osx/trunk
[diagnostics] java.runtime.version : 1.6.0_26-b03-384-10M3425
[diagnostics] java.awt.graphicsenv : apple.awt.CGraphicsEnvironment
[diagnostics] java.endorsed.dirs : /System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Home/lib/endorsed
[diagnostics] os.arch : x86_64
[diagnostics] java.io.tmpdir : /var/folders/aq/aqP130n7Eua3MGAcL598bE+++TY/-Tmp-/
[diagnostics] line.separator :
[diagnostics]
[diagnostics] java.vm.specification.vendor : Sun Microsystems Inc.
[diagnostics] os.name : Mac OS X
[diagnostics] ant.home : /Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4
[diagnostics] sun.jnu.encoding : MacRoman
[diagnostics] java.library.path : .:/Library/Java/Extensions:/System/Library/Java/Extensions:/usr/lib/java
[diagnostics] java.specification.name : Java Platform API Specification
[diagnostics] java.class.version : 50.0
[diagnostics] sun.management.compiler : HotSpot 64-Bit Tiered Compilers
[diagnostics] os.version : 10.6.8
[diagnostics] http.nonProxyHosts : local|*.local|169.254/16|*.169.254/16
[diagnostics] user.home : /Users/hudson
[diagnostics] user.timezone : America/Los_Angeles
[diagnostics] java.awt.printerjob : apple.awt.CPrinterJob
[diagnostics] java.specification.version : 1.6
[diagnostics] file.encoding : MacRoman
[diagnostics] user.name : hudson
[diagnostics] java.class.path : /Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-launcher.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-antlr.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-apache-bcel.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-apache-bsf.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-apache-log4j.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-apache-oro.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-apache-regexp.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-apache-resolver.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-apache-xalan2.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-commons-logging.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-commons-net.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-jai.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-javamail.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-jdepend.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-jmf.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-jsch.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-junit.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-junit4.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-launcher.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-netrexx.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-swing.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-testutil.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant.jar
[diagnostics] java.vm.specification.version : 1.0
[diagnostics] sun.arch.data.model : 64
[diagnostics] java.home : /System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Home
[diagnostics] sun.java.command : org.apache.tools.ant.launch.Launcher -cp hudson-qa
[diagnostics] java.specification.vendor : Sun Microsystems Inc.
[diagnostics] user.language : en
[diagnostics] awt.toolkit : apple.awt.CToolkit
[diagnostics] java.vm.info : mixed mode
[diagnostics] java.version : 1.6.0_26
[diagnostics] java.ext.dirs : /Library/Java/Extensions:/System/Library/Java/Extensions:/System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Home/lib/ext
[diagnostics] sun.boot.class.path : /System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Classes/jsfd.jar:/System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Classes/classes.jar:/System/Library/Frameworks/JavaVM.framework/Frameworks/JavaRuntimeSupport.framework/Resources/Java/JavaRuntimeSupport.jar:/System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Classes/ui.jar:/System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Classes/laf.jar:/System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Classes/sunrsasign.jar:/System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Classes/jsse.jar:/System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Classes/jce.jar:/System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Classes/charsets.jar
[diagnostics] java.vendor : Apple Inc.
[diagnostics] file.separator : /
[diagnostics] java.vendor.url.bug :http://bugreport.apple.com/
[diagnostics] sun.cpu.endian : little
[diagnostics] sun.io.unicode.encoding : UnicodeLittle
[diagnostics] mrj.version : 1060.1.6.0_26-384
[diagnostics] socksNonProxyHosts : local|*.local|169.254/16|*.169.254/16
[diagnostics] jikes.class.path : :/System/Library/Frameworks/JavaVM.framework/Home/../Classes/alt-rt.jar:/System/Library/Frameworks/JavaVM.framework/Home/../Classes/alt-string.jar:/System/Library/Frameworks/JavaVM.framework/Home/../Classes/charsets.jar:/System/Library/Frameworks/JavaVM.framework/Home/../Classes/classes.jar:/System/Library/Frameworks/JavaVM.framework/Home/../Classes/dt.jar:/System/Library/Frameworks/JavaVM.framework/Home/../Classes/jce.jar:/System/Library/Frameworks/JavaVM.framework/Home/../Classes/jconsole.jar:/System/Library/Frameworks/JavaVM.framework/Home/../Classes/jsse.jar:/System/Library/Frameworks/JavaVM.framework/Home/../Classes/management-agent.jar:/System/Library/Frameworks/JavaVM.framework/Home/../Classes/ui.jar
[diagnostics] ftp.nonProxyHosts : local|*.local|169.254/16|*.169.254/16
[diagnostics] sun.cpu.isalist :
> On 19 February 2013 10:14, Peter Firmstone<ji...@zeus.net.au> wrote:
>> Before I get into the details, let me just say that I'm unable to reproduce
>> the test failures seen on OSX and Solaris x64 on local hardware, I don't
>> have access to a debugger or thread dumps.
>>
>> The tests that fail on OSX and Solaris x64 (the tests pass on sparc), are
>> practically identical. The basic problem is discovery event's are either
>> not received or only some discovery events are received. The tests allow
>> very long time frames for these events to be received, on other OS's these
>> tests pass rapidly.
>>
>> Increasing debugging output has the effect of increasing the number of
>> events received.
>>
>> The tests and their details can be viewed on Jenkins.
>>
>> Over the last few months I've been inspecting code manually and fixing
>> synchronization issues.
>>
>> River has a large legacy codebase, there are many examples of inadequate
>> synchronization.
>>
>> Ironically some of the changes I've made, although reducing test failures on
>> Linux and Windows has exacerbated test failures on OSX and Solaris x64.
>>
>> Is there anyone on this list with access to this hardware who can reproduce
>> these bugs?
>>
>> Regards,
>>
>> Peter.
>>
>>
>>
>>
Re: Test failures - concurrency bugs or Socket problems?
Posted by Dan Creswell <da...@gmail.com>.
Which variety of OS X are we talking?
On 19 February 2013 10:14, Peter Firmstone <ji...@zeus.net.au> wrote:
> Before I get into the details, let me just say that I'm unable to reproduce
> the test failures seen on OSX and Solaris x64 on local hardware, I don't
> have access to a debugger or thread dumps.
>
> The tests that fail on OSX and Solaris x64 (the tests pass on sparc), are
> practically identical. The basic problem is discovery event's are either
> not received or only some discovery events are received. The tests allow
> very long time frames for these events to be received, on other OS's these
> tests pass rapidly.
>
> Increasing debugging output has the effect of increasing the number of
> events received.
>
> The tests and their details can be viewed on Jenkins.
>
> Over the last few months I've been inspecting code manually and fixing
> synchronization issues.
>
> River has a large legacy codebase, there are many examples of inadequate
> synchronization.
>
> Ironically some of the changes I've made, although reducing test failures on
> Linux and Windows has exacerbated test failures on OSX and Solaris x64.
>
> Is there anyone on this list with access to this hardware who can reproduce
> these bugs?
>
> Regards,
>
> Peter.
>
>
>
>