You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@river.apache.org by Peter Firmstone <ji...@zeus.net.au> on 2014/01/13 14:55:02 UTC
More Stress Test Results for Outrigger
ant -f
C:\\Users\\peter\\Documents\\NetBeansProjects\\peterConcurrentPolicy
qa.run-tests
qa.run-tests:
qa.james-brown:
Deleting directory
C:\Users\peter\Documents\NetBeansProjects\peterConcurrentPolicy\qa\soul
Created dir:
C:\Users\peter\Documents\NetBeansProjects\peterConcurrentPolicy\qa\soul
Creating
C:\Users\peter\Documents\NetBeansProjects\peterConcurrentPolicy\qa\soul\soul.201401132350005517
qa.run-tests:
-----------------------------------------
CONFIGURATION FILE:
C:\Users\peter\Documents\NetBeansProjects\peterConcurrentPolicy\qa\src\com\sun\jini\test\resources\qaHarness.prop
-----------------------------------------
SETTING UP THE TEST LIST:
Adding test:
com/sun/jini/test/impl/outrigger/matching/StressTestInterleavedWithShutdown.td
-----------------------------------------
GENERAL HARNESS CONFIGURATION INFORMATION:
Date started:
Mon Jan 13 23:50:06 EST 2014
Installation directory of the JSK:
com.sun.jini.jsk.home=C:\Users\peter\Documents\NetBeansProjects\peterConcurrentPolicy
Installation directory of the harness:
com.sun.jini.qa.home=C:\Users\peter\Documents\NetBeansProjects\peterConcurrentPolicy\qa
Categories being tested:
categories=No Categories
-----------------------------------------
ENVIRONMENT PROPERTIES:
JVM information:
Java HotSpot(TM) Client VM, 24.45-b08, 32 bit VM mode
Oracle Corporation
OS information:
Windows 7, 6.1, x86
-----------------------------------------
STARTING TO RUN THE TESTS
Running
com/sun/jini/test/impl/outrigger/matching/StressTestInterleavedWithShutdown.td
Time is Mon Jan 13 23:50:07 EST 2014
Starting test in separate process with command:
'C:\Program Files\Java\jdk1.7.0_45\jre\bin\java'
-Djava.security.manager=org.apache.river.api.security.CombinerSecurityManager
-Djava.security.policy=file:/C:/Users/peter/Documents/NetBeansProjects/peterConcurrentPolicy/qa/harness/policy/defaulttest.policy
'-Djava.rmi.server.codebase=http://medusa:9082/qa1-outrigger-dl.jar
http://medusa:9082/qa1-share-dl.jar' -cp
C:\Users\peter\Documents\NetBeansProjects\peterConcurrentPolicy\qa\lib\jiniharness.jar;C:\Users\peter\Documents\NetBeansProjects\peterConcurrentPolicy\qa\lib\jinitests.jar;C:\Users\peter\Documents\NetBeansProjects\peterConcurrentPolicy\lib\jsk-platform.jar;C:\Users\peter\Documents\NetBeansProjects\peterConcurrentPolicy\lib\jsk-lib.jar;C:\Users\peter\Documents\NetBeansProjects\peterConcurrentPolicy\lib\high-scale-lib.jar;C:\Users\peter\Documents\NetBeansProjects\peterConcurrentPolicy\lib\custard-apple-1.0.3.jar
-ea -esa '-Djava.ext.dirs=C:\Program
Files\Java\jdk1.7.0_45\jre\lib\ext;C:\windows\Sun\Java\lib\ext;C:\Users\peter\Documents\NetBeansProjects\peterConcurrentPolicy\qa\lib-ext;C:\Users\peter\Documents\NetBeansProjects\peterConcurrentPolicy\lib-ext'
-Dcom.sun.jini.jsk.port=9080 -Dcom.sun.jini.qa.port=9081
-Dcom.sun.jini.jsk.home=C:\Users\peter\Documents\NetBeansProjects\peterConcurrentPolicy
-Dcom.sun.jini.qa.home=C:\Users\peter\Documents\NetBeansProjects\peterConcurrentPolicy\qa
-Dcom.sun.jini.qa.harness.harnessJar=C:\Users\peter\Documents\NetBeansProjects\peterConcurrentPolicy\qa\lib\jiniharness.jar
-Dcom.sun.jini.qa.harness.testJar=C:\Users\peter\Documents\NetBeansProjects\peterConcurrentPolicy\qa\lib\jinitests.jar
-Dcom.sun.jini.qa.harness.runjiniserver=true
-Dcom.sun.jini.qa.harness.runkitserver=true
-Djava.security.properties=file:/C:/Users/peter/Documents/NetBeansProjects/peterConcurrentPolicy/qa/harness/trust/dynamic-policy.properties
-Dcom.sun.jini.qa.harness.testhosts=
-Djava.util.logging.config.file=C:\Users\peter\Documents\NetBeansProjects\peterConcurrentPolicy\qa\src\com\sun\jini\test\resources\qa1.logging
-Djava.rmi.server.useCodebaseOnly=false
-Dcom.sun.jini.test.home=C:\Users\peter\Documents\NetBeansProjects\peterConcurrentPolicy\qa
-Dcom.sun.jini.test.port=9082
-Dcom.sun.jini.qa.harness.policies=file:/C:/Users/peter/Documents/NetBeansProjects/peterConcurrentPolicy/qa/src/com/sun/jini/test/resources/jinitest.policy
'-Djava.ext.dirs=C:\Program
Files\Java\jdk1.7.0_45\jre\lib\ext;C:\windows\Sun\Java\lib\ext;C:\Users\peter\Documents\NetBeansProjects\peterConcurrentPolicy\qa\lib-ext;C:\Users\peter\Documents\NetBeansProjects\peterConcurrentPolicy\lib-ext'
com.sun.jini.qa.harness.MasterTest
com/sun/jini/test/impl/outrigger/matching/StressTestInterleavedWithShutdown.td
TIME: 11:50:07 PM
MasterTest.doTest INFO:
============================== CALLING CONSTRUCT()
==============================
Jan 13, 2014 11:50:08 PM com.sun.jini.tool.ClassServer run
INFO: ClassServer started
[[C:\Users\peter\Documents\NetBeansProjects\peterConcurrentPolicy\qa\lib\],
port 9081]
Jan 13, 2014 11:50:08 PM com.sun.jini.tool.ClassServer run
INFO: ClassServer started
[[C:\Users\peter\Documents\NetBeansProjects\peterConcurrentPolicy\lib-dl\],
port 9080]
Jan 13, 2014 11:50:08 PM com.sun.jini.tool.ClassServer run
INFO: ClassServer started
[[C:\Users\peter\Documents\NetBeansProjects\peterConcurrentPolicy\qa\lib\],
port 9082]
MasterTest.doTest INFO:
=============================== CALLING RUN()
===============================
TIME: 11:51:34 PM
TestBase.shutdownNoSleep SEVERE: Could not call killVM for service
com.sun.jini.outrigger.ConstrainableSpaceProxy2 for
7ddc5f87-254d-42e9-bb1f-28771dc4a278 (through
Proxy[OutriggerServer,BasicInvocationHandler[BasicObjectEndpoint[33c36d5d-6614-433c-acd2-634c34fb037b,TcpEndpoint[10.18.221.63:11543]]]])
TestBase.shutdown INFO: Shutdown worked, sleeping for 10000 milliseconds...
TIME: 11:51:44 PM
TestBase.shutdown INFO: ...awake
TIME: 11:52:31 PM
MasterTest.doTest INFO:
============================ CALLING TEARDOWN()
=============================
Jan 13, 2014 11:53:08 PM com.sun.jini.tool.ClassServer terminate
INFO: ClassServer terminated [port 9080]
Jan 13, 2014 11:53:08 PM com.sun.jini.tool.ClassServer terminate
INFO: ClassServer terminated [port 9082]
Jan 13, 2014 11:53:08 PM com.sun.jini.tool.ClassServer terminate
INFO: ClassServer terminated [port 9082]
Jan 13, 2014 11:53:08 PM com.sun.jini.tool.ClassServer terminate
INFO: ClassServer terminated [port 9080]
Jan 13, 2014 11:53:08 PM com.sun.jini.tool.ClassServer terminate
INFO: ClassServer terminated [port 9081]
Jan 13, 2014 11:53:08 PM com.sun.jini.tool.ClassServer terminate
INFO: ClassServer terminated [port 9081]
TIME: 11:53:09 PM
Test process was destroyed and returned code 0
com/sun/jini/test/impl/outrigger/matching/StressTestInterleavedWithShutdown.td
Test Passed: OK
-----------------------------------------
This time, I upped the ante, 10,000 entries, 40 readers and 25 writers.
testClass=StressTestInterleavedWithShutdown
testCategories=javaspace,javaspace_impl,javaspace_impl_matching,stress
com.sun.jini.qa.harness.timeout=14400
include0=../outrigger.properties
## This test is failing on more than just Linux. I'm temporarily
## removing it from the test run for Porter beta.
#com.sun.jini.qa.harness.verifier=com.sun.jini.qa.harness.SkipLinuxTestVerifier
#com.sun.jini.qa.harness.verifier=com.sun.jini.qa.harness.SkipTestVerifier
com.sun.jini.test.share.restart_wait=10000
com.sun.jini.test.impl.outrigger.matching.StressTest.num_entries=10000
com.sun.jini.test.impl.outrigger.matching.StressTest.num_readers=40
com.sun.jini.test.impl.outrigger.matching.StressTest.num_writers=25
com.sun.jini.test.impl.outrigger.matching.StressTest.interleave=true
com.sun.jini.test.impl.outrigger.matching.tryShutdown=1
SUMMARY =================================
com/sun/jini/test/impl/outrigger/matching/StressTestInterleavedWithShutdown.td
Test Passed: OK
-----------------------------------------
# of tests started = 1
# of tests completed = 1
# of tests passed = 1
# of tests failed = 0
-----------------------------------------
Date finished:
Mon Jan 13 23:53:14 EST 2014
Time elapsed:
187 seconds
qa.collect-result:
BUILD SUCCESSFUL (total time: 3 minutes 9 seconds)
Re: More Stress Test Results for Outrigger
Posted by Peter Firmstone <ji...@zeus.net.au>.
Thanks Dawid, I'd appreciate it if you have time.
checkout https://svn.apache.org/repos/asf/river/jtsk/skunk/qa_refactor/trunk
then cd to trunk
$ vi build.properties
append the line:
run.tests=com/sun/jini/test/impl/outrigger/matching/StressTestInterleaved.td
Thanks for the feedback, that's just the sort of thing we need on river dev.
Considering a persistent Outrigger for a moment, would a JDO store that
could use Cassandra, Google Big Table, Amazon S3, MongoDB, Google
Storage et al be more interesting?
These data stores will have their cache, storage and retrieval
algorithms well sorted, there's the matter of optimisation of course,
one of the problems we have with River is the lack of access to hardware
suitable for tuning.
Outrigger could become a sub project if there was enough interest.
Regards,
Peter.
On 14/01/2014 1:29 AM, Dawid Loubser wrote:
> Hi,
>
> I might be able to help. How do I run these tests (what branch do I
> check out, etc)?
>
> For the record, an *in-memory* Outrigger has always scaled very well
> for us.
> However, *persistent* outrigger with SnapLogStore has caused us major
> problems in the past, causing us to switch to Blitz.
>
> With around 10,000 entries (approacing a total size of 3GB, these were
> very very complex object graphs) it rapidly ground to a halt, and
> became irrecoverable.
> There were probably 200 readers / writers. This was on some pretty
> decent hardware, and with this same load, Blitz has no problems
> whatsoever.
>
> kind regards,
> Dawid
>
> Op Di, 2014-01-14 om 00:24 +1000 skryf Peter Firmstone:
>> Hmm, 10,000 entries, 400 readers and 250 writers don't appear to be a
>> problem either.
>>
>> Anyone have some really decent hardware to give Outrigger a proper workout?
>>
>> Cheers,
>>
>> Peter.
Re: More Stress Test Results for Outrigger
Posted by Dawid Loubser <da...@travellinck.com>.
Hi,
I might be able to help. How do I run these tests (what branch do I
check out, etc)?
For the record, an in-memory Outrigger has always scaled very well for
us.
However, persistent outrigger with SnapLogStore has caused us major
problems in the past, causing us to switch to Blitz.
With around 10,000 entries (approacing a total size of 3GB, these were
very very complex object graphs) it rapidly ground to a halt, and became
irrecoverable.
There were probably 200 readers / writers. This was on some pretty
decent hardware, and with this same load, Blitz has no problems
whatsoever.
kind regards,
Dawid
Op Di, 2014-01-14 om 00:24 +1000 skryf Peter Firmstone:
> Hmm, 10,000 entries, 400 readers and 250 writers don't appear to be a
> problem either.
>
> Anyone have some really decent hardware to give Outrigger a proper workout?
>
> Cheers,
>
> Peter.
Re: More Stress Test Results for Outrigger
Posted by Peter Firmstone <ji...@zeus.net.au>.
Hmm, 10,000 entries, 400 readers and 250 writers don't appear to be a
problem either.
Anyone have some really decent hardware to give Outrigger a proper workout?
Cheers,
Peter.
Re: More Stress Test Results for Outrigger
Posted by Peter Firmstone <ji...@zeus.net.au>.
The original test had 1000 entries, 14 readers and 7 writers.
This test ran with 10,000 entries, 2,000 writers and 2,000 readers.
Really need someone to try this out on something with 16 or so cpu's and
32 GB memory, 100,000 entries, 20,000 readers and 20,000 writers.
How for can Outrigger scale? (qa-refactor branch in skunk).
Cheers,
Peter.
ant -f
C:\\Users\\peter\\Documents\\NetBeansProjects\\peterConcurrentPolicy
qa.run-tests
qa.run-tests:
qa.james-brown:
Deleting directory
C:\Users\peter\Documents\NetBeansProjects\peterConcurrentPolicy\qa\soul
Created dir:
C:\Users\peter\Documents\NetBeansProjects\peterConcurrentPolicy\qa\soul
Creating
C:\Users\peter\Documents\NetBeansProjects\peterConcurrentPolicy\qa\soul\soul.201401140027019377
qa.run-tests:
-----------------------------------------
CONFIGURATION FILE:
C:\Users\peter\Documents\NetBeansProjects\peterConcurrentPolicy\qa\src\com\sun\jini\test\resources\qaHarness.prop
-----------------------------------------
SETTING UP THE TEST LIST:
Adding test:
com/sun/jini/test/impl/outrigger/matching/StressTestInterleaved.td
-----------------------------------------
GENERAL HARNESS CONFIGURATION INFORMATION:
Date started:
Tue Jan 14 00:27:20 EST 2014
Installation directory of the JSK:
com.sun.jini.jsk.home=C:\Users\peter\Documents\NetBeansProjects\peterConcurrentPolicy
Installation directory of the harness:
com.sun.jini.qa.home=C:\Users\peter\Documents\NetBeansProjects\peterConcurrentPolicy\qa
Categories being tested:
categories=No Categories
-----------------------------------------
ENVIRONMENT PROPERTIES:
JVM information:
Java HotSpot(TM) Client VM, 24.45-b08, 32 bit VM mode
Oracle Corporation
OS information:
Windows 7, 6.1, x86
-----------------------------------------
STARTING TO RUN THE TESTS
Running com/sun/jini/test/impl/outrigger/matching/StressTestInterleaved.td
Time is Tue Jan 14 00:27:20 EST 2014
Starting test in separate process with command:
'C:\Program Files\Java\jdk1.7.0_45\jre\bin\java'
-Djava.security.manager=org.apache.river.api.security.CombinerSecurityManager
-Djava.security.policy=file:/C:/Users/peter/Documents/NetBeansProjects/peterConcurrentPolicy/qa/harness/policy/defaulttest.policy
'-Djava.rmi.server.codebase=http://medusa:9082/qa1-outrigger-dl.jar
http://medusa:9082/qa1-share-dl.jar' -cp
C:\Users\peter\Documents\NetBeansProjects\peterConcurrentPolicy\qa\lib\jiniharness.jar;C:\Users\peter\Documents\NetBeansProjects\peterConcurrentPolicy\qa\lib\jinitests.jar;C:\Users\peter\Documents\NetBeansProjects\peterConcurrentPolicy\lib\jsk-platform.jar;C:\Users\peter\Documents\NetBeansProjects\peterConcurrentPolicy\lib\jsk-lib.jar;C:\Users\peter\Documents\NetBeansProjects\peterConcurrentPolicy\lib\high-scale-lib.jar;C:\Users\peter\Documents\NetBeansProjects\peterConcurrentPolicy\lib\custard-apple-1.0.3.jar
-ea -esa '-Djava.ext.dirs=C:\Program
Files\Java\jdk1.7.0_45\jre\lib\ext;C:\windows\Sun\Java\lib\ext;C:\Users\peter\Documents\NetBeansProjects\peterConcurrentPolicy\qa\lib-ext;C:\Users\peter\Documents\NetBeansProjects\peterConcurrentPolicy\lib-ext'
-Dcom.sun.jini.jsk.port=9080 -Dcom.sun.jini.qa.port=9081
-Dcom.sun.jini.jsk.home=C:\Users\peter\Documents\NetBeansProjects\peterConcurrentPolicy
-Dcom.sun.jini.qa.home=C:\Users\peter\Documents\NetBeansProjects\peterConcurrentPolicy\qa
-Dcom.sun.jini.qa.harness.harnessJar=C:\Users\peter\Documents\NetBeansProjects\peterConcurrentPolicy\qa\lib\jiniharness.jar
-Dcom.sun.jini.qa.harness.testJar=C:\Users\peter\Documents\NetBeansProjects\peterConcurrentPolicy\qa\lib\jinitests.jar
-Dcom.sun.jini.qa.harness.runjiniserver=true
-Dcom.sun.jini.qa.harness.runkitserver=true
-Djava.security.properties=file:/C:/Users/peter/Documents/NetBeansProjects/peterConcurrentPolicy/qa/harness/trust/dynamic-policy.properties
-Dcom.sun.jini.qa.harness.testhosts=
-Djava.util.logging.config.file=C:\Users\peter\Documents\NetBeansProjects\peterConcurrentPolicy\qa\src\com\sun\jini\test\resources\qa1.logging
-Djava.rmi.server.useCodebaseOnly=false
-Dcom.sun.jini.test.home=C:\Users\peter\Documents\NetBeansProjects\peterConcurrentPolicy\qa
-Dcom.sun.jini.test.port=9082
-Dcom.sun.jini.qa.harness.policies=file:/C:/Users/peter/Documents/NetBeansProjects/peterConcurrentPolicy/qa/src/com/sun/jini/test/resources/jinitest.policy
'-Djava.ext.dirs=C:\Program
Files\Java\jdk1.7.0_45\jre\lib\ext;C:\windows\Sun\Java\lib\ext;C:\Users\peter\Documents\NetBeansProjects\peterConcurrentPolicy\qa\lib-ext;C:\Users\peter\Documents\NetBeansProjects\peterConcurrentPolicy\lib-ext'
com.sun.jini.qa.harness.MasterTest
com/sun/jini/test/impl/outrigger/matching/StressTestInterleaved.td
TIME: 12:27:21 AM
MasterTest.doTest INFO:
============================== CALLING CONSTRUCT()
==============================
Jan 14, 2014 12:27:21 AM com.sun.jini.tool.ClassServer run
INFO: ClassServer started
[[C:\Users\peter\Documents\NetBeansProjects\peterConcurrentPolicy\qa\lib\],
port 9081]
Jan 14, 2014 12:27:21 AM com.sun.jini.tool.ClassServer run
INFO: ClassServer started
[[C:\Users\peter\Documents\NetBeansProjects\peterConcurrentPolicy\qa\lib\],
port 9082]
Jan 14, 2014 12:27:21 AM com.sun.jini.tool.ClassServer run
INFO: ClassServer started
[[C:\Users\peter\Documents\NetBeansProjects\peterConcurrentPolicy\lib-dl\],
port 9080]
MasterTest.doTest INFO:
=============================== CALLING RUN()
===============================
TIME: 12:29:05 AM
MasterTest.doTest INFO:
============================ CALLING TEARDOWN()
=============================
Jan 14, 2014 12:29:46 AM com.sun.jini.tool.ClassServer terminate
INFO: ClassServer terminated [port 9082]
Jan 14, 2014 12:29:46 AM com.sun.jini.tool.ClassServer terminate
INFO: ClassServer terminated [port 9081]
Jan 14, 2014 12:29:46 AM com.sun.jini.tool.ClassServer terminate
INFO: ClassServer terminated [port 9082]
Jan 14, 2014 12:29:46 AM com.sun.jini.tool.ClassServer terminate
INFO: ClassServer terminated [port 9080]
Jan 14, 2014 12:29:46 AM com.sun.jini.tool.ClassServer terminate
INFO: ClassServer terminated [port 9081]
Jan 14, 2014 12:29:46 AM com.sun.jini.tool.ClassServer terminate
INFO: ClassServer terminated [port 9080]
TIME: 12:29:47 AM
Test process was destroyed and returned code 0
com/sun/jini/test/impl/outrigger/matching/StressTestInterleaved.td
Test Passed: OK
-----------------------------------------
SUMMARY =================================
com/sun/jini/test/impl/outrigger/matching/StressTestInterleaved.td
Test Passed: OK
-----------------------------------------
# of tests started = 1
# of tests completed = 1
# of tests passed = 1
# of tests failed = 0
-----------------------------------------
Date finished:
Tue Jan 14 00:29:52 EST 2014
Time elapsed:
151 seconds
qa.collect-result:
BUILD SUCCESSFUL (total time: 2 minutes 33 seconds)