You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@harmony.apache.org by Apache Wiki <wi...@apache.org> on 2008/01/29 11:21:53 UTC
[Harmony Wiki] Trivial Update of "Reliability Tests on DRLVM" by
AndreyYakushev
Dear Wiki user,
You have subscribed to a wiki page or wiki category on "Harmony Wiki" for change notification.
The following page has been changed by AndreyYakushev:
http://wiki.apache.org/harmony/Reliability_Tests_on_DRLVM
------------------------------------------------------------------------------
'''Here are the results of failures analysis'''
- Pass rates according to [http://people.apache.org/~mloenko/snapshot_testing/script/r612947/index.html cruise control results]:
+ Pass rates according to [http://people.apache.org/~mloenko/snapshot_testing/script/r615453/index.html cruise control results]:
||Platform ||Valid||Failed||Excluded||Failed+excluded||Pass rate||Covered by JIRA||
||Windows x86 ||86 ||12 ||10 || 22|| 75%|| 10||
- ||Linux x86 ||86 || 7 ||12 || 19|| 78%|| 15||
+ ||Linux x86 ||86 || 5 ||12 || 17|| 80%|| 15||
- ||Linux x86_64||86 || 3 ||28 || 31|| 63%|| 31||
+ ||Linux x86_64||86 || 3 ||27 || 30|| 65%|| 30||
Results for Windows x86 are very old, no valid CC run on December and January. I obtained only 3 fail in my local test run.
@@ -39, +39 @@
||12||api.text.CollationKeyTest|| [https://issues.apache.org/jira/browse/HARMONY-2752 HARMONY-2752 ], hang|| No - ICU bug||
||13||api.text.CollationKeyTest_ArrHash|| [https://issues.apache.org/jira/browse/HARMONY-2752 HARMONY-2752 ], hang|| No - ICU bug||
||14||api.text.getAvailableLocals_RBC|| [https://issues.apache.org/jira/browse/HARMONY-2742 HARMONY-2742 ], HARMONY-3224, hang|| ||
- ||15||api.text.getSentenceInstance|| [https://issues.apache.org/jira/browse/HARMONY-4215 HARMONY-4215 ], mostly reproduced on release build|| ||
- ||16||api.text.getSentenceInstance_check|| [https://issues.apache.org/jira/browse/HARMONY-62 HARMONY-62 ]|| No - ICU bug||
+ ||15||api.text.getSentenceInstance_check|| [https://issues.apache.org/jira/browse/HARMONY-62 HARMONY-62 ]|| No - ICU bug||
- ||17||vm.classloading.ClassAttributesTest|| [https://issues.apache.org/jira/browse/HARMONY-3680 HARMONY-3680 ], reproduced on release build only|| ||
+ ||16||vm.classloading.ClassAttributesTest|| [https://issues.apache.org/jira/browse/HARMONY-3680 HARMONY-3680 ], reproduced on release build only|| ||
- ||18||vm.classloading.ClassReflectionTest|| [https://issues.apache.org/jira/browse/HARMONY-3680 HARMONY-3680 ], reproduced on release build only|| ||
+ ||17||vm.classloading.ClassReflectionTest|| [https://issues.apache.org/jira/browse/HARMONY-3680 HARMONY-3680 ], reproduced on release build only|| ||
- ||19||vm.classloading.ClassUnloadingTest|| [https://issues.apache.org/jira/browse/HARMONY-2039 HARMONY-2039 ], no class unloading|| no class unloading||
+ ||18||vm.classloading.ClassUnloadingTest|| [https://issues.apache.org/jira/browse/HARMONY-2039 HARMONY-2039 ], no class unloading|| no class unloading||
- ||20||vm.classloading.MultiThreadedLoading|| [https://issues.apache.org/jira/browse/HARMONY-2039 HARMONY-2039 ], no class unloading|| no class unloading||
+ ||19||vm.classloading.MultiThreadedLoading|| [https://issues.apache.org/jira/browse/HARMONY-2039 HARMONY-2039 ], no class unloading|| no class unloading||
- ||21||vm.finalization.ArrayElemFinalizationTest|| [https://issues.apache.org/jira/browse/HARMONY-4413 HARMONY-4413 ] - test issue||test issue||
+ ||20||vm.finalization.ArrayElemFinalizationTest|| [https://issues.apache.org/jira/browse/HARMONY-4413 HARMONY-4413 ] - test issue||test issue||
- ||22||vm.stack.StackFramesRestoreTest|| [https://issues.apache.org/jira/browse/HARMONY-2039 HARMONY-2039 ], no class unloading||no class unloading||
+ ||21||vm.stack.StackFramesRestoreTest|| [https://issues.apache.org/jira/browse/HARMONY-2039 HARMONY-2039 ], no class unloading||no class unloading||
- ||23||api.kernel.hooks.AddRmPropertiesHooksTest|| [https://issues.apache.org/jira/browse/HARMONY-5172 HARMONY-5172 ], assert in debug mode||||
+ ||22||api.kernel.hooks.AddRmPropertiesHooksTest|| [https://issues.apache.org/jira/browse/HARMONY-5172 HARMONY-5172 ], assert in debug mode||||
- ||24||api.kernel.thread.VolatileVariableTest.DekkerTest|| [https://issues.apache.org/jira/browse/HARMONY-5295 HARMONY-5295 ]||intermittent hang, also sometimes failed on SUN and BEA; probably test issue||
+ ||23||api.kernel.thread.VolatileVariableTest.DekkerTest|| [https://issues.apache.org/jira/browse/HARMONY-5295 HARMONY-5295 ]||intermittent hang, also sometimes failed on SUN and BEA; probably test issue||
- ||25||api.kernel.thread.Calculation.CalcTest|| [https://issues.apache.org/jira/browse/HARMONY-5334 HARMONY-5334 ]||increased memory leak||
+ ||24||api.kernel.thread.Calculation.CalcTest|| [https://issues.apache.org/jira/browse/HARMONY-5334 HARMONY-5334 ]increased memory leak|| ||
- ||26||api.kernel.thread.ThreadArrayTest.ThreadArrayTest|| [https://issues.apache.org/jira/browse/HARMONY-5334 HARMONY-5334 ]||increased memory leak||
+ ||25||api.kernel.thread.ThreadArrayTest.ThreadArrayTest|| [https://issues.apache.org/jira/browse/HARMONY-5334 HARMONY-5334 ]increased memory leak|| ||
- ||27||api.kernel.object.ObjectFinalizeTest|| [https://issues.apache.org/jira/browse/HARMONY-5334 HARMONY-5334 ]||increased memory leak||
+ ||26||api.kernel.object.ObjectFinalizeTest|| [https://issues.apache.org/jira/browse/HARMONY-5334 HARMONY-5334 ]increased memory leak|| ||
'''Linux x86_64 reliability excluded test status'''
@@ -78, +77 @@
||18||api.kernel.thread.ThreadArrayTest.ThreadArrayTest || [https://issues.apache.org/jira/browse/HARMONY-5042 HARMONY-5042 ] 20071011 test run failure|| requires investigation||
'''Latest Linux x86 failure (regressions)'''
- ||||'''Excluded test name'''||'''Reason'''||'''Validity'''||
+ ||||'''Excluded test name'''||'''Reason'''||
- ||1||api.kernel.management.SystemResourceOrientedTest|| ||requires investigation ||
- ||2||api.kernel.object.ObjectFinalizeTest||[https://issues.apache.org/jira/browse/HARMONY-5334 HARMONY-5334] || regression ||
- ||3||api.net.DatagramTest|| ||hang; requires investigation ||
- ||4||api.net.SingleConnectTest||[https://issues.apache.org/jira/browse/HARMONY-5266 HARMONY-5266 ] ||problem similar to HttpConnectionTest||
+ ||1||api.net.SingleConnectTest||[https://issues.apache.org/jira/browse/HARMONY-5266 HARMONY-5266 ] problem similar to HttpConnectionTest||
- ||5||api.serialization.SerializableClassesTest|| ||requires investigation ||
+ ||2||api.serialization.SerializableClassesTest|| requires investigation ||
- ||6||api.util.ConcurrentTest||[https://issues.apache.org/jira/browse/HARMONY-5403 HARMONY-5403 ] || regression ||
+ ||3||api.util.ConcurrentTest||[https://issues.apache.org/jira/browse/HARMONY-5403 HARMONY-5403 ] regression ||
- ||7||vm.gc.GCTest||[https://issues.apache.org/jira/browse/HARMONY-5403 HARMONY-5403 ] || regression ||
+ ||4||api.kernel.thread.ThreadSuspendResume.ThreadSuspendResume|| requires investigation||
+ ||5||api.zip.ZlibTest|| requires investigation||
'''Latest Linux x86_64 failure (regressions)'''
- ||||'''Excluded test name'''||'''Reason'''||'''Validity'''||
+ ||||'''Excluded test name'''||'''Reason'''||
- ||1||vm.classloading.ClassCastTest|| [https://issues.apache.org/jira/browse/HARMONY-5395 HARMONY-5395 ] || regression ||
+ ||1||vm.classloading.ClassCastTest|| [https://issues.apache.org/jira/browse/HARMONY-5395 HARMONY-5395 ] regression ||
- ||1||api.util.ConcurrentTest|| [https://issues.apache.org/jira/browse/HARMONY-5403 HARMONY-5403 ] || regression ||
+ ||2||api.util.ConcurrentTest|| [https://issues.apache.org/jira/browse/HARMONY-5403 HARMONY-5403 ] regression ||
- ||1||vm.gc.GCTest|| [https://issues.apache.org/jira/browse/HARMONY-5403 HARMONY-5403 ] || regression ||
+ ||3||api.nio.channels.filechannel.FileChannelMapTest|| requires investigation||