You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@harmony.apache.org by Apache Wiki <wi...@apache.org> on 2008/03/04 11:44:25 UTC

[Harmony Wiki] Trivial Update of "Reliability Tests on DRLVM" by AndreyYakushev

Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Harmony Wiki" for change notification.

The following page has been changed by AndreyYakushev:
http://wiki.apache.org/harmony/Reliability_Tests_on_DRLVM

------------------------------------------------------------------------------
  
  '''Here are the results of failures analysis'''
  
- Pass rates according to [http://people.apache.org/~mloenko/snapshot_testing/script/r629320/index.html cruise control results]:
+ '''Pass rates''' according to [http://people.apache.org/~mloenko/snapshot_testing/script/r629320/index.html cruise control results]:
  
  ||Platform    ||Valid||Failed||Excluded||Failed+excluded||Pass rate||Covered by JIRA||
  ||Windows x86 ||87   || 2    ||13      ||             15||      83%||             15||
  ||Linux x86   ||87   || 3    ||13      ||             16||      82%||             16||
  ||Linux x86_64||87   || 2    ||28      ||             30||      65%||             30||
  
- Details:
+ '''Regressions'''
+ 
+ ||||'''Excluded test name'''||'''Comments'''||
+ ||1||vm.classloading.ClassCastTest|| [https://issues.apache.org/jira/browse/HARMONY-5395 HARMONY-5395 ]||
+ ||2||api.serialization.SerializableClassesTest||[https://issues.apache.org/jira/browse/HARMONY-5532 HARMONY-5532]||
+ 
+ 
+ '''Latest Windows x86 failures'''
+ ||||'''Test name'''||'''Comments'''||
+ ||1||api.net.DatagramTest||[https://issues.apache.org/jira/browse/HARMONY-5531 HARMONY-5531] ||
+ ||3||api.text.getSentenceInstance||intermittent VM crash, requires investigation||
+ 
+ '''Latest Linux x86 failures'''
+ ||||'''Test name'''||'''Comments'''||
+ ||1||api.net.SingleConnectTest||[https://issues.apache.org/jira/browse/HARMONY-5266 HARMONY-5266 ] problem similar to HttpConnectionTest||
+ ||2||api.serialization.SerializableClassesTest|| [https://issues.apache.org/jira/browse/HARMONY-5532 HARMONY-5532]||
+ ||3||api.util.ConcurrentTest||[https://issues.apache.org/jira/browse/HARMONY-5403 HARMONY-5403] regression ||
+ ||4||api.kernel.thread.ThreadSuspendResume.ThreadSuspendResume|| [https://issues.apache.org/jira/browse/HARMONY-5447 HARMONY-5447] infrequent intermittent test hang||
+ ||5||api.zip.ZlibTest|| infrequent intermittent test hang ||
+ ||6||api.kernel.management.SystemResourceOrientedTest|| [https://issues.apache.org/jira/browse/HARMONY-5533 HARMONY-5533] ||
+ ||7||api.kernel.thread.RecursiveThreadTest.RecursiveTest|| [https://issues.apache.org/jira/browse/HARMONY-5534 HARMONY-5534] ||
+ ||8||api.text.DecimalFormat_Locales|| random vm crash, requires investigation||
+ 
+ '''Latest Linux x86_64 failures'''
+ ||||'''Test name'''||'''Comments'''||
+ ||2||api.util.ConcurrentTest|| [https://issues.apache.org/jira/browse/HARMONY-5403 HARMONY-5403 ] regression ||
+ ||3||api.kernel.thread.ThreadLocalTest.ThreadLocalTest|| not reproducible||
  
  '''Common reliability excluded test status'''
  
- 
- ||'''Excluded test name'''||'''Reason'''||'''Validity'''||
+ ||'''Excluded test name'''||'''Comments'''||'''Validity'''||
  ||api.kernel.pckg.PackageGetTest|| [https://issues.apache.org/jira/browse/HARMONY-5512 HARMONY-5512]|| ||
  ||api.kernel.thread.ExcptHandlerTest.ExcptHandlerTest|| [https://issues.apache.org/jira/browse/HARMONY-5402 HARMONY-5402 ], mostly reproduced on release build||  ||
  ||api.kernel.thread.LifeSimulationTest.Life|| [https://issues.apache.org/jira/browse/HARMONY-5334 HARMONY-5334 ], memory leak||  ||
@@ -69, +94 @@

  ||17||api.kernel.exec.RunExec || [https://issues.apache.org/jira/browse/HARMONY-5042 HARMONY-5042 ] 20071011 test run failure|| requires investigation||
  ||18||api.kernel.thread.ThreadArrayTest.ThreadArrayTest || [https://issues.apache.org/jira/browse/HARMONY-5042 HARMONY-5042 ] 20071011 test run failure|| requires investigation||
  
- '''Latest Windows x86 failures'''
- ||||'''Excluded test name'''||'''Reason'''||
- ||1||api.net.DatagramTest||[https://issues.apache.org/jira/browse/HARMONY-5531 HARMONY-5531] ||
- ||2||api.serialization.SerializableClassesTest||[https://issues.apache.org/jira/browse/HARMONY-5532 HARMONY-5532]||
- ||3||api.text.getSentenceInstance||intermittent VM crash, requires investigation||
- 
- '''Latest Linux x86 failures'''
- ||||'''Excluded test name'''||'''Reason'''||
- ||1||api.net.SingleConnectTest||[https://issues.apache.org/jira/browse/HARMONY-5266 HARMONY-5266 ] problem similar to HttpConnectionTest||
- ||2||api.serialization.SerializableClassesTest|| [https://issues.apache.org/jira/browse/HARMONY-5532 HARMONY-5532]||
- ||3||api.util.ConcurrentTest||[https://issues.apache.org/jira/browse/HARMONY-5403 HARMONY-5403] regression ||
- ||4||api.kernel.thread.ThreadSuspendResume.ThreadSuspendResume|| [https://issues.apache.org/jira/browse/HARMONY-5447 HARMONY-5447] infrequent intermittent test hang||
- ||5||api.zip.ZlibTest|| infrequent intermittent test hang ||
- ||6||api.kernel.management.SystemResourceOrientedTest|| [https://issues.apache.org/jira/browse/HARMONY-5533 HARMONY-5533] ||
- ||7||api.kernel.thread.RecursiveThreadTest.RecursiveTest|| [https://issues.apache.org/jira/browse/HARMONY-5534 HARMONY-5534] ||
- ||8||api.text.DecimalFormat_Locales|| random vm crash, requires investigation||
- 
- '''Latest Linux x86_64 failures'''
- ||||'''Excluded test name'''||'''Reason'''||
- ||1||vm.classloading.ClassCastTest|| [https://issues.apache.org/jira/browse/HARMONY-5395 HARMONY-5395 ] regression ||
- ||2||api.util.ConcurrentTest|| [https://issues.apache.org/jira/browse/HARMONY-5403 HARMONY-5403 ] regression ||
- ||3||api.kernel.thread.ThreadLocalTest.ThreadLocalTest|| not reproducible||
- 
  '''List of failures occured on cruise control hosts, which was not reproduced on local run after at least 10 test run20 minutes each:'''
  
  [http://people.apache.org/~smishura/r613602/Linux_x86_64/reliability/api/text/42_DecimalFormat_Locales.html DecimalFormat_Locales]