You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@harmony.apache.org by Vladimir Ivanov <iv...@gmail.com> on 2007/02/05 08:05:52 UTC

[drlvm][testing] regression tests for DRLVM

Hello everyone,
today the run of DRLVM regression tests was added to the CC-cycle. It
works OK on SUSE Linux ia32m but failed on Windows XP with message:
run-test:
    [junit] Running org.apache.harmony.drlvm.tests.regression.h3027.AgentLibTest
    [junit] Failed to open agent library AgentLib.dll : The specified
module could not be found.
    [junit] Failed to open agent library AgentLib.dll
    [junit] Failed to initialize JVMTI.
    [junit] HMYEXEL062E Internal VM error: Failed to create Java VM
    [junit] FAILED to invoke JVM.
    [junit] Test
org.apache.harmony.drlvm.tests.regression.h3027.AgentLibTest FAILED

Note the build report "BUILD SUCCESSFUL" status in this case.

Could anybody take care about this test?

 thanks, Vladimir

Re: [drlvm][testing] regression tests for DRLVM

Posted by "Geir Magnusson Jr." <ge...@pobox.com>.
Nice.

BTW, someone pointed out somewhere that TestNG has built-in support  
for tests that are known to fail, but I'm guessing that isn't going  
to be some kind of platform scheme like we need...

geir

On Feb 8, 2007, at 5:18 AM, Alexander Kleymenov wrote:

> Hello,
>
> I've implemented the support for exclusion of regression tests.
> Please, look at this improvement within HARMONY-3136 JIRA report [1].
> As an example of exclude lists usage I've excluded regression test  
> H3027
> which fails on windows x86.
>
> You comments are welcome!
>
> Thanks,
> Alexander
>
> [1] http://issues.apache.org/jira/browse/HARMONY-3136
>    ([drlvm][testing] Regression Testing Framework lacks of exclude
> lists support)


Re: [drlvm][testing] regression tests for DRLVM

Posted by Alexander Kleymenov <kl...@gmail.com>.
Hello,

I've implemented the support for exclusion of regression tests.
Please, look at this improvement within HARMONY-3136 JIRA report [1].
As an example of exclude lists usage I've excluded regression test H3027
which fails on windows x86.

You comments are welcome!

Thanks,
Alexander

[1] http://issues.apache.org/jira/browse/HARMONY-3136
    ([drlvm][testing] Regression Testing Framework lacks of exclude
lists support)

Re: [drlvm][testing] regression tests for DRLVM

Posted by Alexander Kleymenov <kl...@gmail.com>.
Hello,

I'm working on several TODOs for regression testing framework,
and the mean for test exclusion is one of them.
I'll proceed with patches for framework after final resolution
of HARMONY-2540 issue (Regression Testing Infrastructure implementation).

Vladimir Ivanov wrote:
> Note the build report "BUILD SUCCESSFUL" status in this case.

The patch provided for this 2540 JIRA report implements proper build
reaction on unsuccessful test execution. I hope the time is coming and
we will see "BUILD FAILED" message :)

Here:
>     [exec]     [junit] vf_debug: VerifyError:
> org/apache/harmony/drlvm/tests/regression/h2808/finTest2
>     [exec]     [junit] Tests run: 1, Failures: 0, Errors: 0, Time
> elapsed: 0.232 sec

,and here:
>     [exec]     [junit] java:
> /export/cruise/trunk/cc/projects/drlvm/trunk/vm/vmcore/src/util/linux/signals_em64t.cpp:106:
> void asm_jvmti_exception_catch_callback(): Assertion `0' failed.
>     [exec]     [junit] Fatal error
>     [exec]      [echo] Running on interpreter
>     [exec]     [junit] Running
> org.apache.harmony.drlvm.tests.regression.h2926.Test
>     [exec]     [junit] Test
> org.apache.harmony.drlvm.tests.regression.h2926.Test FAILED
>     [exec]     [junit] Tests run: 1, Failures: 0, Errors: 0, Time
> elapsed: 0.857 sec

(note "Failures: 0, Errors: 0"?) I see the trace of another old and
unresolved problem - the lack of JUnit's JVM crash handling mechanism.
This issue was addressed by HARMONY-2416 report (JVM crash handling
implementation) which is also in pending state. I have started several
discussions on it but they sunk into oblivion without any attention.
I'm chanting an incantation before starting of another one :)

Thanks,
Alexander

Re: [drlvm][testing] regression tests for DRLVM

Posted by Gregory Shimansky <gs...@gmail.com>.
Hello

Some JVMTI regression tests like 2925 should not be run on x86_64. Do 
you know how to exclude them for this architecture?

Vladimir Ivanov wrote:
> For the SUSE 9 Linux x86_64 these tests also failed with message:
>     [exec] run-test:
>     [exec]     [junit] Running
> org.apache.harmony.drlvm.tests.regression.h2335.SimplestLibraryPathTest
>     [exec]     [junit] Tests run: 1, Failures: 0, Errors: 0, Time
> elapsed: 0.225 sec
>     [exec]     [junit] Running
> org.apache.harmony.drlvm.tests.regression.h2808.finTest
>     [exec]     [junit] vf_debug: verifying class
> org/apache/harmony/drlvm/tests/regression/h2808/finTest1 (method
> test()V) couldn't load class
> "org/apache/harmony/drlvm/tests/regression/h2808/finTest2"
>     [exec]     [junit] vf_debug: VerifyError:
> org/apache/harmony/drlvm/tests/regression/h2808/finTest2
>     [exec]     [junit] Tests run: 1, Failures: 0, Errors: 0, Time
> elapsed: 0.232 sec
> 
>     [exec] run-test:
>     [exec]      [echo] Running on JIT
>     [exec]     [junit] Running
> org.apache.harmony.drlvm.tests.regression.h2926.Test
>     [exec]     [junit] java:
> /export/cruise/trunk/cc/projects/drlvm/trunk/vm/vmcore/src/util/linux/signals_em64t.cpp:106: 
> 
> void asm_jvmti_exception_catch_callback(): Assertion `0' failed.
>     [exec]     [junit] Fatal error
>     [exec]      [echo] Running on interpreter
>     [exec]     [junit] Running
> org.apache.harmony.drlvm.tests.regression.h2926.Test
>     [exec]     [junit] Test
> org.apache.harmony.drlvm.tests.regression.h2926.Test FAILED
>     [exec]     [junit] Tests run: 1, Failures: 0, Errors: 0, Time
> elapsed: 0.857 sec
> 
> Thanks, Vladimir
> 
> On 2/5/07, Vladimir Ivanov <iv...@gmail.com> wrote:
>> Hello everyone,
>> today the run of DRLVM regression tests was added to the CC-cycle. It
>> works OK on SUSE Linux ia32m but failed on Windows XP with message:
>> run-test:
>>    [junit] Running 
>> org.apache.harmony.drlvm.tests.regression.h3027.AgentLibTest
>>    [junit] Failed to open agent library AgentLib.dll : The specified
>> module could not be found.
>>    [junit] Failed to open agent library AgentLib.dll
>>    [junit] Failed to initialize JVMTI.
>>    [junit] HMYEXEL062E Internal VM error: Failed to create Java VM
>>    [junit] FAILED to invoke JVM.
>>    [junit] Test
>> org.apache.harmony.drlvm.tests.regression.h3027.AgentLibTest FAILED
>>
>> Note the build report "BUILD SUCCESSFUL" status in this case.
>>
>> Could anybody take care about this test?
>>
>>  thanks, Vladimir
>>
> 


-- 
Gregory


Re: [drlvm][testing] regression tests for DRLVM

Posted by Vladimir Ivanov <iv...@gmail.com>.
For the SUSE 9 Linux x86_64 these tests also failed with message:
     [exec] run-test:
     [exec]     [junit] Running
org.apache.harmony.drlvm.tests.regression.h2335.SimplestLibraryPathTest
     [exec]     [junit] Tests run: 1, Failures: 0, Errors: 0, Time
elapsed: 0.225 sec
     [exec]     [junit] Running
org.apache.harmony.drlvm.tests.regression.h2808.finTest
     [exec]     [junit] vf_debug: verifying class
org/apache/harmony/drlvm/tests/regression/h2808/finTest1 (method
test()V) couldn't load class
"org/apache/harmony/drlvm/tests/regression/h2808/finTest2"
     [exec]     [junit] vf_debug: VerifyError:
org/apache/harmony/drlvm/tests/regression/h2808/finTest2
     [exec]     [junit] Tests run: 1, Failures: 0, Errors: 0, Time
elapsed: 0.232 sec

     [exec] run-test:
     [exec]      [echo] Running on JIT
     [exec]     [junit] Running
org.apache.harmony.drlvm.tests.regression.h2926.Test
     [exec]     [junit] java:
/export/cruise/trunk/cc/projects/drlvm/trunk/vm/vmcore/src/util/linux/signals_em64t.cpp:106:
void asm_jvmti_exception_catch_callback(): Assertion `0' failed.
     [exec]     [junit] Fatal error
     [exec]      [echo] Running on interpreter
     [exec]     [junit] Running
org.apache.harmony.drlvm.tests.regression.h2926.Test
     [exec]     [junit] Test
org.apache.harmony.drlvm.tests.regression.h2926.Test FAILED
     [exec]     [junit] Tests run: 1, Failures: 0, Errors: 0, Time
elapsed: 0.857 sec

Thanks, Vladimir

On 2/5/07, Vladimir Ivanov <iv...@gmail.com> wrote:
> Hello everyone,
> today the run of DRLVM regression tests was added to the CC-cycle. It
> works OK on SUSE Linux ia32m but failed on Windows XP with message:
> run-test:
>    [junit] Running org.apache.harmony.drlvm.tests.regression.h3027.AgentLibTest
>    [junit] Failed to open agent library AgentLib.dll : The specified
> module could not be found.
>    [junit] Failed to open agent library AgentLib.dll
>    [junit] Failed to initialize JVMTI.
>    [junit] HMYEXEL062E Internal VM error: Failed to create Java VM
>    [junit] FAILED to invoke JVM.
>    [junit] Test
> org.apache.harmony.drlvm.tests.regression.h3027.AgentLibTest FAILED
>
> Note the build report "BUILD SUCCESSFUL" status in this case.
>
> Could anybody take care about this test?
>
>  thanks, Vladimir
>