You are viewing a plain text version of this content. The canonical link for it is here.
Posted to derby-dev@db.apache.org by Ramin Moazeni <rm...@gmail.com> on 2007/05/10 21:21:17 UTC

Test Results

Hi

I've been running derby tests (derbyall) before I can send out
a fix for review. In the report, I noticed that there are 13 suites skipped
and no tests were run:
Summary results:

Test Run Started: 2007-05-09 23:44:12.0
Test Run Duration: 01:36:02

0 Tests Run
 0% Pass (0 tests passed)
 0% Fail (0 tests failed)
13 Suites skipped

Here is how I ran the tests:
java org.apache.derbyTesting.functionTests.harness.RunSuite derbyall

did I miss anything here?

Please advise...

Thanks,
Ramin

PS. I am attaching the reports with this email.

Re: Test Results

Posted by John Embretsen <Jo...@Sun.COM>.
John Embretsen wrote:

>  From the files you attached it looks to me as if the results you got 
> are as good as we could hope for :)

I mean the skipped suites, not the fact that no tests were run!
I suggest you follow the previous advice given in this thread to resolve that 
issue...

Make sure you do "ant all", and try running a single test...

-- 
John

Re: Test Results

Posted by Ramin Moazeni <rm...@gmail.com>.
Hi

I was able to run the tests without any issues after adding
jakarta-oro-2.0.8.jar to the classpath.

274 Tests Run
100% Pass (274 tests passed)
 0% Fail (0 tests failed)
9 Suites skipped

Thanks for the assistance.

Ramin
On 5/11/07, John Embretsen <Jo...@sun.com> wrote:
> Kristian Waagan wrote:
> > What happened to the embedded tests and derbynetclientmats?
>
> I believe Kathey was dead-on in the first response: Missing
> jakarta-oro-2.0.8.jar in the classpath.
>
> I tried running a legacy suite (derbytools, short duration) with the same
> classpath as Ramin and got "0 Tests Run" in the report file. The .sum file, on
> the other hand, was full of these messages:
>
> Exception in thread "main" java.lang.NoClassDefFoundError:
> org/apache/oro/text/regex/MalformedPatternException
>         at
> org.apache.derbyTesting.functionTests.harness.RunTest.main(RunTest.java:399)
>
> Adding jakarta-oro-2.0.8.jar to the classpath resolved the issue (12 tests run)
> and 100% of the tests succeeded.
>
>
> --
> John
>
>

Re: Test Results

Posted by John Embretsen <Jo...@Sun.COM>.
Kristian Waagan wrote:
> What happened to the embedded tests and derbynetclientmats?

I believe Kathey was dead-on in the first response: Missing 
jakarta-oro-2.0.8.jar in the classpath.

I tried running a legacy suite (derbytools, short duration) with the same 
classpath as Ramin and got "0 Tests Run" in the report file. The .sum file, on 
the other hand, was full of these messages:

Exception in thread "main" java.lang.NoClassDefFoundError: 
org/apache/oro/text/regex/MalformedPatternException
         at 
org.apache.derbyTesting.functionTests.harness.RunTest.main(RunTest.java:399)

Adding jakarta-oro-2.0.8.jar to the classpath resolved the issue (12 tests run) 
and 100% of the tests succeeded.


-- 
John


Re: Test Results

Posted by Kristian Waagan <Kr...@Sun.COM>.
John Embretsen wrote:
> Hi Ramin,
> 
> Ramin Moazeni wrote:
>> Hi
>>
>> I've been running derby tests (derbyall) before I can send out
>> a fix for review. In the report, I noticed that there are 13 suites 
>> skipped
>> and no tests were run:
> 
>  From the files you attached it looks to me as if the results you got 
> are as good as we could hope for :)

Not sure I understand.
What happened to the embedded tests and derbynetclientmats?

FYI, when I run derbyall now, I get around 314 tests (is being reduced 
as people move/rewrite tests to JUnit) using Java SE 6 and including the 
IBM driver. On my machine it takes around 1:45 -> 2+ hours.

Running with Java SE 5.0, I get around 307 tests (2 suites skipped).
I have not run without the IBM driver lately.

Last, just for information, derbyall is going to be gone in a "little 
while". The main test suite will be suites.All, which is a JUnit suite.



regards,
-- 
Kristian

> 
> The derbynetmats tests/suites are skipped because you don't have 
> db2jcc.jar and db2jcc_license_c.jar in your classpath. These jars are 
> optional, for testing with the so-called "DerbyNet" framework (using 
> IBM's Universal JDBC driver), so this is OK.
> 
> The jdbc40 suite is skipped in all frameworks because you are running 
> the test with a version of Java that does not support JDBC 4.0. If you 
> run the tests using Java SE 6 (JDK 6), these tests will be run as well.
> 
> This is also optional, although the more tests you run the better.
> 
> 
> 


Re: Test Results

Posted by John Embretsen <Jo...@Sun.COM>.
Hi Ramin,

Ramin Moazeni wrote:
> Hi
> 
> I've been running derby tests (derbyall) before I can send out
> a fix for review. In the report, I noticed that there are 13 suites skipped
> and no tests were run:

 From the files you attached it looks to me as if the results you got are as 
good as we could hope for :)

The derbynetmats tests/suites are skipped because you don't have db2jcc.jar and 
db2jcc_license_c.jar in your classpath. These jars are optional, for testing 
with the so-called "DerbyNet" framework (using IBM's Universal JDBC driver), so 
this is OK.

The jdbc40 suite is skipped in all frameworks because you are running the test 
with a version of Java that does not support JDBC 4.0. If you run the tests 
using Java SE 6 (JDK 6), these tests will be run as well.

This is also optional, although the more tests you run the better.



-- 
John


Re: Test Results

Posted by Myrna van Lunteren <m....@gmail.com>.
On 5/10/07, Kathey Marsden <km...@sbcglobal.net> wrote:
> Ramin Moazeni wrote:
> > In the report, I noticed that there are 13 suites skipped
> > and no tests were run:
> > Summary results:
> [snip...]
> > Java classpath:  /home/rm145956/opensource/derby/trunk/classes:/home/rm145956/opensource/derby/trunk/tools/java/junit.jar
> >
> Hi Ramin,
>
> I don't think this would cause the tests to be skipped, but  I also have
> jakarta-oro-2.0.8.jar and
> osgi.jar in my classpath. osgi is optional but I think jakarta-oro is
> required to run tests.  You can get it from
> http://jakarta.apache.org/site/downloads/downloads_oro.cgi
>
> Kathey
>
>
>
>
Actually, if jakarta-oro-2.0.8.jar is missing, but nothing else, you'd
get errors on some tests, because it's used when comparing the out
with the master files.

I would suspect that you don't actually have all classes built. The
fact that you *can* run RunSuite is contradicting though.

I wonder if more useful information might be available in
derbyall.sum? Or derbyall_diff.txt?
And what does the directory structure under derbyall look like - are
there any subdirectories?
Also, it would be interesting to verify that you have (lots of) files
under your classes/org/apache/derbyTesting/functionTests/tests/
directories...

Then, I wonder what you see if you attempt to run one test, for example,
java org.apache.derbyTesting.functionTests.harness.RunTest lang/delete.sql
?

Myrna

Re: Test Results

Posted by Kathey Marsden <km...@sbcglobal.net>.
Ramin Moazeni wrote:
> In the report, I noticed that there are 13 suites skipped
> and no tests were run:
> Summary results:
[snip...]
> Java classpath:  /home/rm145956/opensource/derby/trunk/classes:/home/rm145956/opensource/derby/trunk/tools/java/junit.jar
>   
Hi Ramin,

I don't think this would cause the tests to be skipped, but  I also have 
jakarta-oro-2.0.8.jar and
osgi.jar in my classpath. osgi is optional but I think jakarta-oro is 
required to run tests.  You can get it from 
http://jakarta.apache.org/site/downloads/downloads_oro.cgi

Kathey