You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@harmony.apache.org by "Geir Magnusson Jr." <ge...@pobox.com> on 2006/10/25 07:57:49 UTC
Re: Harmony passes 94% on derby tests.
Nice work!
More inline..
Leo Li wrote:
> 467 Tests Run
> 94% Pass (443 tests passed)
> 6% Fail (24 tests failed)
> 5 Suites skipped
>
> The main progress focuses here:
> 1. Harmony classlib fails to load class when user-defined security policy
> exists. It is due to the sequence of library loading of VM, which has been
> resolved now.
> 2. A new workround for derby tests which allow useprocess to run test or
> else several testcases might fail due to derby lack these tests when
> useprocess = false.
> 3. Derby source code uses the version and the name of java vm to decide
> what
> to do, while current IBM VM has the version of "1.4.2" and the name of
> "j9",
> which has different output on the screen from that of standard RI 1.5. At
> the same time Derby test compares the output of the iteractive test scripts
> to that of expected. I have made some slight modification in its source
> code, but I have not throughly change this odd behavior, ...,too much:(
Have you approached the derby community with the changes?
>
> Besides, some testcase fails even on RI. I exclude
> a "derbynetclientmats" test suit since it will hang both RI and Harmony.
> Currently all the failure is irrelevant to Harmony. Hope I can find
> something in the left.
>
> I have updated the wiki of derby on Hamony:
> http://wiki.apache.org/harmony/Apache_Derby.
>
Re: Harmony passes 94% on derby tests.
Posted by "Geir Magnusson Jr." <ge...@pobox.com>.
+1
Leo Li wrote:
> So I recommend to delay putting formal derby tests in Harmony project util
> they are ported to junit. Since there will be quite some trouble to build
> them and to test them. Furthermore, current tests which are large and
> compared by console output are not so easy for debugging.:)
>
> Besides, I will put my patch on Harmony wiki page and give some
> instructions
> about how to build and test for those who are interested in this topic
> right
> now.
>
>
> On 10/26/06, Daniel John Debrunner <dj...@apache.org> wrote:
>>
>> Geir Magnusson Jr. wrote:
>> > Nice work!
>> >
>> > More inline..
>> >
>> > Leo Li wrote:
>> >> 467 Tests Run
>> >> 94% Pass (443 tests passed)
>> >> 6% Fail (24 tests failed)
>> >> 5 Suites skipped
>> >>
>> >> The main progress focuses here:
>> >> 1. Harmony classlib fails to load class when user-defined security
>> policy
>> >> exists. It is due to the sequence of library loading of VM, which has
>> >> been
>> >> resolved now.
>> >> 2. A new workround for derby tests which allow useprocess to run test
>> or
>> >> else several testcases might fail due to derby lack these tests when
>> >> useprocess = false.
>> >> 3. Derby source code uses the version and the name of java vm to
>> >> decide what
>> >> to do, while current IBM VM has the version of "1.4.2" and the name of
>> >> "j9",
>> >> which has different output on the screen from that of standard RI 1.5.
>> At
>> >> the same time Derby test compares the output of the iteractive test
>> >> scripts
>> >> to that of expected. I have made some slight modification in its
>> source
>> >> code, but I have not throughly change this odd behavior, ...,too
>> much:(
>> >
>> > Have you approached the derby community with the changes?
>>
>> Derby is moving to a pure JUnit based world, so it is probably not worth
>> a lot of effort patching up the old harness to run with Harmony. One of
>> the reasons to kill the old harness is that how to run with a new vm is
>> not obvious.
>>
>> http://wiki.apache.org/db-derby/KillDerbyTestHarness
>>
>>
>> Dan.
>>
>>
>
>
Re: Harmony passes 94% on derby tests.
Posted by Paulex Yang <pa...@gmail.com>.
Leo Li wrote:
> So I recommend to delay putting formal derby tests in Harmony project
> util
> they are ported to junit. Since there will be quite some trouble to build
> them and to test them. Furthermore, current tests which are large and
> compared by console output are not so easy for debugging.:)
> Besides, I will put my patch on Harmony wiki page and give some
> instructions
> about how to build and test for those who are interested in this topic
> right
> now.
>
Excellent work and very nice page!
>
> On 10/26/06, Daniel John Debrunner <dj...@apache.org> wrote:
>>
>> Geir Magnusson Jr. wrote:
>> > Nice work!
>> >
>> > More inline..
>> >
>> > Leo Li wrote:
>> >> 467 Tests Run
>> >> 94% Pass (443 tests passed)
>> >> 6% Fail (24 tests failed)
>> >> 5 Suites skipped
>> >>
>> >> The main progress focuses here:
>> >> 1. Harmony classlib fails to load class when user-defined security
>> policy
>> >> exists. It is due to the sequence of library loading of VM, which has
>> >> been
>> >> resolved now.
>> >> 2. A new workround for derby tests which allow useprocess to run test
>> or
>> >> else several testcases might fail due to derby lack these tests when
>> >> useprocess = false.
>> >> 3. Derby source code uses the version and the name of java vm to
>> >> decide what
>> >> to do, while current IBM VM has the version of "1.4.2" and the
>> name of
>> >> "j9",
>> >> which has different output on the screen from that of standard RI
>> 1.5.
>> At
>> >> the same time Derby test compares the output of the iteractive test
>> >> scripts
>> >> to that of expected. I have made some slight modification in its
>> source
>> >> code, but I have not throughly change this odd behavior, ...,too
>> much:(
>> >
>> > Have you approached the derby community with the changes?
>>
>> Derby is moving to a pure JUnit based world, so it is probably not worth
>> a lot of effort patching up the old harness to run with Harmony. One of
>> the reasons to kill the old harness is that how to run with a new vm is
>> not obvious.
>>
>> http://wiki.apache.org/db-derby/KillDerbyTestHarness
>>
>>
>> Dan.
>>
>>
>
>
--
Paulex Yang
China Software Development Lab
IBM
Re: Harmony passes 94% on derby tests.
Posted by Leo Li <li...@gmail.com>.
So I recommend to delay putting formal derby tests in Harmony project util
they are ported to junit. Since there will be quite some trouble to build
them and to test them. Furthermore, current tests which are large and
compared by console output are not so easy for debugging.:)
Besides, I will put my patch on Harmony wiki page and give some instructions
about how to build and test for those who are interested in this topic right
now.
On 10/26/06, Daniel John Debrunner <dj...@apache.org> wrote:
>
> Geir Magnusson Jr. wrote:
> > Nice work!
> >
> > More inline..
> >
> > Leo Li wrote:
> >> 467 Tests Run
> >> 94% Pass (443 tests passed)
> >> 6% Fail (24 tests failed)
> >> 5 Suites skipped
> >>
> >> The main progress focuses here:
> >> 1. Harmony classlib fails to load class when user-defined security
> policy
> >> exists. It is due to the sequence of library loading of VM, which has
> >> been
> >> resolved now.
> >> 2. A new workround for derby tests which allow useprocess to run test
> or
> >> else several testcases might fail due to derby lack these tests when
> >> useprocess = false.
> >> 3. Derby source code uses the version and the name of java vm to
> >> decide what
> >> to do, while current IBM VM has the version of "1.4.2" and the name of
> >> "j9",
> >> which has different output on the screen from that of standard RI 1.5.
> At
> >> the same time Derby test compares the output of the iteractive test
> >> scripts
> >> to that of expected. I have made some slight modification in its source
> >> code, but I have not throughly change this odd behavior, ...,too much:(
> >
> > Have you approached the derby community with the changes?
>
> Derby is moving to a pure JUnit based world, so it is probably not worth
> a lot of effort patching up the old harness to run with Harmony. One of
> the reasons to kill the old harness is that how to run with a new vm is
> not obvious.
>
> http://wiki.apache.org/db-derby/KillDerbyTestHarness
>
>
> Dan.
>
>
--
Leo Li
China Software Development Lab, IBM
Re: Harmony passes 94% on derby tests.
Posted by Daniel John Debrunner <dj...@apache.org>.
Geir Magnusson Jr. wrote:
> What's the timeline? Can we help?
Hopefully within months, we already have a set of JUnit tests that run
successfully, now just need to convert the existing ~600 tests.
Conversion has started, and yes you are very welcome to help, just join
in on derby-dev@db.apache.org.
Thanks,
Dan.
> Tim Ellison wrote:
>> Daniel John Debrunner wrote:
>>> Derby is moving to a pure JUnit based world, so it is probably not worth
>>> a lot of effort patching up the old harness to run with Harmony. One of
>>> the reasons to kill the old harness is that how to run with a new vm is
>>> not obvious.
Re: Harmony passes 94% on derby tests.
Posted by "Geir Magnusson Jr." <ge...@pobox.com>.
What's the timeline? Can we help?
Tim Ellison wrote:
> Daniel John Debrunner wrote:
>> Derby is moving to a pure JUnit based world, so it is probably not worth
>> a lot of effort patching up the old harness to run with Harmony. One of
>> the reasons to kill the old harness is that how to run with a new vm is
>> not obvious.
>
> No kidding ;-)
>
>> http://wiki.apache.org/db-derby/KillDerbyTestHarness
>
> are we invited to the wake?
>
> Tim
>
Re: Harmony passes 94% on derby tests.
Posted by "Geir Magnusson Jr." <ge...@pobox.com>.
I bet Mark could write a Perl script to do that...
Daniel John Debrunner wrote:
> Tim Ellison wrote:
>> Daniel John Debrunner wrote:
>>> Derby is moving to a pure JUnit based world, so it is probably not worth
>>> a lot of effort patching up the old harness to run with Harmony. One of
>>> the reasons to kill the old harness is that how to run with a new vm is
>>> not obvious.
>>
>> No kidding ;-)
>>
>>> http://wiki.apache.org/db-derby/KillDerbyTestHarness
>>
>> are we invited to the wake?
>
> Sure, there is a "two test conversion to JUnit minimum" though. :-)
>
> Dan.
>
>
Re: Harmony passes 94% on derby tests.
Posted by Daniel John Debrunner <dj...@apache.org>.
Tim Ellison wrote:
> Daniel John Debrunner wrote:
>> Derby is moving to a pure JUnit based world, so it is probably not worth
>> a lot of effort patching up the old harness to run with Harmony. One of
>> the reasons to kill the old harness is that how to run with a new vm is
>> not obvious.
>
> No kidding ;-)
>
>> http://wiki.apache.org/db-derby/KillDerbyTestHarness
>
> are we invited to the wake?
Sure, there is a "two test conversion to JUnit minimum" though. :-)
Dan.
Re: Harmony passes 94% on derby tests.
Posted by Tim Ellison <t....@gmail.com>.
Daniel John Debrunner wrote:
> Derby is moving to a pure JUnit based world, so it is probably not worth
> a lot of effort patching up the old harness to run with Harmony. One of
> the reasons to kill the old harness is that how to run with a new vm is
> not obvious.
No kidding ;-)
> http://wiki.apache.org/db-derby/KillDerbyTestHarness
are we invited to the wake?
Tim
--
Tim Ellison (t.p.ellison@gmail.com)
Re: Harmony passes 94% on derby tests.
Posted by Daniel John Debrunner <dj...@apache.org>.
Geir Magnusson Jr. wrote:
> Nice work!
>
> More inline..
>
> Leo Li wrote:
>> 467 Tests Run
>> 94% Pass (443 tests passed)
>> 6% Fail (24 tests failed)
>> 5 Suites skipped
>>
>> The main progress focuses here:
>> 1. Harmony classlib fails to load class when user-defined security policy
>> exists. It is due to the sequence of library loading of VM, which has
>> been
>> resolved now.
>> 2. A new workround for derby tests which allow useprocess to run test or
>> else several testcases might fail due to derby lack these tests when
>> useprocess = false.
>> 3. Derby source code uses the version and the name of java vm to
>> decide what
>> to do, while current IBM VM has the version of "1.4.2" and the name of
>> "j9",
>> which has different output on the screen from that of standard RI 1.5. At
>> the same time Derby test compares the output of the iteractive test
>> scripts
>> to that of expected. I have made some slight modification in its source
>> code, but I have not throughly change this odd behavior, ...,too much:(
>
> Have you approached the derby community with the changes?
Derby is moving to a pure JUnit based world, so it is probably not worth
a lot of effort patching up the old harness to run with Harmony. One of
the reasons to kill the old harness is that how to run with a new vm is
not obvious.
http://wiki.apache.org/db-derby/KillDerbyTestHarness
Dan.
Re: Harmony passes 94% on derby tests.
Posted by Vladimir Ivanov <iv...@gmail.com>.
Nice work!
Thanks, Vladimir
On 11/2/06, Nina Rinskaya <ni...@gmail.com> wrote:
>
> Hi,
>
> I might have chosen the wrong thread for this message, but this is
> about another well-known unit tests suite - Eclipse Unit Tests. I've
> recently filed new JIRA issue
> (https://issues.apache.org/jira/browse/HARMONY-2038) with the ant
> script to run EUT on Harmony. Does it make sense to integrate it to
> the buildtest module?
>
> For a moment EUT pass rate on Harmony is ~77%. EUT runs results (on
> Linux/ia32 and windows/ia32) are being updated on wiki:
> http://wiki.apache.org/harmony/Eclipse_Unit_Tests_Pass_on_DRLVM
>
> A number of EUT test cases fail on Harmony because EUT uses some
> hard-coded Sun/Jrockit classlibs names. In particular,
> org.eclipse.jdt.core.tests.util.Util class uses specific paths to
> class libraries jar files (<JRE_HOME>/lib/rt.jar, for example).
> org.eclipse.jdt.core.tests.runtime.*VMLauncher classes use "javaw" as
> vm executable name that is missing in Harmony bundle. So what I would
> like to do now is to patch EUT to invoke Harmony correctly if it is ok
> with everyone here.
>
> Best regards,
> Nina
>
> On 10/25/06, Vladimir Ivanov <iv...@gmail.com> wrote:
> > Excellent!
> >
> >
> >
> > I have one more idea: we already have buildtest module. Some time ago we
> > agreed to extends it by coverage and japi scripts (I hope it happens
> soon:)
> > ). May be we extend it one more time and store here some scripts for
> > automatic run of other-projects unit tests? Seems, in this case we can
> > easily reproduce tests run and enable new platforms.
> >
> > Of cause, we can not cover all application but we can define some list
> of
> > 'most important application'.
> >
> > Is it OK?
> >
> > Leo, could you share your script for Derby?
> >
> > Tony, could you share your scripts for ant and log4j?
> >
> >
> >
> > thanks, Vladimir
> >
> >
> > PS. The directory structure may be something like that:
> > builtest
> > - trunk
> > - cc
> > - coverage
> > - japi
> > - application_test
> > - derby
> > - ant
> > - etc
> > - misc (some other scripts)
> > On 10/25/06, Geir Magnusson Jr. <ge...@pobox.com> wrote:
> > >
> > > Nice work!
> > >
> > > More inline..
> > >
> > > Leo Li wrote:
> > > > 467 Tests Run
> > > > 94% Pass (443 tests passed)
> > > > 6% Fail (24 tests failed)
> > > > 5 Suites skipped
> > > >
> > > > The main progress focuses here:
> > > > 1. Harmony classlib fails to load class when user-defined security
> > > policy
> > > > exists. It is due to the sequence of library loading of VM, which
> has
> > > been
> > > > resolved now.
> > > > 2. A new workround for derby tests which allow useprocess to run
> test or
> > > > else several testcases might fail due to derby lack these tests when
> > > > useprocess = false.
> > > > 3. Derby source code uses the version and the name of java vm to
> decide
> > > > what
> > > > to do, while current IBM VM has the version of "1.4.2" and the name
> of
> > > > "j9",
> > > > which has different output on the screen from that of standard RI
> 1.5.
> > > At
> > > > the same time Derby test compares the output of the iteractive test
> > > scripts
> > > > to that of expected. I have made some slight modification in its
> source
> > > > code, but I have not throughly change this odd behavior, ...,too
> much:(
> > >
> > > Have you approached the derby community with the changes?
> > >
> > > >
> > > > Besides, some testcase fails even on RI. I exclude
> > > > a "derbynetclientmats" test suit since it will hang both RI and
> Harmony.
> > > > Currently all the failure is irrelevant to Harmony. Hope I can find
> > > > something in the left.
> > > >
> > > > I have updated the wiki of derby on Hamony:
> > > > http://wiki.apache.org/harmony/Apache_Derby.
> > > >
> > >
> >
> >
>
Re: Harmony passes 94% on derby tests.
Posted by Alexey Varlamov <al...@gmail.com>.
2006/11/7, Nina Rinskaya <ni...@gmail.com>:
> Thanks for your reply! And I agree that the right thing is to file
> bugs on EUT. But maybe it is ok to make the patches first as a
> temporary workaround just to be able to run EUT on Harmony and not to
> wait too long for EUT bugs fixes? Does it make sense?
>
Sure, the patches would be useful even if just hanging in a JIRA. I
suggest to separate issues intended for commit from temporary stuff,
please file additional JIRA for the last.
--
Best regards,
Alexey
> Thanks,
> Nina
>
> On 11/3/06, Alexey Varlamov <al...@gmail.com> wrote:
> > +1 to integration. As for the patches, I'd rather suggest filing bugs
> > on EUT and let respective community to resolve those issue for good -
> > either find more universal approach (like java.management or JVMTI
> > features) or hardcode harmony too :).
> >
> > Thanks for spending these efforts, anyway!
> >
> > 03 Nov 2006 14:01:14 +0600, Egor Pasko <eg...@gmail.com>:
> > > On the 0x215 day of Apache Harmony Nina Rinskaya wrote:
> > > > Hi,
> > > >
> > > > I might have chosen the wrong thread for this message, but this is
> > > > about another well-known unit tests suite - Eclipse Unit Tests. I've
> > > > recently filed new JIRA issue
> > > > (https://issues.apache.org/jira/browse/HARMONY-2038) with the ant
> > > > script to run EUT on Harmony. Does it make sense to integrate it to
> > > > the buildtest module?
> > >
> > > I think, yes!
> > >
> > > > For a moment EUT pass rate on Harmony is ~77%. EUT runs results (on
> > > > Linux/ia32 and windows/ia32) are being updated on wiki:
> > > > http://wiki.apache.org/harmony/Eclipse_Unit_Tests_Pass_on_DRLVM
> > > >
> > > > A number of EUT test cases fail on Harmony because EUT uses some
> > > > hard-coded Sun/Jrockit classlibs names. In particular,
> > > > org.eclipse.jdt.core.tests.util.Util class uses specific paths to
> > > > class libraries jar files (<JRE_HOME>/lib/rt.jar, for example).
> > > > org.eclipse.jdt.core.tests.runtime.*VMLauncher classes use "javaw" as
> > > > vm executable name that is missing in Harmony bundle. So what I would
> > > > like to do now is to patch EUT to invoke Harmony correctly if it is ok
> > > > with everyone here.
> > > >
> > > > Best regards,
> > > > Nina
> > > >
> > > > On 10/25/06, Vladimir Ivanov <iv...@gmail.com> wrote:
> > > > > Excellent!
> > > > >
> > > > >
> > > > >
> > > > > I have one more idea: we already have buildtest module. Some time ago we
> > > > > agreed to extends it by coverage and japi scripts (I hope it happens soon:)
> > > > > ). May be we extend it one more time and store here some scripts for
> > > > > automatic run of other-projects unit tests? Seems, in this case we can
> > > > > easily reproduce tests run and enable new platforms.
> > > > >
> > > > > Of cause, we can not cover all application but we can define some list of
> > > > > 'most important application'.
> > > > >
> > > > > Is it OK?
> > > > >
> > > > > Leo, could you share your script for Derby?
> > > > >
> > > > > Tony, could you share your scripts for ant and log4j?
> > > > >
> > > > >
> > > > >
> > > > > thanks, Vladimir
> > > > >
> > > > >
> > > > > PS. The directory structure may be something like that:
> > > > > builtest
> > > > > - trunk
> > > > > - cc
> > > > > - coverage
> > > > > - japi
> > > > > - application_test
> > > > > - derby
> > > > > - ant
> > > > > - etc
> > > > > - misc (some other scripts)
> > > > > On 10/25/06, Geir Magnusson Jr. <ge...@pobox.com> wrote:
> > > > > >
> > > > > > Nice work!
> > > > > >
> > > > > > More inline..
> > > > > >
> > > > > > Leo Li wrote:
> > > > > > > 467 Tests Run
> > > > > > > 94% Pass (443 tests passed)
> > > > > > > 6% Fail (24 tests failed)
> > > > > > > 5 Suites skipped
> > > > > > >
> > > > > > > The main progress focuses here:
> > > > > > > 1. Harmony classlib fails to load class when user-defined security
> > > > > > policy
> > > > > > > exists. It is due to the sequence of library loading of VM, which has
> > > > > > been
> > > > > > > resolved now.
> > > > > > > 2. A new workround for derby tests which allow useprocess to run test or
> > > > > > > else several testcases might fail due to derby lack these tests when
> > > > > > > useprocess = false.
> > > > > > > 3. Derby source code uses the version and the name of java vm to decide
> > > > > > > what
> > > > > > > to do, while current IBM VM has the version of "1.4.2" and the name of
> > > > > > > "j9",
> > > > > > > which has different output on the screen from that of standard RI 1.5.
> > > > > > At
> > > > > > > the same time Derby test compares the output of the iteractive test
> > > > > > scripts
> > > > > > > to that of expected. I have made some slight modification in its source
> > > > > > > code, but I have not throughly change this odd behavior, ...,too much:(
> > > > > >
> > > > > > Have you approached the derby community with the changes?
> > > > > >
> > > > > > >
> > > > > > > Besides, some testcase fails even on RI. I exclude
> > > > > > > a "derbynetclientmats" test suit since it will hang both RI and Harmony.
> > > > > > > Currently all the failure is irrelevant to Harmony. Hope I can find
> > > > > > > something in the left.
> > > > > > >
> > > > > > > I have updated the wiki of derby on Hamony:
> > > > > > > http://wiki.apache.org/harmony/Apache_Derby.
> > > > > > >
> > > > > >
> > > > >
> > > > >
> > > >
> > >
> > > --
> > > Egor Pasko
> > >
> > >
> >
>
Re: Harmony passes 94% on derby tests.
Posted by Nina Rinskaya <ni...@gmail.com>.
Thanks for your reply! And I agree that the right thing is to file
bugs on EUT. But maybe it is ok to make the patches first as a
temporary workaround just to be able to run EUT on Harmony and not to
wait too long for EUT bugs fixes? Does it make sense?
Thanks,
Nina
On 11/3/06, Alexey Varlamov <al...@gmail.com> wrote:
> +1 to integration. As for the patches, I'd rather suggest filing bugs
> on EUT and let respective community to resolve those issue for good -
> either find more universal approach (like java.management or JVMTI
> features) or hardcode harmony too :).
>
> Thanks for spending these efforts, anyway!
>
> 03 Nov 2006 14:01:14 +0600, Egor Pasko <eg...@gmail.com>:
> > On the 0x215 day of Apache Harmony Nina Rinskaya wrote:
> > > Hi,
> > >
> > > I might have chosen the wrong thread for this message, but this is
> > > about another well-known unit tests suite - Eclipse Unit Tests. I've
> > > recently filed new JIRA issue
> > > (https://issues.apache.org/jira/browse/HARMONY-2038) with the ant
> > > script to run EUT on Harmony. Does it make sense to integrate it to
> > > the buildtest module?
> >
> > I think, yes!
> >
> > > For a moment EUT pass rate on Harmony is ~77%. EUT runs results (on
> > > Linux/ia32 and windows/ia32) are being updated on wiki:
> > > http://wiki.apache.org/harmony/Eclipse_Unit_Tests_Pass_on_DRLVM
> > >
> > > A number of EUT test cases fail on Harmony because EUT uses some
> > > hard-coded Sun/Jrockit classlibs names. In particular,
> > > org.eclipse.jdt.core.tests.util.Util class uses specific paths to
> > > class libraries jar files (<JRE_HOME>/lib/rt.jar, for example).
> > > org.eclipse.jdt.core.tests.runtime.*VMLauncher classes use "javaw" as
> > > vm executable name that is missing in Harmony bundle. So what I would
> > > like to do now is to patch EUT to invoke Harmony correctly if it is ok
> > > with everyone here.
> > >
> > > Best regards,
> > > Nina
> > >
> > > On 10/25/06, Vladimir Ivanov <iv...@gmail.com> wrote:
> > > > Excellent!
> > > >
> > > >
> > > >
> > > > I have one more idea: we already have buildtest module. Some time ago we
> > > > agreed to extends it by coverage and japi scripts (I hope it happens soon:)
> > > > ). May be we extend it one more time and store here some scripts for
> > > > automatic run of other-projects unit tests? Seems, in this case we can
> > > > easily reproduce tests run and enable new platforms.
> > > >
> > > > Of cause, we can not cover all application but we can define some list of
> > > > 'most important application'.
> > > >
> > > > Is it OK?
> > > >
> > > > Leo, could you share your script for Derby?
> > > >
> > > > Tony, could you share your scripts for ant and log4j?
> > > >
> > > >
> > > >
> > > > thanks, Vladimir
> > > >
> > > >
> > > > PS. The directory structure may be something like that:
> > > > builtest
> > > > - trunk
> > > > - cc
> > > > - coverage
> > > > - japi
> > > > - application_test
> > > > - derby
> > > > - ant
> > > > - etc
> > > > - misc (some other scripts)
> > > > On 10/25/06, Geir Magnusson Jr. <ge...@pobox.com> wrote:
> > > > >
> > > > > Nice work!
> > > > >
> > > > > More inline..
> > > > >
> > > > > Leo Li wrote:
> > > > > > 467 Tests Run
> > > > > > 94% Pass (443 tests passed)
> > > > > > 6% Fail (24 tests failed)
> > > > > > 5 Suites skipped
> > > > > >
> > > > > > The main progress focuses here:
> > > > > > 1. Harmony classlib fails to load class when user-defined security
> > > > > policy
> > > > > > exists. It is due to the sequence of library loading of VM, which has
> > > > > been
> > > > > > resolved now.
> > > > > > 2. A new workround for derby tests which allow useprocess to run test or
> > > > > > else several testcases might fail due to derby lack these tests when
> > > > > > useprocess = false.
> > > > > > 3. Derby source code uses the version and the name of java vm to decide
> > > > > > what
> > > > > > to do, while current IBM VM has the version of "1.4.2" and the name of
> > > > > > "j9",
> > > > > > which has different output on the screen from that of standard RI 1.5.
> > > > > At
> > > > > > the same time Derby test compares the output of the iteractive test
> > > > > scripts
> > > > > > to that of expected. I have made some slight modification in its source
> > > > > > code, but I have not throughly change this odd behavior, ...,too much:(
> > > > >
> > > > > Have you approached the derby community with the changes?
> > > > >
> > > > > >
> > > > > > Besides, some testcase fails even on RI. I exclude
> > > > > > a "derbynetclientmats" test suit since it will hang both RI and Harmony.
> > > > > > Currently all the failure is irrelevant to Harmony. Hope I can find
> > > > > > something in the left.
> > > > > >
> > > > > > I have updated the wiki of derby on Hamony:
> > > > > > http://wiki.apache.org/harmony/Apache_Derby.
> > > > > >
> > > > >
> > > >
> > > >
> > >
> >
> > --
> > Egor Pasko
> >
> >
>
Re: Harmony passes 94% on derby tests.
Posted by Alexey Varlamov <al...@gmail.com>.
+1 to integration. As for the patches, I'd rather suggest filing bugs
on EUT and let respective community to resolve those issue for good -
either find more universal approach (like java.management or JVMTI
features) or hardcode harmony too :).
Thanks for spending these efforts, anyway!
03 Nov 2006 14:01:14 +0600, Egor Pasko <eg...@gmail.com>:
> On the 0x215 day of Apache Harmony Nina Rinskaya wrote:
> > Hi,
> >
> > I might have chosen the wrong thread for this message, but this is
> > about another well-known unit tests suite - Eclipse Unit Tests. I've
> > recently filed new JIRA issue
> > (https://issues.apache.org/jira/browse/HARMONY-2038) with the ant
> > script to run EUT on Harmony. Does it make sense to integrate it to
> > the buildtest module?
>
> I think, yes!
>
> > For a moment EUT pass rate on Harmony is ~77%. EUT runs results (on
> > Linux/ia32 and windows/ia32) are being updated on wiki:
> > http://wiki.apache.org/harmony/Eclipse_Unit_Tests_Pass_on_DRLVM
> >
> > A number of EUT test cases fail on Harmony because EUT uses some
> > hard-coded Sun/Jrockit classlibs names. In particular,
> > org.eclipse.jdt.core.tests.util.Util class uses specific paths to
> > class libraries jar files (<JRE_HOME>/lib/rt.jar, for example).
> > org.eclipse.jdt.core.tests.runtime.*VMLauncher classes use "javaw" as
> > vm executable name that is missing in Harmony bundle. So what I would
> > like to do now is to patch EUT to invoke Harmony correctly if it is ok
> > with everyone here.
> >
> > Best regards,
> > Nina
> >
> > On 10/25/06, Vladimir Ivanov <iv...@gmail.com> wrote:
> > > Excellent!
> > >
> > >
> > >
> > > I have one more idea: we already have buildtest module. Some time ago we
> > > agreed to extends it by coverage and japi scripts (I hope it happens soon:)
> > > ). May be we extend it one more time and store here some scripts for
> > > automatic run of other-projects unit tests? Seems, in this case we can
> > > easily reproduce tests run and enable new platforms.
> > >
> > > Of cause, we can not cover all application but we can define some list of
> > > 'most important application'.
> > >
> > > Is it OK?
> > >
> > > Leo, could you share your script for Derby?
> > >
> > > Tony, could you share your scripts for ant and log4j?
> > >
> > >
> > >
> > > thanks, Vladimir
> > >
> > >
> > > PS. The directory structure may be something like that:
> > > builtest
> > > - trunk
> > > - cc
> > > - coverage
> > > - japi
> > > - application_test
> > > - derby
> > > - ant
> > > - etc
> > > - misc (some other scripts)
> > > On 10/25/06, Geir Magnusson Jr. <ge...@pobox.com> wrote:
> > > >
> > > > Nice work!
> > > >
> > > > More inline..
> > > >
> > > > Leo Li wrote:
> > > > > 467 Tests Run
> > > > > 94% Pass (443 tests passed)
> > > > > 6% Fail (24 tests failed)
> > > > > 5 Suites skipped
> > > > >
> > > > > The main progress focuses here:
> > > > > 1. Harmony classlib fails to load class when user-defined security
> > > > policy
> > > > > exists. It is due to the sequence of library loading of VM, which has
> > > > been
> > > > > resolved now.
> > > > > 2. A new workround for derby tests which allow useprocess to run test or
> > > > > else several testcases might fail due to derby lack these tests when
> > > > > useprocess = false.
> > > > > 3. Derby source code uses the version and the name of java vm to decide
> > > > > what
> > > > > to do, while current IBM VM has the version of "1.4.2" and the name of
> > > > > "j9",
> > > > > which has different output on the screen from that of standard RI 1.5.
> > > > At
> > > > > the same time Derby test compares the output of the iteractive test
> > > > scripts
> > > > > to that of expected. I have made some slight modification in its source
> > > > > code, but I have not throughly change this odd behavior, ...,too much:(
> > > >
> > > > Have you approached the derby community with the changes?
> > > >
> > > > >
> > > > > Besides, some testcase fails even on RI. I exclude
> > > > > a "derbynetclientmats" test suit since it will hang both RI and Harmony.
> > > > > Currently all the failure is irrelevant to Harmony. Hope I can find
> > > > > something in the left.
> > > > >
> > > > > I have updated the wiki of derby on Hamony:
> > > > > http://wiki.apache.org/harmony/Apache_Derby.
> > > > >
> > > >
> > >
> > >
> >
>
> --
> Egor Pasko
>
>
Re: Harmony passes 94% on derby tests.
Posted by Egor Pasko <eg...@gmail.com>.
On the 0x215 day of Apache Harmony Nina Rinskaya wrote:
> Hi,
>
> I might have chosen the wrong thread for this message, but this is
> about another well-known unit tests suite - Eclipse Unit Tests. I've
> recently filed new JIRA issue
> (https://issues.apache.org/jira/browse/HARMONY-2038) with the ant
> script to run EUT on Harmony. Does it make sense to integrate it to
> the buildtest module?
I think, yes!
> For a moment EUT pass rate on Harmony is ~77%. EUT runs results (on
> Linux/ia32 and windows/ia32) are being updated on wiki:
> http://wiki.apache.org/harmony/Eclipse_Unit_Tests_Pass_on_DRLVM
>
> A number of EUT test cases fail on Harmony because EUT uses some
> hard-coded Sun/Jrockit classlibs names. In particular,
> org.eclipse.jdt.core.tests.util.Util class uses specific paths to
> class libraries jar files (<JRE_HOME>/lib/rt.jar, for example).
> org.eclipse.jdt.core.tests.runtime.*VMLauncher classes use "javaw" as
> vm executable name that is missing in Harmony bundle. So what I would
> like to do now is to patch EUT to invoke Harmony correctly if it is ok
> with everyone here.
>
> Best regards,
> Nina
>
> On 10/25/06, Vladimir Ivanov <iv...@gmail.com> wrote:
> > Excellent!
> >
> >
> >
> > I have one more idea: we already have buildtest module. Some time ago we
> > agreed to extends it by coverage and japi scripts (I hope it happens soon:)
> > ). May be we extend it one more time and store here some scripts for
> > automatic run of other-projects unit tests? Seems, in this case we can
> > easily reproduce tests run and enable new platforms.
> >
> > Of cause, we can not cover all application but we can define some list of
> > 'most important application'.
> >
> > Is it OK?
> >
> > Leo, could you share your script for Derby?
> >
> > Tony, could you share your scripts for ant and log4j?
> >
> >
> >
> > thanks, Vladimir
> >
> >
> > PS. The directory structure may be something like that:
> > builtest
> > - trunk
> > - cc
> > - coverage
> > - japi
> > - application_test
> > - derby
> > - ant
> > - etc
> > - misc (some other scripts)
> > On 10/25/06, Geir Magnusson Jr. <ge...@pobox.com> wrote:
> > >
> > > Nice work!
> > >
> > > More inline..
> > >
> > > Leo Li wrote:
> > > > 467 Tests Run
> > > > 94% Pass (443 tests passed)
> > > > 6% Fail (24 tests failed)
> > > > 5 Suites skipped
> > > >
> > > > The main progress focuses here:
> > > > 1. Harmony classlib fails to load class when user-defined security
> > > policy
> > > > exists. It is due to the sequence of library loading of VM, which has
> > > been
> > > > resolved now.
> > > > 2. A new workround for derby tests which allow useprocess to run test or
> > > > else several testcases might fail due to derby lack these tests when
> > > > useprocess = false.
> > > > 3. Derby source code uses the version and the name of java vm to decide
> > > > what
> > > > to do, while current IBM VM has the version of "1.4.2" and the name of
> > > > "j9",
> > > > which has different output on the screen from that of standard RI 1.5.
> > > At
> > > > the same time Derby test compares the output of the iteractive test
> > > scripts
> > > > to that of expected. I have made some slight modification in its source
> > > > code, but I have not throughly change this odd behavior, ...,too much:(
> > >
> > > Have you approached the derby community with the changes?
> > >
> > > >
> > > > Besides, some testcase fails even on RI. I exclude
> > > > a "derbynetclientmats" test suit since it will hang both RI and Harmony.
> > > > Currently all the failure is irrelevant to Harmony. Hope I can find
> > > > something in the left.
> > > >
> > > > I have updated the wiki of derby on Hamony:
> > > > http://wiki.apache.org/harmony/Apache_Derby.
> > > >
> > >
> >
> >
>
--
Egor Pasko
Re: Harmony passes 94% on derby tests.
Posted by Nina Rinskaya <ni...@gmail.com>.
Hi,
I might have chosen the wrong thread for this message, but this is
about another well-known unit tests suite - Eclipse Unit Tests. I've
recently filed new JIRA issue
(https://issues.apache.org/jira/browse/HARMONY-2038) with the ant
script to run EUT on Harmony. Does it make sense to integrate it to
the buildtest module?
For a moment EUT pass rate on Harmony is ~77%. EUT runs results (on
Linux/ia32 and windows/ia32) are being updated on wiki:
http://wiki.apache.org/harmony/Eclipse_Unit_Tests_Pass_on_DRLVM
A number of EUT test cases fail on Harmony because EUT uses some
hard-coded Sun/Jrockit classlibs names. In particular,
org.eclipse.jdt.core.tests.util.Util class uses specific paths to
class libraries jar files (<JRE_HOME>/lib/rt.jar, for example).
org.eclipse.jdt.core.tests.runtime.*VMLauncher classes use "javaw" as
vm executable name that is missing in Harmony bundle. So what I would
like to do now is to patch EUT to invoke Harmony correctly if it is ok
with everyone here.
Best regards,
Nina
On 10/25/06, Vladimir Ivanov <iv...@gmail.com> wrote:
> Excellent!
>
>
>
> I have one more idea: we already have buildtest module. Some time ago we
> agreed to extends it by coverage and japi scripts (I hope it happens soon:)
> ). May be we extend it one more time and store here some scripts for
> automatic run of other-projects unit tests? Seems, in this case we can
> easily reproduce tests run and enable new platforms.
>
> Of cause, we can not cover all application but we can define some list of
> 'most important application'.
>
> Is it OK?
>
> Leo, could you share your script for Derby?
>
> Tony, could you share your scripts for ant and log4j?
>
>
>
> thanks, Vladimir
>
>
> PS. The directory structure may be something like that:
> builtest
> - trunk
> - cc
> - coverage
> - japi
> - application_test
> - derby
> - ant
> - etc
> - misc (some other scripts)
> On 10/25/06, Geir Magnusson Jr. <ge...@pobox.com> wrote:
> >
> > Nice work!
> >
> > More inline..
> >
> > Leo Li wrote:
> > > 467 Tests Run
> > > 94% Pass (443 tests passed)
> > > 6% Fail (24 tests failed)
> > > 5 Suites skipped
> > >
> > > The main progress focuses here:
> > > 1. Harmony classlib fails to load class when user-defined security
> > policy
> > > exists. It is due to the sequence of library loading of VM, which has
> > been
> > > resolved now.
> > > 2. A new workround for derby tests which allow useprocess to run test or
> > > else several testcases might fail due to derby lack these tests when
> > > useprocess = false.
> > > 3. Derby source code uses the version and the name of java vm to decide
> > > what
> > > to do, while current IBM VM has the version of "1.4.2" and the name of
> > > "j9",
> > > which has different output on the screen from that of standard RI 1.5.
> > At
> > > the same time Derby test compares the output of the iteractive test
> > scripts
> > > to that of expected. I have made some slight modification in its source
> > > code, but I have not throughly change this odd behavior, ...,too much:(
> >
> > Have you approached the derby community with the changes?
> >
> > >
> > > Besides, some testcase fails even on RI. I exclude
> > > a "derbynetclientmats" test suit since it will hang both RI and Harmony.
> > > Currently all the failure is irrelevant to Harmony. Hope I can find
> > > something in the left.
> > >
> > > I have updated the wiki of derby on Hamony:
> > > http://wiki.apache.org/harmony/Apache_Derby.
> > >
> >
>
>
Re: Harmony passes 94% on derby tests.
Posted by "Geir Magnusson Jr." <ge...@pobox.com>.
Vladimir Ivanov wrote:
> On 10/25/06, Geir Magnusson Jr. <ge...@pobox.com> wrote:
>
>>
>>
>> Mark Hindess wrote:
>
>
> <snip>
>
>
>
>> >> PS. The directory structure may be something like that:
>> >>
>> >> builtest
>> >> - trunk
>> >> - cc
>> >> - coverage
>> >> - japi
>> >> - application_test
>> >> - derby
>> >> - ant
>> >> - etc
>> >> - misc (some other scripts)
>> >
>> > I had assumed we'd make separate, optional cruisecontrol jobs to
>> perform
>> > the coverage/japi/etc reporting. These jobs would depend on the build
>> > ant test jobs succeeding.
>
> I agree.
>>
>> Judging by the structure you suggest, it
>> > seems to me that you may anticipate doing it differently?
>> >
>
>
>
> my vision is: into each 'application' directory we have 3 files (at least):
> one - for manual run of application tests over checkouted workspace, one
> for
> manual run of application tests over HDK and one - cruise control project
> description for this test set based on the first file (actually, 'cc'
> may be
> is not good name. Let's rename it to 'hut' (harmony unit tests) or
> something
> else).
>
> The common part - classlib and drlvm builds - should be stored into root of
> buildtest/trunk module.
>
> By default, the CC will include only builds and unit tests for classlib and
> drlvm but can be updated to builds and something else by command line
> options.
>
> Is it OK?
Why not put everything in by default, and let people comment out what
they don't need?
geir
>
> thanks, Vladimir
>
>
>
>> > Regards,
>> > Mark.
>> >
>> >
>> >
>>
>
Re: Harmony passes 94% on derby tests.
Posted by Vladimir Ivanov <iv...@gmail.com>.
On 10/25/06, Geir Magnusson Jr. <ge...@pobox.com> wrote:
>
>
> Mark Hindess wrote:
<snip>
> >> PS. The directory structure may be something like that:
> >>
> >> builtest
> >> - trunk
> >> - cc
> >> - coverage
> >> - japi
> >> - application_test
> >> - derby
> >> - ant
> >> - etc
> >> - misc (some other scripts)
> >
> > I had assumed we'd make separate, optional cruisecontrol jobs to perform
> > the coverage/japi/etc reporting. These jobs would depend on the build
> > ant test jobs succeeding.
I agree.
>
> Judging by the structure you suggest, it
> > seems to me that you may anticipate doing it differently?
> >
my vision is: into each 'application' directory we have 3 files (at least):
one - for manual run of application tests over checkouted workspace, one for
manual run of application tests over HDK and one - cruise control project
description for this test set based on the first file (actually, 'cc' may be
is not good name. Let's rename it to 'hut' (harmony unit tests) or something
else).
The common part - classlib and drlvm builds - should be stored into root of
buildtest/trunk module.
By default, the CC will include only builds and unit tests for classlib and
drlvm but can be updated to builds and something else by command line
options.
Is it OK?
thanks, Vladimir
> > Regards,
> > Mark.
> >
> >
> >
>
Re: Harmony passes 94% on derby tests.
Posted by "Geir Magnusson Jr." <ge...@pobox.com>.
Mark Hindess wrote:
> On 25 October 2006 at 18:36, "Vladimir Ivanov" <iv...@gmail.com> wrote:
>> Excellent!
>>
>> I have one more idea: we already have buildtest module. Some time ago we
>> agreed to extends it by coverage and japi scripts (I hope it happens soon:)
>> ). May be we extend it one more time and store here some scripts for
>> automatic run of other-projects unit tests? Seems, in this case we can
>> easily reproduce tests run and enable new platforms.
>>
>> Of cause, we can not cover all application but we can define some list of
>> 'most important application'.
>>
>> Is it OK?
>
> I think gump will do this?
I'm sure it will, but given we have the infrastructure that we want
people to run anyway, why not use it?
>
>> PS. The directory structure may be something like that:
>>
>> builtest
>> - trunk
>> - cc
>> - coverage
>> - japi
>> - application_test
>> - derby
>> - ant
>> - etc
>> - misc (some other scripts)
>
> I had assumed we'd make separate, optional cruisecontrol jobs to perform
> the coverage/japi/etc reporting. These jobs would depend on the build
> ant test jobs succeeding.
I agree.
Judging by the structure you suggest, it
> seems to me that you may anticipate doing it differently?
>
> Regards,
> Mark.
>
>
>
Re: Harmony passes 94% on derby tests.
Posted by Mark Hindess <ma...@googlemail.com>.
On 25 October 2006 at 18:36, "Vladimir Ivanov" <iv...@gmail.com> wrote:
>
> Excellent!
>
> I have one more idea: we already have buildtest module. Some time ago we
> agreed to extends it by coverage and japi scripts (I hope it happens soon:)
> ). May be we extend it one more time and store here some scripts for
> automatic run of other-projects unit tests? Seems, in this case we can
> easily reproduce tests run and enable new platforms.
>
> Of cause, we can not cover all application but we can define some list of
> 'most important application'.
>
> Is it OK?
I think gump will do this?
> PS. The directory structure may be something like that:
>
> builtest
> - trunk
> - cc
> - coverage
> - japi
> - application_test
> - derby
> - ant
> - etc
> - misc (some other scripts)
I had assumed we'd make separate, optional cruisecontrol jobs to perform
the coverage/japi/etc reporting. These jobs would depend on the build
ant test jobs succeeding. Judging by the structure you suggest, it
seems to me that you may anticipate doing it differently?
Regards,
Mark.
Re: Harmony passes 94% on derby tests.
Posted by Vladimir Ivanov <iv...@gmail.com>.
On 10/26/06, Leo Li <li...@gmail.com> wrote:
>
> Hi, Vladimir:
> Sorry for the delay.
> I am willing to share my script. It will be great if we can use real
> application as a supplement for our testcase.
> But...actually, I am not quite sure about what the script is.:)
>From my point of view (other people can have other point :) ) it is ant
based script that:
- download application (if needed);
- download tests (if needed);
- do some 'standard' modification (if needed);
- run application tests over the harmony runtime.
Also it may prepare results for wiki or something else :)
thanks, Vladimir
Note, you can look at
*HARMONY-995*<http://issues.apache.org/jira/browse/HARMONY-995>,
file cc.zip to see a preliminary structure of 'buildtest' module
> On 10/25/06, Vladimir Ivanov <iv...@gmail.com> wrote:
> >
> > Excellent!
> >
> >
> >
> > I have one more idea: we already have buildtest module. Some time ago we
> > agreed to extends it by coverage and japi scripts (I hope it happens
> > soon:)
> > ). May be we extend it one more time and store here some scripts for
> > automatic run of other-projects unit tests? Seems, in this case we can
> > easily reproduce tests run and enable new platforms.
> >
> > Of cause, we can not cover all application but we can define some list
> of
> > 'most important application'.
> >
> > Is it OK?
> >
> > Leo, could you share your script for Derby?
> >
> > Tony, could you share your scripts for ant and log4j?
> >
> >
> >
> > thanks, Vladimir
> >
> >
> > PS. The directory structure may be something like that:
> > builtest
> > - trunk
> > - cc
> > - coverage
> > - japi
> > - application_test
> > - derby
> > - ant
> > - etc
> > - misc (some other scripts)
> > On 10/25/06, Geir Magnusson Jr. <ge...@pobox.com> wrote:
> > >
> > > Nice work!
> > >
> > > More inline..
> > >
> > > Leo Li wrote:
> > > > 467 Tests Run
> > > > 94% Pass (443 tests passed)
> > > > 6% Fail (24 tests failed)
> > > > 5 Suites skipped
> > > >
> > > > The main progress focuses here:
> > > > 1. Harmony classlib fails to load class when user-defined security
> > > policy
> > > > exists. It is due to the sequence of library loading of VM, which
> has
> > > been
> > > > resolved now.
> > > > 2. A new workround for derby tests which allow useprocess to run
> test
> > or
> > > > else several testcases might fail due to derby lack these tests when
> > > > useprocess = false.
> > > > 3. Derby source code uses the version and the name of java vm to
> > decide
> > > > what
> > > > to do, while current IBM VM has the version of "1.4.2" and the name
> of
> > > > "j9",
> > > > which has different output on the screen from that of standard RI
> 1.5.
> > > At
> > > > the same time Derby test compares the output of the iteractive test
> > > scripts
> > > > to that of expected. I have made some slight modification in its
> > source
> > > > code, but I have not throughly change this odd behavior, ...,too
> > much:(
> > >
> > > Have you approached the derby community with the changes?
> > >
> > > >
> > > > Besides, some testcase fails even on RI. I exclude
> > > > a "derbynetclientmats" test suit since it will hang both RI and
> > Harmony.
> > > > Currently all the failure is irrelevant to Harmony. Hope I can find
> > > > something in the left.
> > > >
> > > > I have updated the wiki of derby on Hamony:
> > > > http://wiki.apache.org/harmony/Apache_Derby.
> > > >
> > >
> >
> >
>
>
> --
> Leo Li
> China Software Development Lab, IBM
>
>
Re: Harmony passes 94% on derby tests.
Posted by Leo Li <li...@gmail.com>.
Hi, Vladimir:
Sorry for the delay.
I am willing to share my script. It will be great if we can use real
application as a supplement for our testcase.
But...actually, I am not quite sure about what the script is.:)
On 10/25/06, Vladimir Ivanov <iv...@gmail.com> wrote:
>
> Excellent!
>
>
>
> I have one more idea: we already have buildtest module. Some time ago we
> agreed to extends it by coverage and japi scripts (I hope it happens
> soon:)
> ). May be we extend it one more time and store here some scripts for
> automatic run of other-projects unit tests? Seems, in this case we can
> easily reproduce tests run and enable new platforms.
>
> Of cause, we can not cover all application but we can define some list of
> 'most important application'.
>
> Is it OK?
>
> Leo, could you share your script for Derby?
>
> Tony, could you share your scripts for ant and log4j?
>
>
>
> thanks, Vladimir
>
>
> PS. The directory structure may be something like that:
> builtest
> - trunk
> - cc
> - coverage
> - japi
> - application_test
> - derby
> - ant
> - etc
> - misc (some other scripts)
> On 10/25/06, Geir Magnusson Jr. <ge...@pobox.com> wrote:
> >
> > Nice work!
> >
> > More inline..
> >
> > Leo Li wrote:
> > > 467 Tests Run
> > > 94% Pass (443 tests passed)
> > > 6% Fail (24 tests failed)
> > > 5 Suites skipped
> > >
> > > The main progress focuses here:
> > > 1. Harmony classlib fails to load class when user-defined security
> > policy
> > > exists. It is due to the sequence of library loading of VM, which has
> > been
> > > resolved now.
> > > 2. A new workround for derby tests which allow useprocess to run test
> or
> > > else several testcases might fail due to derby lack these tests when
> > > useprocess = false.
> > > 3. Derby source code uses the version and the name of java vm to
> decide
> > > what
> > > to do, while current IBM VM has the version of "1.4.2" and the name of
> > > "j9",
> > > which has different output on the screen from that of standard RI 1.5.
> > At
> > > the same time Derby test compares the output of the iteractive test
> > scripts
> > > to that of expected. I have made some slight modification in its
> source
> > > code, but I have not throughly change this odd behavior, ...,too
> much:(
> >
> > Have you approached the derby community with the changes?
> >
> > >
> > > Besides, some testcase fails even on RI. I exclude
> > > a "derbynetclientmats" test suit since it will hang both RI and
> Harmony.
> > > Currently all the failure is irrelevant to Harmony. Hope I can find
> > > something in the left.
> > >
> > > I have updated the wiki of derby on Hamony:
> > > http://wiki.apache.org/harmony/Apache_Derby.
> > >
> >
>
>
--
Leo Li
China Software Development Lab, IBM
Re: Harmony passes 94% on derby tests.
Posted by Vladimir Ivanov <iv...@gmail.com>.
Excellent!
I have one more idea: we already have buildtest module. Some time ago we
agreed to extends it by coverage and japi scripts (I hope it happens soon:)
). May be we extend it one more time and store here some scripts for
automatic run of other-projects unit tests? Seems, in this case we can
easily reproduce tests run and enable new platforms.
Of cause, we can not cover all application but we can define some list of
'most important application'.
Is it OK?
Leo, could you share your script for Derby?
Tony, could you share your scripts for ant and log4j?
thanks, Vladimir
PS. The directory structure may be something like that:
builtest
- trunk
- cc
- coverage
- japi
- application_test
- derby
- ant
- etc
- misc (some other scripts)
On 10/25/06, Geir Magnusson Jr. <ge...@pobox.com> wrote:
>
> Nice work!
>
> More inline..
>
> Leo Li wrote:
> > 467 Tests Run
> > 94% Pass (443 tests passed)
> > 6% Fail (24 tests failed)
> > 5 Suites skipped
> >
> > The main progress focuses here:
> > 1. Harmony classlib fails to load class when user-defined security
> policy
> > exists. It is due to the sequence of library loading of VM, which has
> been
> > resolved now.
> > 2. A new workround for derby tests which allow useprocess to run test or
> > else several testcases might fail due to derby lack these tests when
> > useprocess = false.
> > 3. Derby source code uses the version and the name of java vm to decide
> > what
> > to do, while current IBM VM has the version of "1.4.2" and the name of
> > "j9",
> > which has different output on the screen from that of standard RI 1.5.
> At
> > the same time Derby test compares the output of the iteractive test
> scripts
> > to that of expected. I have made some slight modification in its source
> > code, but I have not throughly change this odd behavior, ...,too much:(
>
> Have you approached the derby community with the changes?
>
> >
> > Besides, some testcase fails even on RI. I exclude
> > a "derbynetclientmats" test suit since it will hang both RI and Harmony.
> > Currently all the failure is irrelevant to Harmony. Hope I can find
> > something in the left.
> >
> > I have updated the wiki of derby on Hamony:
> > http://wiki.apache.org/harmony/Apache_Derby.
> >
>