You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@harmony.apache.org by Nina Rinskaya <ni...@gmail.com> on 2006/11/02 14:15:26 UTC
Re: Harmony passes 94% on derby tests.
Hi,
I might have chosen the wrong thread for this message, but this is
about another well-known unit tests suite - Eclipse Unit Tests. I've
recently filed new JIRA issue
(https://issues.apache.org/jira/browse/HARMONY-2038) with the ant
script to run EUT on Harmony. Does it make sense to integrate it to
the buildtest module?
For a moment EUT pass rate on Harmony is ~77%. EUT runs results (on
Linux/ia32 and windows/ia32) are being updated on wiki:
http://wiki.apache.org/harmony/Eclipse_Unit_Tests_Pass_on_DRLVM
A number of EUT test cases fail on Harmony because EUT uses some
hard-coded Sun/Jrockit classlibs names. In particular,
org.eclipse.jdt.core.tests.util.Util class uses specific paths to
class libraries jar files (<JRE_HOME>/lib/rt.jar, for example).
org.eclipse.jdt.core.tests.runtime.*VMLauncher classes use "javaw" as
vm executable name that is missing in Harmony bundle. So what I would
like to do now is to patch EUT to invoke Harmony correctly if it is ok
with everyone here.
Best regards,
Nina
On 10/25/06, Vladimir Ivanov <iv...@gmail.com> wrote:
> Excellent!
>
>
>
> I have one more idea: we already have buildtest module. Some time ago we
> agreed to extends it by coverage and japi scripts (I hope it happens soon:)
> ). May be we extend it one more time and store here some scripts for
> automatic run of other-projects unit tests? Seems, in this case we can
> easily reproduce tests run and enable new platforms.
>
> Of cause, we can not cover all application but we can define some list of
> 'most important application'.
>
> Is it OK?
>
> Leo, could you share your script for Derby?
>
> Tony, could you share your scripts for ant and log4j?
>
>
>
> thanks, Vladimir
>
>
> PS. The directory structure may be something like that:
> builtest
> - trunk
> - cc
> - coverage
> - japi
> - application_test
> - derby
> - ant
> - etc
> - misc (some other scripts)
> On 10/25/06, Geir Magnusson Jr. <ge...@pobox.com> wrote:
> >
> > Nice work!
> >
> > More inline..
> >
> > Leo Li wrote:
> > > 467 Tests Run
> > > 94% Pass (443 tests passed)
> > > 6% Fail (24 tests failed)
> > > 5 Suites skipped
> > >
> > > The main progress focuses here:
> > > 1. Harmony classlib fails to load class when user-defined security
> > policy
> > > exists. It is due to the sequence of library loading of VM, which has
> > been
> > > resolved now.
> > > 2. A new workround for derby tests which allow useprocess to run test or
> > > else several testcases might fail due to derby lack these tests when
> > > useprocess = false.
> > > 3. Derby source code uses the version and the name of java vm to decide
> > > what
> > > to do, while current IBM VM has the version of "1.4.2" and the name of
> > > "j9",
> > > which has different output on the screen from that of standard RI 1.5.
> > At
> > > the same time Derby test compares the output of the iteractive test
> > scripts
> > > to that of expected. I have made some slight modification in its source
> > > code, but I have not throughly change this odd behavior, ...,too much:(
> >
> > Have you approached the derby community with the changes?
> >
> > >
> > > Besides, some testcase fails even on RI. I exclude
> > > a "derbynetclientmats" test suit since it will hang both RI and Harmony.
> > > Currently all the failure is irrelevant to Harmony. Hope I can find
> > > something in the left.
> > >
> > > I have updated the wiki of derby on Hamony:
> > > http://wiki.apache.org/harmony/Apache_Derby.
> > >
> >
>
>
Re: Harmony passes 94% on derby tests.
Posted by Vladimir Ivanov <iv...@gmail.com>.
Nice work!
Thanks, Vladimir
On 11/2/06, Nina Rinskaya <ni...@gmail.com> wrote:
>
> Hi,
>
> I might have chosen the wrong thread for this message, but this is
> about another well-known unit tests suite - Eclipse Unit Tests. I've
> recently filed new JIRA issue
> (https://issues.apache.org/jira/browse/HARMONY-2038) with the ant
> script to run EUT on Harmony. Does it make sense to integrate it to
> the buildtest module?
>
> For a moment EUT pass rate on Harmony is ~77%. EUT runs results (on
> Linux/ia32 and windows/ia32) are being updated on wiki:
> http://wiki.apache.org/harmony/Eclipse_Unit_Tests_Pass_on_DRLVM
>
> A number of EUT test cases fail on Harmony because EUT uses some
> hard-coded Sun/Jrockit classlibs names. In particular,
> org.eclipse.jdt.core.tests.util.Util class uses specific paths to
> class libraries jar files (<JRE_HOME>/lib/rt.jar, for example).
> org.eclipse.jdt.core.tests.runtime.*VMLauncher classes use "javaw" as
> vm executable name that is missing in Harmony bundle. So what I would
> like to do now is to patch EUT to invoke Harmony correctly if it is ok
> with everyone here.
>
> Best regards,
> Nina
>
> On 10/25/06, Vladimir Ivanov <iv...@gmail.com> wrote:
> > Excellent!
> >
> >
> >
> > I have one more idea: we already have buildtest module. Some time ago we
> > agreed to extends it by coverage and japi scripts (I hope it happens
> soon:)
> > ). May be we extend it one more time and store here some scripts for
> > automatic run of other-projects unit tests? Seems, in this case we can
> > easily reproduce tests run and enable new platforms.
> >
> > Of cause, we can not cover all application but we can define some list
> of
> > 'most important application'.
> >
> > Is it OK?
> >
> > Leo, could you share your script for Derby?
> >
> > Tony, could you share your scripts for ant and log4j?
> >
> >
> >
> > thanks, Vladimir
> >
> >
> > PS. The directory structure may be something like that:
> > builtest
> > - trunk
> > - cc
> > - coverage
> > - japi
> > - application_test
> > - derby
> > - ant
> > - etc
> > - misc (some other scripts)
> > On 10/25/06, Geir Magnusson Jr. <ge...@pobox.com> wrote:
> > >
> > > Nice work!
> > >
> > > More inline..
> > >
> > > Leo Li wrote:
> > > > 467 Tests Run
> > > > 94% Pass (443 tests passed)
> > > > 6% Fail (24 tests failed)
> > > > 5 Suites skipped
> > > >
> > > > The main progress focuses here:
> > > > 1. Harmony classlib fails to load class when user-defined security
> > > policy
> > > > exists. It is due to the sequence of library loading of VM, which
> has
> > > been
> > > > resolved now.
> > > > 2. A new workround for derby tests which allow useprocess to run
> test or
> > > > else several testcases might fail due to derby lack these tests when
> > > > useprocess = false.
> > > > 3. Derby source code uses the version and the name of java vm to
> decide
> > > > what
> > > > to do, while current IBM VM has the version of "1.4.2" and the name
> of
> > > > "j9",
> > > > which has different output on the screen from that of standard RI
> 1.5.
> > > At
> > > > the same time Derby test compares the output of the iteractive test
> > > scripts
> > > > to that of expected. I have made some slight modification in its
> source
> > > > code, but I have not throughly change this odd behavior, ...,too
> much:(
> > >
> > > Have you approached the derby community with the changes?
> > >
> > > >
> > > > Besides, some testcase fails even on RI. I exclude
> > > > a "derbynetclientmats" test suit since it will hang both RI and
> Harmony.
> > > > Currently all the failure is irrelevant to Harmony. Hope I can find
> > > > something in the left.
> > > >
> > > > I have updated the wiki of derby on Hamony:
> > > > http://wiki.apache.org/harmony/Apache_Derby.
> > > >
> > >
> >
> >
>
Re: Harmony passes 94% on derby tests.
Posted by Alexey Varlamov <al...@gmail.com>.
2006/11/7, Nina Rinskaya <ni...@gmail.com>:
> Thanks for your reply! And I agree that the right thing is to file
> bugs on EUT. But maybe it is ok to make the patches first as a
> temporary workaround just to be able to run EUT on Harmony and not to
> wait too long for EUT bugs fixes? Does it make sense?
>
Sure, the patches would be useful even if just hanging in a JIRA. I
suggest to separate issues intended for commit from temporary stuff,
please file additional JIRA for the last.
--
Best regards,
Alexey
> Thanks,
> Nina
>
> On 11/3/06, Alexey Varlamov <al...@gmail.com> wrote:
> > +1 to integration. As for the patches, I'd rather suggest filing bugs
> > on EUT and let respective community to resolve those issue for good -
> > either find more universal approach (like java.management or JVMTI
> > features) or hardcode harmony too :).
> >
> > Thanks for spending these efforts, anyway!
> >
> > 03 Nov 2006 14:01:14 +0600, Egor Pasko <eg...@gmail.com>:
> > > On the 0x215 day of Apache Harmony Nina Rinskaya wrote:
> > > > Hi,
> > > >
> > > > I might have chosen the wrong thread for this message, but this is
> > > > about another well-known unit tests suite - Eclipse Unit Tests. I've
> > > > recently filed new JIRA issue
> > > > (https://issues.apache.org/jira/browse/HARMONY-2038) with the ant
> > > > script to run EUT on Harmony. Does it make sense to integrate it to
> > > > the buildtest module?
> > >
> > > I think, yes!
> > >
> > > > For a moment EUT pass rate on Harmony is ~77%. EUT runs results (on
> > > > Linux/ia32 and windows/ia32) are being updated on wiki:
> > > > http://wiki.apache.org/harmony/Eclipse_Unit_Tests_Pass_on_DRLVM
> > > >
> > > > A number of EUT test cases fail on Harmony because EUT uses some
> > > > hard-coded Sun/Jrockit classlibs names. In particular,
> > > > org.eclipse.jdt.core.tests.util.Util class uses specific paths to
> > > > class libraries jar files (<JRE_HOME>/lib/rt.jar, for example).
> > > > org.eclipse.jdt.core.tests.runtime.*VMLauncher classes use "javaw" as
> > > > vm executable name that is missing in Harmony bundle. So what I would
> > > > like to do now is to patch EUT to invoke Harmony correctly if it is ok
> > > > with everyone here.
> > > >
> > > > Best regards,
> > > > Nina
> > > >
> > > > On 10/25/06, Vladimir Ivanov <iv...@gmail.com> wrote:
> > > > > Excellent!
> > > > >
> > > > >
> > > > >
> > > > > I have one more idea: we already have buildtest module. Some time ago we
> > > > > agreed to extends it by coverage and japi scripts (I hope it happens soon:)
> > > > > ). May be we extend it one more time and store here some scripts for
> > > > > automatic run of other-projects unit tests? Seems, in this case we can
> > > > > easily reproduce tests run and enable new platforms.
> > > > >
> > > > > Of cause, we can not cover all application but we can define some list of
> > > > > 'most important application'.
> > > > >
> > > > > Is it OK?
> > > > >
> > > > > Leo, could you share your script for Derby?
> > > > >
> > > > > Tony, could you share your scripts for ant and log4j?
> > > > >
> > > > >
> > > > >
> > > > > thanks, Vladimir
> > > > >
> > > > >
> > > > > PS. The directory structure may be something like that:
> > > > > builtest
> > > > > - trunk
> > > > > - cc
> > > > > - coverage
> > > > > - japi
> > > > > - application_test
> > > > > - derby
> > > > > - ant
> > > > > - etc
> > > > > - misc (some other scripts)
> > > > > On 10/25/06, Geir Magnusson Jr. <ge...@pobox.com> wrote:
> > > > > >
> > > > > > Nice work!
> > > > > >
> > > > > > More inline..
> > > > > >
> > > > > > Leo Li wrote:
> > > > > > > 467 Tests Run
> > > > > > > 94% Pass (443 tests passed)
> > > > > > > 6% Fail (24 tests failed)
> > > > > > > 5 Suites skipped
> > > > > > >
> > > > > > > The main progress focuses here:
> > > > > > > 1. Harmony classlib fails to load class when user-defined security
> > > > > > policy
> > > > > > > exists. It is due to the sequence of library loading of VM, which has
> > > > > > been
> > > > > > > resolved now.
> > > > > > > 2. A new workround for derby tests which allow useprocess to run test or
> > > > > > > else several testcases might fail due to derby lack these tests when
> > > > > > > useprocess = false.
> > > > > > > 3. Derby source code uses the version and the name of java vm to decide
> > > > > > > what
> > > > > > > to do, while current IBM VM has the version of "1.4.2" and the name of
> > > > > > > "j9",
> > > > > > > which has different output on the screen from that of standard RI 1.5.
> > > > > > At
> > > > > > > the same time Derby test compares the output of the iteractive test
> > > > > > scripts
> > > > > > > to that of expected. I have made some slight modification in its source
> > > > > > > code, but I have not throughly change this odd behavior, ...,too much:(
> > > > > >
> > > > > > Have you approached the derby community with the changes?
> > > > > >
> > > > > > >
> > > > > > > Besides, some testcase fails even on RI. I exclude
> > > > > > > a "derbynetclientmats" test suit since it will hang both RI and Harmony.
> > > > > > > Currently all the failure is irrelevant to Harmony. Hope I can find
> > > > > > > something in the left.
> > > > > > >
> > > > > > > I have updated the wiki of derby on Hamony:
> > > > > > > http://wiki.apache.org/harmony/Apache_Derby.
> > > > > > >
> > > > > >
> > > > >
> > > > >
> > > >
> > >
> > > --
> > > Egor Pasko
> > >
> > >
> >
>
Re: Harmony passes 94% on derby tests.
Posted by Nina Rinskaya <ni...@gmail.com>.
Thanks for your reply! And I agree that the right thing is to file
bugs on EUT. But maybe it is ok to make the patches first as a
temporary workaround just to be able to run EUT on Harmony and not to
wait too long for EUT bugs fixes? Does it make sense?
Thanks,
Nina
On 11/3/06, Alexey Varlamov <al...@gmail.com> wrote:
> +1 to integration. As for the patches, I'd rather suggest filing bugs
> on EUT and let respective community to resolve those issue for good -
> either find more universal approach (like java.management or JVMTI
> features) or hardcode harmony too :).
>
> Thanks for spending these efforts, anyway!
>
> 03 Nov 2006 14:01:14 +0600, Egor Pasko <eg...@gmail.com>:
> > On the 0x215 day of Apache Harmony Nina Rinskaya wrote:
> > > Hi,
> > >
> > > I might have chosen the wrong thread for this message, but this is
> > > about another well-known unit tests suite - Eclipse Unit Tests. I've
> > > recently filed new JIRA issue
> > > (https://issues.apache.org/jira/browse/HARMONY-2038) with the ant
> > > script to run EUT on Harmony. Does it make sense to integrate it to
> > > the buildtest module?
> >
> > I think, yes!
> >
> > > For a moment EUT pass rate on Harmony is ~77%. EUT runs results (on
> > > Linux/ia32 and windows/ia32) are being updated on wiki:
> > > http://wiki.apache.org/harmony/Eclipse_Unit_Tests_Pass_on_DRLVM
> > >
> > > A number of EUT test cases fail on Harmony because EUT uses some
> > > hard-coded Sun/Jrockit classlibs names. In particular,
> > > org.eclipse.jdt.core.tests.util.Util class uses specific paths to
> > > class libraries jar files (<JRE_HOME>/lib/rt.jar, for example).
> > > org.eclipse.jdt.core.tests.runtime.*VMLauncher classes use "javaw" as
> > > vm executable name that is missing in Harmony bundle. So what I would
> > > like to do now is to patch EUT to invoke Harmony correctly if it is ok
> > > with everyone here.
> > >
> > > Best regards,
> > > Nina
> > >
> > > On 10/25/06, Vladimir Ivanov <iv...@gmail.com> wrote:
> > > > Excellent!
> > > >
> > > >
> > > >
> > > > I have one more idea: we already have buildtest module. Some time ago we
> > > > agreed to extends it by coverage and japi scripts (I hope it happens soon:)
> > > > ). May be we extend it one more time and store here some scripts for
> > > > automatic run of other-projects unit tests? Seems, in this case we can
> > > > easily reproduce tests run and enable new platforms.
> > > >
> > > > Of cause, we can not cover all application but we can define some list of
> > > > 'most important application'.
> > > >
> > > > Is it OK?
> > > >
> > > > Leo, could you share your script for Derby?
> > > >
> > > > Tony, could you share your scripts for ant and log4j?
> > > >
> > > >
> > > >
> > > > thanks, Vladimir
> > > >
> > > >
> > > > PS. The directory structure may be something like that:
> > > > builtest
> > > > - trunk
> > > > - cc
> > > > - coverage
> > > > - japi
> > > > - application_test
> > > > - derby
> > > > - ant
> > > > - etc
> > > > - misc (some other scripts)
> > > > On 10/25/06, Geir Magnusson Jr. <ge...@pobox.com> wrote:
> > > > >
> > > > > Nice work!
> > > > >
> > > > > More inline..
> > > > >
> > > > > Leo Li wrote:
> > > > > > 467 Tests Run
> > > > > > 94% Pass (443 tests passed)
> > > > > > 6% Fail (24 tests failed)
> > > > > > 5 Suites skipped
> > > > > >
> > > > > > The main progress focuses here:
> > > > > > 1. Harmony classlib fails to load class when user-defined security
> > > > > policy
> > > > > > exists. It is due to the sequence of library loading of VM, which has
> > > > > been
> > > > > > resolved now.
> > > > > > 2. A new workround for derby tests which allow useprocess to run test or
> > > > > > else several testcases might fail due to derby lack these tests when
> > > > > > useprocess = false.
> > > > > > 3. Derby source code uses the version and the name of java vm to decide
> > > > > > what
> > > > > > to do, while current IBM VM has the version of "1.4.2" and the name of
> > > > > > "j9",
> > > > > > which has different output on the screen from that of standard RI 1.5.
> > > > > At
> > > > > > the same time Derby test compares the output of the iteractive test
> > > > > scripts
> > > > > > to that of expected. I have made some slight modification in its source
> > > > > > code, but I have not throughly change this odd behavior, ...,too much:(
> > > > >
> > > > > Have you approached the derby community with the changes?
> > > > >
> > > > > >
> > > > > > Besides, some testcase fails even on RI. I exclude
> > > > > > a "derbynetclientmats" test suit since it will hang both RI and Harmony.
> > > > > > Currently all the failure is irrelevant to Harmony. Hope I can find
> > > > > > something in the left.
> > > > > >
> > > > > > I have updated the wiki of derby on Hamony:
> > > > > > http://wiki.apache.org/harmony/Apache_Derby.
> > > > > >
> > > > >
> > > >
> > > >
> > >
> >
> > --
> > Egor Pasko
> >
> >
>
Re: Harmony passes 94% on derby tests.
Posted by Alexey Varlamov <al...@gmail.com>.
+1 to integration. As for the patches, I'd rather suggest filing bugs
on EUT and let respective community to resolve those issue for good -
either find more universal approach (like java.management or JVMTI
features) or hardcode harmony too :).
Thanks for spending these efforts, anyway!
03 Nov 2006 14:01:14 +0600, Egor Pasko <eg...@gmail.com>:
> On the 0x215 day of Apache Harmony Nina Rinskaya wrote:
> > Hi,
> >
> > I might have chosen the wrong thread for this message, but this is
> > about another well-known unit tests suite - Eclipse Unit Tests. I've
> > recently filed new JIRA issue
> > (https://issues.apache.org/jira/browse/HARMONY-2038) with the ant
> > script to run EUT on Harmony. Does it make sense to integrate it to
> > the buildtest module?
>
> I think, yes!
>
> > For a moment EUT pass rate on Harmony is ~77%. EUT runs results (on
> > Linux/ia32 and windows/ia32) are being updated on wiki:
> > http://wiki.apache.org/harmony/Eclipse_Unit_Tests_Pass_on_DRLVM
> >
> > A number of EUT test cases fail on Harmony because EUT uses some
> > hard-coded Sun/Jrockit classlibs names. In particular,
> > org.eclipse.jdt.core.tests.util.Util class uses specific paths to
> > class libraries jar files (<JRE_HOME>/lib/rt.jar, for example).
> > org.eclipse.jdt.core.tests.runtime.*VMLauncher classes use "javaw" as
> > vm executable name that is missing in Harmony bundle. So what I would
> > like to do now is to patch EUT to invoke Harmony correctly if it is ok
> > with everyone here.
> >
> > Best regards,
> > Nina
> >
> > On 10/25/06, Vladimir Ivanov <iv...@gmail.com> wrote:
> > > Excellent!
> > >
> > >
> > >
> > > I have one more idea: we already have buildtest module. Some time ago we
> > > agreed to extends it by coverage and japi scripts (I hope it happens soon:)
> > > ). May be we extend it one more time and store here some scripts for
> > > automatic run of other-projects unit tests? Seems, in this case we can
> > > easily reproduce tests run and enable new platforms.
> > >
> > > Of cause, we can not cover all application but we can define some list of
> > > 'most important application'.
> > >
> > > Is it OK?
> > >
> > > Leo, could you share your script for Derby?
> > >
> > > Tony, could you share your scripts for ant and log4j?
> > >
> > >
> > >
> > > thanks, Vladimir
> > >
> > >
> > > PS. The directory structure may be something like that:
> > > builtest
> > > - trunk
> > > - cc
> > > - coverage
> > > - japi
> > > - application_test
> > > - derby
> > > - ant
> > > - etc
> > > - misc (some other scripts)
> > > On 10/25/06, Geir Magnusson Jr. <ge...@pobox.com> wrote:
> > > >
> > > > Nice work!
> > > >
> > > > More inline..
> > > >
> > > > Leo Li wrote:
> > > > > 467 Tests Run
> > > > > 94% Pass (443 tests passed)
> > > > > 6% Fail (24 tests failed)
> > > > > 5 Suites skipped
> > > > >
> > > > > The main progress focuses here:
> > > > > 1. Harmony classlib fails to load class when user-defined security
> > > > policy
> > > > > exists. It is due to the sequence of library loading of VM, which has
> > > > been
> > > > > resolved now.
> > > > > 2. A new workround for derby tests which allow useprocess to run test or
> > > > > else several testcases might fail due to derby lack these tests when
> > > > > useprocess = false.
> > > > > 3. Derby source code uses the version and the name of java vm to decide
> > > > > what
> > > > > to do, while current IBM VM has the version of "1.4.2" and the name of
> > > > > "j9",
> > > > > which has different output on the screen from that of standard RI 1.5.
> > > > At
> > > > > the same time Derby test compares the output of the iteractive test
> > > > scripts
> > > > > to that of expected. I have made some slight modification in its source
> > > > > code, but I have not throughly change this odd behavior, ...,too much:(
> > > >
> > > > Have you approached the derby community with the changes?
> > > >
> > > > >
> > > > > Besides, some testcase fails even on RI. I exclude
> > > > > a "derbynetclientmats" test suit since it will hang both RI and Harmony.
> > > > > Currently all the failure is irrelevant to Harmony. Hope I can find
> > > > > something in the left.
> > > > >
> > > > > I have updated the wiki of derby on Hamony:
> > > > > http://wiki.apache.org/harmony/Apache_Derby.
> > > > >
> > > >
> > >
> > >
> >
>
> --
> Egor Pasko
>
>
Re: Harmony passes 94% on derby tests.
Posted by Egor Pasko <eg...@gmail.com>.
On the 0x215 day of Apache Harmony Nina Rinskaya wrote:
> Hi,
>
> I might have chosen the wrong thread for this message, but this is
> about another well-known unit tests suite - Eclipse Unit Tests. I've
> recently filed new JIRA issue
> (https://issues.apache.org/jira/browse/HARMONY-2038) with the ant
> script to run EUT on Harmony. Does it make sense to integrate it to
> the buildtest module?
I think, yes!
> For a moment EUT pass rate on Harmony is ~77%. EUT runs results (on
> Linux/ia32 and windows/ia32) are being updated on wiki:
> http://wiki.apache.org/harmony/Eclipse_Unit_Tests_Pass_on_DRLVM
>
> A number of EUT test cases fail on Harmony because EUT uses some
> hard-coded Sun/Jrockit classlibs names. In particular,
> org.eclipse.jdt.core.tests.util.Util class uses specific paths to
> class libraries jar files (<JRE_HOME>/lib/rt.jar, for example).
> org.eclipse.jdt.core.tests.runtime.*VMLauncher classes use "javaw" as
> vm executable name that is missing in Harmony bundle. So what I would
> like to do now is to patch EUT to invoke Harmony correctly if it is ok
> with everyone here.
>
> Best regards,
> Nina
>
> On 10/25/06, Vladimir Ivanov <iv...@gmail.com> wrote:
> > Excellent!
> >
> >
> >
> > I have one more idea: we already have buildtest module. Some time ago we
> > agreed to extends it by coverage and japi scripts (I hope it happens soon:)
> > ). May be we extend it one more time and store here some scripts for
> > automatic run of other-projects unit tests? Seems, in this case we can
> > easily reproduce tests run and enable new platforms.
> >
> > Of cause, we can not cover all application but we can define some list of
> > 'most important application'.
> >
> > Is it OK?
> >
> > Leo, could you share your script for Derby?
> >
> > Tony, could you share your scripts for ant and log4j?
> >
> >
> >
> > thanks, Vladimir
> >
> >
> > PS. The directory structure may be something like that:
> > builtest
> > - trunk
> > - cc
> > - coverage
> > - japi
> > - application_test
> > - derby
> > - ant
> > - etc
> > - misc (some other scripts)
> > On 10/25/06, Geir Magnusson Jr. <ge...@pobox.com> wrote:
> > >
> > > Nice work!
> > >
> > > More inline..
> > >
> > > Leo Li wrote:
> > > > 467 Tests Run
> > > > 94% Pass (443 tests passed)
> > > > 6% Fail (24 tests failed)
> > > > 5 Suites skipped
> > > >
> > > > The main progress focuses here:
> > > > 1. Harmony classlib fails to load class when user-defined security
> > > policy
> > > > exists. It is due to the sequence of library loading of VM, which has
> > > been
> > > > resolved now.
> > > > 2. A new workround for derby tests which allow useprocess to run test or
> > > > else several testcases might fail due to derby lack these tests when
> > > > useprocess = false.
> > > > 3. Derby source code uses the version and the name of java vm to decide
> > > > what
> > > > to do, while current IBM VM has the version of "1.4.2" and the name of
> > > > "j9",
> > > > which has different output on the screen from that of standard RI 1.5.
> > > At
> > > > the same time Derby test compares the output of the iteractive test
> > > scripts
> > > > to that of expected. I have made some slight modification in its source
> > > > code, but I have not throughly change this odd behavior, ...,too much:(
> > >
> > > Have you approached the derby community with the changes?
> > >
> > > >
> > > > Besides, some testcase fails even on RI. I exclude
> > > > a "derbynetclientmats" test suit since it will hang both RI and Harmony.
> > > > Currently all the failure is irrelevant to Harmony. Hope I can find
> > > > something in the left.
> > > >
> > > > I have updated the wiki of derby on Hamony:
> > > > http://wiki.apache.org/harmony/Apache_Derby.
> > > >
> > >
> >
> >
>
--
Egor Pasko