You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@harmony.apache.org by Stepan Mishura <st...@gmail.com> on 2007/12/11 11:31:39 UTC
[testing] M4 candidate (r602572) testing status.
Hi,
I compared the testing status for the last snapshot (r602572) [1] with
M3 status[2].
The brief status is:
* DRLVM tests:
- Windows_x86_64: 1 crashed test (intermittent? If not then M3 regression)
* Eclipse Unit Tests 3.3
- Linux_x86: 4 failures
- Windows_x86: 14 failures
- Linux_x86_64: the suite is rerun (previous snapshot has 94.07% pass rate)
* EGAx48:
- Linux_x86: failed
- Windows_x86: no status – the scenario causes CC host down after
running several hours
- Linux_x86_64: failed
* Eclipse TPTP Tests:
- Windows_x86: 1 intermittent failure.
* Functional Suite:
- Linux_x86: 8 failures – 4 M3 regressions, 2 M2 regressions, 1
intermittent (?)
- Windows_x86: 6 failures – 2 M3 regressions, 1 M2 regression, 1
intermittent (?)
- Linux_x86_64: 7 failures – 2 M3 regressions, 2 fails on M3 too, 2
intermittent (?)
- Windows_x86_64: 9 failures – 1 M3 regressions, 5 fails on M3 too,
1 intermittent (?)
* Geronimo Unit Tests: need investigation
* JDKTools Tests
- Windows_x86_64: 3 intermittent failures
* Jetty scenario
- Linux_x86: 1 intermittent failure.
* Reliability Test Suite
- Linux_x86: 17 failures – 10 M3 regressions, 7 fails on M3 too.
- Windows_x86: 12 failures – 10 M3 regressions, 2 fails on M3 too.
- Linux_x86_64: no status – CC host was down
* Stress Test Suite
- Linux_x86: 3 failures
- Windows_x86: 2 failures: 1 M3 regressions
- Linux_x86_64: 4 failures
- Windows_x86_64: 9 failures – 3 M3 regressions, 4 fails on M3 too
* Struts
- Linux_x86_64: 1 intermittent failure.
I'd like to encourage everyone to look into the failures and provide
more comments.
[1] http://people.apache.org/~mloenko/snapshot_testing/script/r602572/index.html
[2] http://people.apache.org/~mloenko/snapshot_testing/script/r580985/index.html
Thanks,
Stepan Mishura
Intel Enterprise Solutions Software Division
Re: [testing] M4 candidate (r602572) testing status.
Posted by "Pavlenko, Andrey A" <an...@googlemail.com>.
I've verified - the issue is not reproducible anymore.
On 12/12/07, Mikhail Fursov <mi...@gmail.com> wrote:
>
> >HARMONY-5290
> Must be fixed starting from 603534
>
> On Dec 12, 2007 4:09 PM, Pavlenko, Andrey A <
> andrey.a.pavlenko@googlemail.com> wrote:
>
> > Concerning the functional suite, there are 3 regressions:
> >
> > HARMONY-4857 - issue in third-party component, won't be fixed in M4
> > HARMONY-5283 - patch attached, but it was suggested to postpone the
> commit
> > HARMONY-5290 - patch attached, under testing. Should be fixed in M4.
> >
> >
> > On 12/11/07, Stepan Mishura <st...@gmail.com> wrote:
> > >
> > > Hi,
> > >
> > > I compared the testing status for the last snapshot (r602572) [1] with
> > > M3 status[2].
> > > The brief status is:
> > >
> > > * DRLVM tests:
> > > - Windows_x86_64: 1 crashed test (intermittent? If not then M3
> > > regression)
> > >
> > > * Eclipse Unit Tests 3.3
> > > - Linux_x86: 4 failures
> > > - Windows_x86: 14 failures
> > > - Linux_x86_64: the suite is rerun (previous snapshot has
> 94.07%pass
> > > rate)
> > >
> > > * EGAx48:
> > > - Linux_x86: failed
> > > - Windows_x86: no status – the scenario causes CC host down after
> > > running several hours
> > > - Linux_x86_64: failed
> > >
> > > * Eclipse TPTP Tests:
> > > - Windows_x86: 1 intermittent failure.
> > >
> > > * Functional Suite:
> > > - Linux_x86: 8 failures – 4 M3 regressions, 2 M2 regressions, 1
> > > intermittent (?)
> > > - Windows_x86: 6 failures – 2 M3 regressions, 1 M2 regression, 1
> > > intermittent (?)
> > > - Linux_x86_64: 7 failures – 2 M3 regressions, 2 fails on M3 too, 2
> > > intermittent (?)
> > > - Windows_x86_64: 9 failures – 1 M3 regressions, 5 fails on M3 too,
> > > 1 intermittent (?)
> > >
> > > * Geronimo Unit Tests: need investigation
> > >
> > > * JDKTools Tests
> > > - Windows_x86_64: 3 intermittent failures
> > >
> > > * Jetty scenario
> > > - Linux_x86: 1 intermittent failure.
> > >
> > > * Reliability Test Suite
> > > - Linux_x86: 17 failures – 10 M3 regressions, 7 fails on M3 too.
> > > - Windows_x86: 12 failures – 10 M3 regressions, 2 fails on M3 too.
> > > - Linux_x86_64: no status – CC host was down
> > >
> > > * Stress Test Suite
> > > - Linux_x86: 3 failures
> > > - Windows_x86: 2 failures: 1 M3 regressions
> > > - Linux_x86_64: 4 failures
> > > - Windows_x86_64: 9 failures – 3 M3 regressions, 4 fails on M3 too
> > >
> > > * Struts
> > > - Linux_x86_64: 1 intermittent failure.
> > >
> > > I'd like to encourage everyone to look into the failures and provide
> > > more comments.
> > >
> > > [1]
> > >
> >
> http://people.apache.org/~mloenko/snapshot_testing/script/r602572/index.html
> <
> http://people.apache.org/%7Emloenko/snapshot_testing/script/r602572/index.html
> >
> > > [2]
> > >
> >
> http://people.apache.org/~mloenko/snapshot_testing/script/r580985/index.html
> <
> http://people.apache.org/%7Emloenko/snapshot_testing/script/r580985/index.html
> >
> > >
> > > Thanks,
> > > Stepan Mishura
> > > Intel Enterprise Solutions Software Division
> > >
> >
>
>
>
> --
> Mikhail Fursov
>
Re: [testing] M4 candidate (r602572) testing status.
Posted by Mikhail Fursov <mi...@gmail.com>.
>HARMONY-5290
Must be fixed starting from 603534
On Dec 12, 2007 4:09 PM, Pavlenko, Andrey A <
andrey.a.pavlenko@googlemail.com> wrote:
> Concerning the functional suite, there are 3 regressions:
>
> HARMONY-4857 - issue in third-party component, won't be fixed in M4
> HARMONY-5283 - patch attached, but it was suggested to postpone the commit
> HARMONY-5290 - patch attached, under testing. Should be fixed in M4.
>
>
> On 12/11/07, Stepan Mishura <st...@gmail.com> wrote:
> >
> > Hi,
> >
> > I compared the testing status for the last snapshot (r602572) [1] with
> > M3 status[2].
> > The brief status is:
> >
> > * DRLVM tests:
> > - Windows_x86_64: 1 crashed test (intermittent? If not then M3
> > regression)
> >
> > * Eclipse Unit Tests 3.3
> > - Linux_x86: 4 failures
> > - Windows_x86: 14 failures
> > - Linux_x86_64: the suite is rerun (previous snapshot has 94.07%pass
> > rate)
> >
> > * EGAx48:
> > - Linux_x86: failed
> > - Windows_x86: no status – the scenario causes CC host down after
> > running several hours
> > - Linux_x86_64: failed
> >
> > * Eclipse TPTP Tests:
> > - Windows_x86: 1 intermittent failure.
> >
> > * Functional Suite:
> > - Linux_x86: 8 failures – 4 M3 regressions, 2 M2 regressions, 1
> > intermittent (?)
> > - Windows_x86: 6 failures – 2 M3 regressions, 1 M2 regression, 1
> > intermittent (?)
> > - Linux_x86_64: 7 failures – 2 M3 regressions, 2 fails on M3 too, 2
> > intermittent (?)
> > - Windows_x86_64: 9 failures – 1 M3 regressions, 5 fails on M3 too,
> > 1 intermittent (?)
> >
> > * Geronimo Unit Tests: need investigation
> >
> > * JDKTools Tests
> > - Windows_x86_64: 3 intermittent failures
> >
> > * Jetty scenario
> > - Linux_x86: 1 intermittent failure.
> >
> > * Reliability Test Suite
> > - Linux_x86: 17 failures – 10 M3 regressions, 7 fails on M3 too.
> > - Windows_x86: 12 failures – 10 M3 regressions, 2 fails on M3 too.
> > - Linux_x86_64: no status – CC host was down
> >
> > * Stress Test Suite
> > - Linux_x86: 3 failures
> > - Windows_x86: 2 failures: 1 M3 regressions
> > - Linux_x86_64: 4 failures
> > - Windows_x86_64: 9 failures – 3 M3 regressions, 4 fails on M3 too
> >
> > * Struts
> > - Linux_x86_64: 1 intermittent failure.
> >
> > I'd like to encourage everyone to look into the failures and provide
> > more comments.
> >
> > [1]
> >
> http://people.apache.org/~mloenko/snapshot_testing/script/r602572/index.html<http://people.apache.org/%7Emloenko/snapshot_testing/script/r602572/index.html>
> > [2]
> >
> http://people.apache.org/~mloenko/snapshot_testing/script/r580985/index.html<http://people.apache.org/%7Emloenko/snapshot_testing/script/r580985/index.html>
> >
> > Thanks,
> > Stepan Mishura
> > Intel Enterprise Solutions Software Division
> >
>
--
Mikhail Fursov
Re: [testing] M4 candidate (r602572) testing status.
Posted by "Pavlenko, Andrey A" <an...@googlemail.com>.
Concerning the functional suite, there are 3 regressions:
HARMONY-4857 - issue in third-party component, won't be fixed in M4
HARMONY-5283 - patch attached, but it was suggested to postpone the commit
HARMONY-5290 - patch attached, under testing. Should be fixed in M4.
On 12/11/07, Stepan Mishura <st...@gmail.com> wrote:
>
> Hi,
>
> I compared the testing status for the last snapshot (r602572) [1] with
> M3 status[2].
> The brief status is:
>
> * DRLVM tests:
> - Windows_x86_64: 1 crashed test (intermittent? If not then M3
> regression)
>
> * Eclipse Unit Tests 3.3
> - Linux_x86: 4 failures
> - Windows_x86: 14 failures
> - Linux_x86_64: the suite is rerun (previous snapshot has 94.07% pass
> rate)
>
> * EGAx48:
> - Linux_x86: failed
> - Windows_x86: no status – the scenario causes CC host down after
> running several hours
> - Linux_x86_64: failed
>
> * Eclipse TPTP Tests:
> - Windows_x86: 1 intermittent failure.
>
> * Functional Suite:
> - Linux_x86: 8 failures – 4 M3 regressions, 2 M2 regressions, 1
> intermittent (?)
> - Windows_x86: 6 failures – 2 M3 regressions, 1 M2 regression, 1
> intermittent (?)
> - Linux_x86_64: 7 failures – 2 M3 regressions, 2 fails on M3 too, 2
> intermittent (?)
> - Windows_x86_64: 9 failures – 1 M3 regressions, 5 fails on M3 too,
> 1 intermittent (?)
>
> * Geronimo Unit Tests: need investigation
>
> * JDKTools Tests
> - Windows_x86_64: 3 intermittent failures
>
> * Jetty scenario
> - Linux_x86: 1 intermittent failure.
>
> * Reliability Test Suite
> - Linux_x86: 17 failures – 10 M3 regressions, 7 fails on M3 too.
> - Windows_x86: 12 failures – 10 M3 regressions, 2 fails on M3 too.
> - Linux_x86_64: no status – CC host was down
>
> * Stress Test Suite
> - Linux_x86: 3 failures
> - Windows_x86: 2 failures: 1 M3 regressions
> - Linux_x86_64: 4 failures
> - Windows_x86_64: 9 failures – 3 M3 regressions, 4 fails on M3 too
>
> * Struts
> - Linux_x86_64: 1 intermittent failure.
>
> I'd like to encourage everyone to look into the failures and provide
> more comments.
>
> [1]
> http://people.apache.org/~mloenko/snapshot_testing/script/r602572/index.html
> [2]
> http://people.apache.org/~mloenko/snapshot_testing/script/r580985/index.html
>
> Thanks,
> Stepan Mishura
> Intel Enterprise Solutions Software Division
>
Re: [testing] M4 candidate (r602572) testing status.
Posted by Tim Ellison <t....@gmail.com>.
Excellent summary Stepan, thank you.
I'll take a look and raise JIRAs for things I see that are broken.
Regards,
Tim
Stepan Mishura wrote:
> Hi,
>
> I compared the testing status for the last snapshot (r602572) [1] with
> M3 status[2].
> The brief status is:
>
> * DRLVM tests:
> - Windows_x86_64: 1 crashed test (intermittent? If not then M3 regression)
>
> * Eclipse Unit Tests 3.3
> - Linux_x86: 4 failures
> - Windows_x86: 14 failures
> - Linux_x86_64: the suite is rerun (previous snapshot has 94.07% pass rate)
>
> * EGAx48:
> - Linux_x86: failed
> - Windows_x86: no status – the scenario causes CC host down after
> running several hours
> - Linux_x86_64: failed
>
> * Eclipse TPTP Tests:
> - Windows_x86: 1 intermittent failure.
>
> * Functional Suite:
> - Linux_x86: 8 failures – 4 M3 regressions, 2 M2 regressions, 1
> intermittent (?)
> - Windows_x86: 6 failures – 2 M3 regressions, 1 M2 regression, 1
> intermittent (?)
> - Linux_x86_64: 7 failures – 2 M3 regressions, 2 fails on M3 too, 2
> intermittent (?)
> - Windows_x86_64: 9 failures – 1 M3 regressions, 5 fails on M3 too,
> 1 intermittent (?)
>
> * Geronimo Unit Tests: need investigation
>
> * JDKTools Tests
> - Windows_x86_64: 3 intermittent failures
>
> * Jetty scenario
> - Linux_x86: 1 intermittent failure.
>
> * Reliability Test Suite
> - Linux_x86: 17 failures – 10 M3 regressions, 7 fails on M3 too.
> - Windows_x86: 12 failures – 10 M3 regressions, 2 fails on M3 too.
> - Linux_x86_64: no status – CC host was down
>
> * Stress Test Suite
> - Linux_x86: 3 failures
> - Windows_x86: 2 failures: 1 M3 regressions
> - Linux_x86_64: 4 failures
> - Windows_x86_64: 9 failures – 3 M3 regressions, 4 fails on M3 too
>
> * Struts
> - Linux_x86_64: 1 intermittent failure.
>
> I'd like to encourage everyone to look into the failures and provide
> more comments.
>
> [1] http://people.apache.org/~mloenko/snapshot_testing/script/r602572/index.html
> [2] http://people.apache.org/~mloenko/snapshot_testing/script/r580985/index.html
>
> Thanks,
> Stepan Mishura
> Intel Enterprise Solutions Software Division
>