You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@harmony.apache.org by Nina Rinskaya <ni...@gmail.com> on 2007/03/06 10:30:26 UTC
Re: [testing] Eclipse Unit Tests run under Cruise Control
Hi,
As it was discussed above in this thread, I'd like to start sending
Cruise Control notifications about Eclipse Unit Tests failures to
alerts@harmony.apache.org (if nobody minds).
I'm running EUT under Cruise Control on Linux (SLES9) IA32 and Windows
XP IA32. A number of EUT suites that fail/crash are excluded from the
regular runs in order to have all tests passed as a normal state and
thus to monitor regression failures. Note that the number of excluded
tests is large now, because I didn't find an easy way to exclude
tests, not test suites, and I'm excluding the whole suite if it has 1
failing testcase. I'll try to work on exlude list clean-up and on
finding better way to exclude single tests.
I hope that everything would work ok, but I'd like to apologize in
advance for possible junk mail (false failure notifications) in
alerts@harmony.apache.org mailing list.
--
Thanks,
Nina
On 12/22/06, Nina Rinskaya <ni...@gmail.com> wrote:
> Hi all,
>
> That's just to let you know that I run Eclipse Unit Tests under Cruise
> Control on Linux (SLES 9)/ia32 and windows (xp)/ia32. During last 10
> days Alexey Ignatenko and I worked on enabling EUT on Harmony and have
> increased EUT pass rate from ~60% up to 93-95% (not taking into
> account some intermittent failures). Many-many thanks to Alexey
> Ignatenko for all his great work.
>
> Does it make sense to report EUT regressions to the mailing list?
>
> Well, first try. Today my local Cruise Control reported significant
> EUT pass rate downgrade with similar failures logs, and Eclipse failed
> to start (silently died after "Select Workspace" dialog). It looks
> like it is caused by commit r489307 - just comparing classlib
> rollbacks to r489307 (Eclipse dies, some EUT tests fail) and r489306
> (Eclipse 'Hello world' passes, EUT tests pass as usually). Could
> anybody take a look at this issue please?
>
> Thanks,
> Nina
>
Re: [testing] Eclipse Unit Tests run under Cruise Control
Posted by Nina Rinskaya <ni...@gmail.com>.
On 3/7/07, Geir Magnusson Jr. <ge...@pobox.com> wrote:
>
> On Mar 6, 2007, at 4:30 AM, Nina Rinskaya wrote:
>
> > Hi,
> >
> > As it was discussed above in this thread, I'd like to start sending
> > Cruise Control notifications about Eclipse Unit Tests failures to
> > alerts@harmony.apache.org (if nobody minds).
>
> Go for it
>
> >
> > I'm running EUT under Cruise Control on Linux (SLES9) IA32 and Windows
> > XP IA32. A number of EUT suites that fail/crash are excluded from the
> > regular runs in order to have all tests passed as a normal state and
> > thus to monitor regression failures. Note that the number of excluded
> > tests is large now, because I didn't find an easy way to exclude
> > tests, not test suites, and I'm excluding the whole suite if it has 1
> > failing testcase. I'll try to work on exlude list clean-up and on
> > finding better way to exclude single tests.
> >
> > I hope that everything would work ok, but I'd like to apologize in
> > advance for possible junk mail (false failure notifications) in
> > alerts@harmony.apache.org mailing list.
>
> it's already a mess :)
>
> Can anyone do this? is the code/config in JIRA or SVN ?
The patch for "buildtest" that adds Eclipse Unit Tests runs to CC is
submitted to JIRA (HARMONY-2687), but it looks that it should be
updated if buildtest structure is revised as it was discussed recently
(for example, like in HARMONY-3115).
--
Thanks,
Nina
P.S. There was a failure notification about EUT in the alerts list
recently, and I'd like to note that it was a configuration issue: no
free disk space, it's fixed now.
>
> geir
>
> >
> > --
> > Thanks,
> > Nina
> >
> > On 12/22/06, Nina Rinskaya <ni...@gmail.com> wrote:
> >> Hi all,
> >>
> >> That's just to let you know that I run Eclipse Unit Tests under
> >> Cruise
> >> Control on Linux (SLES 9)/ia32 and windows (xp)/ia32. During last 10
> >> days Alexey Ignatenko and I worked on enabling EUT on Harmony and
> >> have
> >> increased EUT pass rate from ~60% up to 93-95% (not taking into
> >> account some intermittent failures). Many-many thanks to Alexey
> >> Ignatenko for all his great work.
> >>
> >> Does it make sense to report EUT regressions to the mailing list?
> >>
> >> Well, first try. Today my local Cruise Control reported significant
> >> EUT pass rate downgrade with similar failures logs, and Eclipse
> >> failed
> >> to start (silently died after "Select Workspace" dialog). It looks
> >> like it is caused by commit r489307 - just comparing classlib
> >> rollbacks to r489307 (Eclipse dies, some EUT tests fail) and r489306
> >> (Eclipse 'Hello world' passes, EUT tests pass as usually). Could
> >> anybody take a look at this issue please?
> >>
> >> Thanks,
> >> Nina
> >>
>
>
Re: [testing] Eclipse Unit Tests run under Cruise Control
Posted by "Geir Magnusson Jr." <ge...@pobox.com>.
On Mar 6, 2007, at 4:30 AM, Nina Rinskaya wrote:
> Hi,
>
> As it was discussed above in this thread, I'd like to start sending
> Cruise Control notifications about Eclipse Unit Tests failures to
> alerts@harmony.apache.org (if nobody minds).
Go for it
>
> I'm running EUT under Cruise Control on Linux (SLES9) IA32 and Windows
> XP IA32. A number of EUT suites that fail/crash are excluded from the
> regular runs in order to have all tests passed as a normal state and
> thus to monitor regression failures. Note that the number of excluded
> tests is large now, because I didn't find an easy way to exclude
> tests, not test suites, and I'm excluding the whole suite if it has 1
> failing testcase. I'll try to work on exlude list clean-up and on
> finding better way to exclude single tests.
>
> I hope that everything would work ok, but I'd like to apologize in
> advance for possible junk mail (false failure notifications) in
> alerts@harmony.apache.org mailing list.
it's already a mess :)
Can anyone do this? is the code/config in JIRA or SVN ?
geir
>
> --
> Thanks,
> Nina
>
> On 12/22/06, Nina Rinskaya <ni...@gmail.com> wrote:
>> Hi all,
>>
>> That's just to let you know that I run Eclipse Unit Tests under
>> Cruise
>> Control on Linux (SLES 9)/ia32 and windows (xp)/ia32. During last 10
>> days Alexey Ignatenko and I worked on enabling EUT on Harmony and
>> have
>> increased EUT pass rate from ~60% up to 93-95% (not taking into
>> account some intermittent failures). Many-many thanks to Alexey
>> Ignatenko for all his great work.
>>
>> Does it make sense to report EUT regressions to the mailing list?
>>
>> Well, first try. Today my local Cruise Control reported significant
>> EUT pass rate downgrade with similar failures logs, and Eclipse
>> failed
>> to start (silently died after "Select Workspace" dialog). It looks
>> like it is caused by commit r489307 - just comparing classlib
>> rollbacks to r489307 (Eclipse dies, some EUT tests fail) and r489306
>> (Eclipse 'Hello world' passes, EUT tests pass as usually). Could
>> anybody take a look at this issue please?
>>
>> Thanks,
>> Nina
>>