You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@tuscany.apache.org by Mike Edwards <mi...@gmail.com> on 2010/08/04 09:52:30 UTC
Re: Current overall otest status
Folks,
Simon Laws wrote:
> OK there's been some goos progress. Assembly, Policy, WS are good.
> Here's the latest results I see.
>
> Assembly
> ========
>
> Failed tests:
> testDummy(client.ASM_12006_TestCase) - OASIS Issue - fails dues to
> externalAttachment elements for 10003
> testDummy(client.ASM_8014_TestCase) - OASIS Issue -
> confidentiality.transport
>
> Tests run: 134, Failures: 2, Errors: 0, Skipped: 0
<snip>
>
> Regards
>
> Simon
>
Assembly testcases ASM_8014 & ASM_12006 fixed under OASIS issue ASSEMBLY-240 as of 04/08/2010.
Yours, Mike.
Re: Current overall otest status
Posted by Simon Laws <si...@googlemail.com>.
As of today this is what I see...
Assembly
========
Results :
Tests run: 132, Failures: 0, Errors: 0, Skipped: 0
JCA
===
Failed tests:
testDummy(client_javacaa.JCA_9016_TestCase) - properties - OASIS fix
required (TUSCANY-3626)
testDummy(client_javacaa.JCA_10013_TestCase) - intent/policy
inheritance - OASIS Fix
Tests run: 218, Failures: 2, Errors: 0, Skipped: 109
I also have local fixes for 11016 (TUSCANY-3656),waiting for OASIS to apply.
JCI
===
Tests run: 122, Failures: 0, Errors: 0, Skipped: 61
Policy
======
Failed tests:
testDummy(client.POL_4019_TestCase)
Tests run: 112, Failures: 1, Errors: 0, Skipped: 56
WS
==
Tests run: 74, Failures: 0, Errors: 0, Skipped: 37
Simon
--
Apache Tuscany committer: tuscany.apache.org
Co-author of a book about Tuscany and SCA: tuscanyinaction.com
Re: Current overall otest status
Posted by Simon Laws <si...@googlemail.com>.
Ran the tests the morning with the latest Tuscany and test code and
for JCA I now see...
Failed tests:
testDummy(client_javacaa.JCA_7003_TestCase) - asynch operation -
needs default binding support
testDummy(client_javacaa.JCA_7004_TestCase) - asynch operation -
needs default binding support
testDummy(client_javacaa.JCA_7005_TestCase) - asynch operation -
needs default binding support
testDummy(client_javacaa.JCA_7006_TestCase) - asynch operation -
needs default binding support
testDummy(client_javacaa.JCA_9016_TestCase) - properties - OASIS fix
required (TUSCANY-3626)
testDummy(client_javacaa.JCA_10013_TestCase) - intent/policy inheritance
Tests run: 218, Failures: 6, Errors: 0, Skipped: 109
I have local changes for 11016 which required OASIS fixes (TUSCANY-3656)
Simon
--
Apache Tuscany committer: tuscany.apache.org
Co-author of a book about Tuscany and SCA: tuscanyinaction.com
Re: Current overall otest status
Posted by Simon Laws <si...@googlemail.com>.
> JCI
> ===
>
> Failed tests:
> testDummy(client_javapojo.POJO_8036_TestCase)
>
> Tests run: 122, Failures: 1, Errors: 0, Skipped: 61
>
> I have a few local OASIS fixes to get down to 1 failure so there will
> be more for others.
>
OK, I'm declaring something of a victory for JCI as I have all the
tests passing here. There will be failures for others as there are two
outstanding JCI issues with OASIS (I have local changes). Also the JCA
issue (TUSCANY-3648) prevents me from committing a final Tuscany JCI
fix.
There is still a bit of tidying to do and I'm going to move on to
helping with JCAA tests, some of which touch the same code, so I'll
pick that up there.
Simon
--
Apache Tuscany committer: tuscany.apache.org
Co-author of a book about Tuscany and SCA: tuscanyinaction.com
Re: Current overall otest status
Posted by Simon Laws <si...@googlemail.com>.
>>>
>>
>> Out of curiosity, what does the skipped count means ? Are these
>> failing and ignored tests ?
>>
>> --
>> Luciano Resende
>> http://people.apache.org/~lresende
>> http://twitter.com/lresende1975
>> http://lresende.blogspot.com/
>>
>
> Good question. I think it's just an artifact of how we are running the
> tests but I'll check.
>
> Simon
>
> --
> Apache Tuscany committer: tuscany.apache.org
> Co-author of a book about Tuscany and SCA: tuscanyinaction.com
>
Looking at the otest JUnit test cases they generally have an ignored
test commented as follows....
/**
* Dummy method to ensure that things work with JUnit 3 eg within
Eclipse Ganymede
*/
@Ignore
@Test
public void testFoo() throws Exception {
}
So it seems that the ignored tests are really ignored tests.
This does mean that the number of tests I quotes is probably double
what it really is (I just totted up the reported number of tests).
Simon
--
Apache Tuscany committer: tuscany.apache.org
Co-author of a book about Tuscany and SCA: tuscanyinaction.com
Re: Current overall otest status
Posted by Simon Laws <si...@googlemail.com>.
On Wed, Aug 11, 2010 at 7:09 PM, Luciano Resende <lu...@gmail.com> wrote:
> On Wed, Aug 11, 2010 at 12:56 AM, Simon Laws <si...@googlemail.com> wrote:
>> On Wed, Aug 4, 2010 at 8:52 AM, Mike Edwards
>> <mi...@gmail.com> wrote:
>>> Folks,
>>>
>>>
>>> Simon Laws wrote:
>>>>
>>>> OK there's been some goos progress. Assembly, Policy, WS are good.
>>>> Here's the latest results I see.
>>>>
>>>> Assembly
>>>> ========
>>>>
>>>> Failed tests:
>>>> testDummy(client.ASM_12006_TestCase) - OASIS Issue - fails dues to
>>>> externalAttachment elements for 10003
>>>> testDummy(client.ASM_8014_TestCase) - OASIS Issue -
>>>> confidentiality.transport
>>>>
>>>> Tests run: 134, Failures: 2, Errors: 0, Skipped: 0
>>>
>>> <snip>
>>>>
>>>> Regards
>>>>
>>>> Simon
>>>>
>>>
>>> Assembly testcases ASM_8014 & ASM_12006 fixed under OASIS issue ASSEMBLY-240
>>> as of 04/08/2010.
>>>
>>>
>>> Yours, Mike.
>>>
>>>
>>
>> What with vacation and all it's been a few days but I've just re-run
>> the otests and this is what I see this morning. We're getting there!
>> 20 tests to crack out of 658.
>>
>> Assembly
>> ========
>>
>> Tests run: 132, Failures: 0, Errors: 0, Skipped: 0
>>
>> JCAA
>> =====
>>
>> Failed tests:
>> testDummy(client_javacaa.JCA_9013_TestCase)
>> testDummy(client_javacaa.JCA_9016_TestCase)
>> testDummy(client_javacaa.JCA_7006_TestCase)
>> testDummy(client_javacaa.JCA_11010_TestCase)
>> testDummy(client_javacaa.JCA_11009_TestCase)
>> testDummy(client_javacaa.JCA_1001_TestCase)
>> testDummy(client_javacaa.JCA_7004_TestCase)
>> testDummy(client_javacaa.JCA_7005_TestCase)
>> testDummy(client_javacaa.JCA_8011_TestCase)
>> testDummy(client_javacaa.JCA_7002_TestCase)
>> testDummy(client_javacaa.JCA_8007_TestCase)
>> testDummy(client_javacaa.JCA_7003_TestCase)
>> testDummy(client_javacaa.JCA_11011_TestCase)
>> testDummy(client_javacaa.JCA_1002_TestCase)
>> testDummy(client_javacaa.JCA_10013_TestCase)
>> testDummy(client_javacaa.JCA_7001_TestCase)
>> testDummy(client_javacaa.JCA_3014_TestCase)
>> testDummy(client_javacaa.JCA_11016_TestCase)
>>
>> Tests run: 218, Failures: 18, Errors: 0, Skipped: 109
>>
>> JCI
>> ===
>>
>> Failed tests:
>> testDummy(client_javapojo.POJO_8036_TestCase)
>>
>> Tests run: 122, Failures: 1, Errors: 0, Skipped: 61
>>
>> I have a few local OASIS fixes to get down to 1 failure so there will
>> be more for others.
>>
>> Policy
>> =====
>>
>> Failed tests:
>> testDummy(client.POL_4019_TestCase)
>>
>> Tests run: 112, Failures: 1, Errors: 0, Skipped: 56
>>
>> WS
>> ===
>>
>> Tests run: 74, Failures: 0, Errors: 0, Skipped: 37
>>
>> Simon
>>
>> --
>> Apache Tuscany committer: tuscany.apache.org
>> Co-author of a book about Tuscany and SCA: tuscanyinaction.com
>>
>
> Out of curiosity, what does the skipped count means ? Are these
> failing and ignored tests ?
>
> --
> Luciano Resende
> http://people.apache.org/~lresende
> http://twitter.com/lresende1975
> http://lresende.blogspot.com/
>
Good question. I think it's just an artifact of how we are running the
tests but I'll check.
Simon
--
Apache Tuscany committer: tuscany.apache.org
Co-author of a book about Tuscany and SCA: tuscanyinaction.com
Re: Current overall otest status
Posted by Luciano Resende <lu...@gmail.com>.
On Wed, Aug 11, 2010 at 12:56 AM, Simon Laws <si...@googlemail.com> wrote:
> On Wed, Aug 4, 2010 at 8:52 AM, Mike Edwards
> <mi...@gmail.com> wrote:
>> Folks,
>>
>>
>> Simon Laws wrote:
>>>
>>> OK there's been some goos progress. Assembly, Policy, WS are good.
>>> Here's the latest results I see.
>>>
>>> Assembly
>>> ========
>>>
>>> Failed tests:
>>> testDummy(client.ASM_12006_TestCase) - OASIS Issue - fails dues to
>>> externalAttachment elements for 10003
>>> testDummy(client.ASM_8014_TestCase) - OASIS Issue -
>>> confidentiality.transport
>>>
>>> Tests run: 134, Failures: 2, Errors: 0, Skipped: 0
>>
>> <snip>
>>>
>>> Regards
>>>
>>> Simon
>>>
>>
>> Assembly testcases ASM_8014 & ASM_12006 fixed under OASIS issue ASSEMBLY-240
>> as of 04/08/2010.
>>
>>
>> Yours, Mike.
>>
>>
>
> What with vacation and all it's been a few days but I've just re-run
> the otests and this is what I see this morning. We're getting there!
> 20 tests to crack out of 658.
>
> Assembly
> ========
>
> Tests run: 132, Failures: 0, Errors: 0, Skipped: 0
>
> JCAA
> =====
>
> Failed tests:
> testDummy(client_javacaa.JCA_9013_TestCase)
> testDummy(client_javacaa.JCA_9016_TestCase)
> testDummy(client_javacaa.JCA_7006_TestCase)
> testDummy(client_javacaa.JCA_11010_TestCase)
> testDummy(client_javacaa.JCA_11009_TestCase)
> testDummy(client_javacaa.JCA_1001_TestCase)
> testDummy(client_javacaa.JCA_7004_TestCase)
> testDummy(client_javacaa.JCA_7005_TestCase)
> testDummy(client_javacaa.JCA_8011_TestCase)
> testDummy(client_javacaa.JCA_7002_TestCase)
> testDummy(client_javacaa.JCA_8007_TestCase)
> testDummy(client_javacaa.JCA_7003_TestCase)
> testDummy(client_javacaa.JCA_11011_TestCase)
> testDummy(client_javacaa.JCA_1002_TestCase)
> testDummy(client_javacaa.JCA_10013_TestCase)
> testDummy(client_javacaa.JCA_7001_TestCase)
> testDummy(client_javacaa.JCA_3014_TestCase)
> testDummy(client_javacaa.JCA_11016_TestCase)
>
> Tests run: 218, Failures: 18, Errors: 0, Skipped: 109
>
> JCI
> ===
>
> Failed tests:
> testDummy(client_javapojo.POJO_8036_TestCase)
>
> Tests run: 122, Failures: 1, Errors: 0, Skipped: 61
>
> I have a few local OASIS fixes to get down to 1 failure so there will
> be more for others.
>
> Policy
> =====
>
> Failed tests:
> testDummy(client.POL_4019_TestCase)
>
> Tests run: 112, Failures: 1, Errors: 0, Skipped: 56
>
> WS
> ===
>
> Tests run: 74, Failures: 0, Errors: 0, Skipped: 37
>
> Simon
>
> --
> Apache Tuscany committer: tuscany.apache.org
> Co-author of a book about Tuscany and SCA: tuscanyinaction.com
>
Out of curiosity, what does the skipped count means ? Are these
failing and ignored tests ?
--
Luciano Resende
http://people.apache.org/~lresende
http://twitter.com/lresende1975
http://lresende.blogspot.com/
Re: Current overall otest status
Posted by Simon Laws <si...@googlemail.com>.
On Wed, Aug 4, 2010 at 8:52 AM, Mike Edwards
<mi...@gmail.com> wrote:
> Folks,
>
>
> Simon Laws wrote:
>>
>> OK there's been some goos progress. Assembly, Policy, WS are good.
>> Here's the latest results I see.
>>
>> Assembly
>> ========
>>
>> Failed tests:
>> testDummy(client.ASM_12006_TestCase) - OASIS Issue - fails dues to
>> externalAttachment elements for 10003
>> testDummy(client.ASM_8014_TestCase) - OASIS Issue -
>> confidentiality.transport
>>
>> Tests run: 134, Failures: 2, Errors: 0, Skipped: 0
>
> <snip>
>>
>> Regards
>>
>> Simon
>>
>
> Assembly testcases ASM_8014 & ASM_12006 fixed under OASIS issue ASSEMBLY-240
> as of 04/08/2010.
>
>
> Yours, Mike.
>
>
What with vacation and all it's been a few days but I've just re-run
the otests and this is what I see this morning. We're getting there!
20 tests to crack out of 658.
Assembly
========
Tests run: 132, Failures: 0, Errors: 0, Skipped: 0
JCAA
=====
Failed tests:
testDummy(client_javacaa.JCA_9013_TestCase)
testDummy(client_javacaa.JCA_9016_TestCase)
testDummy(client_javacaa.JCA_7006_TestCase)
testDummy(client_javacaa.JCA_11010_TestCase)
testDummy(client_javacaa.JCA_11009_TestCase)
testDummy(client_javacaa.JCA_1001_TestCase)
testDummy(client_javacaa.JCA_7004_TestCase)
testDummy(client_javacaa.JCA_7005_TestCase)
testDummy(client_javacaa.JCA_8011_TestCase)
testDummy(client_javacaa.JCA_7002_TestCase)
testDummy(client_javacaa.JCA_8007_TestCase)
testDummy(client_javacaa.JCA_7003_TestCase)
testDummy(client_javacaa.JCA_11011_TestCase)
testDummy(client_javacaa.JCA_1002_TestCase)
testDummy(client_javacaa.JCA_10013_TestCase)
testDummy(client_javacaa.JCA_7001_TestCase)
testDummy(client_javacaa.JCA_3014_TestCase)
testDummy(client_javacaa.JCA_11016_TestCase)
Tests run: 218, Failures: 18, Errors: 0, Skipped: 109
JCI
===
Failed tests:
testDummy(client_javapojo.POJO_8036_TestCase)
Tests run: 122, Failures: 1, Errors: 0, Skipped: 61
I have a few local OASIS fixes to get down to 1 failure so there will
be more for others.
Policy
=====
Failed tests:
testDummy(client.POL_4019_TestCase)
Tests run: 112, Failures: 1, Errors: 0, Skipped: 56
WS
===
Tests run: 74, Failures: 0, Errors: 0, Skipped: 37
Simon
--
Apache Tuscany committer: tuscany.apache.org
Co-author of a book about Tuscany and SCA: tuscanyinaction.com