You are viewing a plain text version of this content. The canonical link for it is here.
Posted to server-dev@james.apache.org by Robert Burrell Donkin <ro...@gmail.com> on 2008/05/26 10:19:24 UTC
[PROPOSAL] mail-samples product
functional and integration testing mail applications requires mail
messages. at apache, this requiries sample mail of known provenance.
we have a number of samples scattered across products and projects. if
it were assembled together in one place it would represent a
reasonable start for a corpus. a single corpus could be shared for
testing across JAMES and may be of interest more widely.
so, i'd like to propose that we start to gather together a library
consisting of some simple mail loaders suitable for easy mail testing
together with the mail samples used for testing. test dependencies
would be declare on this product by any JAMES products needing
specific samples. further, i would like to propose that we try to add
samples to this product rather than locally.
- robert
---------------------------------------------------------------------
To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
For additional commands, e-mail: server-dev-help@james.apache.org
Re: [PROPOSAL] mail-samples product
Posted by Stefano Bagnara <ap...@bago.org>.
Robert Burrell Donkin ha scritto:
> On Mon, May 26, 2008 at 6:34 PM, Stefano Bagnara <ap...@bago.org> wrote:
>> Robert Burrell Donkin ha scritto:
>>> On Mon, May 26, 2008 at 2:57 PM, Robert Burrell Donkin
>>> <ro...@gmail.com> wrote:
>>>> On Mon, May 26, 2008 at 2:36 PM, Stefano Bagnara <ap...@bago.org> wrote:
>>>>> I'm not sure I understand.
>>>>>
>>>>> What would be the content of this product? rfc2822 messages or code?
>>>> both
>>> examples:
>>>
>>> 1. resources in
>>>
>>> http://svn.apache.org/repos/asf/james/server/trunk/experimental-seda-imap-function/src/test/resources/org/apache/james/test/functional/
>>> plus the intelligent loader (handles encoding, line endings and
>>> ignores headers)
>>> 2.
>>> http://svn.apache.org/repos/asf/james/mime4j/trunk/src/test/java/org/apache/james/mime4j/ExampleMail.java
>>>
>>> - robert
>> IMHO having corpus without any metadata about what is
>> particular/wrong/interesting in that corpus is pointless,
>
> what metadata did you have in mind?
Metadata depending on the test you want to do with each specific message.
E.g: message structure, whether it is an rfc2822 compliant message or
not, decoded binary attachments, and so on.
> a large corpus of standard mail with good coverage of different MIME
> types is useful for functional testing. typically, these are used
> either to generate testing scripts (for example, IMAP) or for
> round-trip testing (for example, Mime4J).
Simply loading the messages will not give any information. You will have
to locally set the result you expect (error, decoded data, structure).
And this depend on the tool you're testing.
If you don't add metadata to the corpus I see no big difference with
testing pseudo-random char sequences.
Probably this is caused by my ignorance but I don't see what corpus
could be shared between mime4j, the imap functional tests and postage.
In my mind each of this product will need its specific stuff.
Stefano
---------------------------------------------------------------------
To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
For additional commands, e-mail: server-dev-help@james.apache.org
Re: [PROPOSAL] mail-samples product
Posted by Bernd Fondermann <be...@googlemail.com>.
On Mon, May 26, 2008 at 9:02 PM, Robert Burrell Donkin
<ro...@gmail.com> wrote:
> On Mon, May 26, 2008 at 6:34 PM, Stefano Bagnara <ap...@bago.org> wrote:
>> Robert Burrell Donkin ha scritto:
>>>
>>> On Mon, May 26, 2008 at 2:57 PM, Robert Burrell Donkin
>>> <ro...@gmail.com> wrote:
>>>>
>>>> On Mon, May 26, 2008 at 2:36 PM, Stefano Bagnara <ap...@bago.org> wrote:
>>>>>
>>>>> I'm not sure I understand.
>>>>>
>>>>> What would be the content of this product? rfc2822 messages or code?
>>>>
>>>> both
>>>
>>> examples:
>>>
>>> 1. resources in
>>>
>>> http://svn.apache.org/repos/asf/james/server/trunk/experimental-seda-imap-function/src/test/resources/org/apache/james/test/functional/
>>> plus the intelligent loader (handles encoding, line endings and
>>> ignores headers)
>>> 2.
>>> http://svn.apache.org/repos/asf/james/mime4j/trunk/src/test/java/org/apache/james/mime4j/ExampleMail.java
>>>
>>> - robert
>>
>> IMHO having corpus without any metadata about what is
>> particular/wrong/interesting in that corpus is pointless,
>
> what metadata did you have in mind?
>
> a large corpus of standard mail with good coverage of different MIME
> types is useful for functional testing. typically, these are used
> either to generate testing scripts (for example, IMAP) or for
> round-trip testing (for example, Mime4J).
I like this idea. We could also feed this into Postage.
Bernd
---------------------------------------------------------------------
To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
For additional commands, e-mail: server-dev-help@james.apache.org
Re: [PROPOSAL] mail-samples product
Posted by Robert Burrell Donkin <ro...@gmail.com>.
On Mon, May 26, 2008 at 6:34 PM, Stefano Bagnara <ap...@bago.org> wrote:
> Robert Burrell Donkin ha scritto:
>>
>> On Mon, May 26, 2008 at 2:57 PM, Robert Burrell Donkin
>> <ro...@gmail.com> wrote:
>>>
>>> On Mon, May 26, 2008 at 2:36 PM, Stefano Bagnara <ap...@bago.org> wrote:
>>>>
>>>> I'm not sure I understand.
>>>>
>>>> What would be the content of this product? rfc2822 messages or code?
>>>
>>> both
>>
>> examples:
>>
>> 1. resources in
>>
>> http://svn.apache.org/repos/asf/james/server/trunk/experimental-seda-imap-function/src/test/resources/org/apache/james/test/functional/
>> plus the intelligent loader (handles encoding, line endings and
>> ignores headers)
>> 2.
>> http://svn.apache.org/repos/asf/james/mime4j/trunk/src/test/java/org/apache/james/mime4j/ExampleMail.java
>>
>> - robert
>
> IMHO having corpus without any metadata about what is
> particular/wrong/interesting in that corpus is pointless,
what metadata did you have in mind?
a large corpus of standard mail with good coverage of different MIME
types is useful for functional testing. typically, these are used
either to generate testing scripts (for example, IMAP) or for
round-trip testing (for example, Mime4J).
- robert
---------------------------------------------------------------------
To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
For additional commands, e-mail: server-dev-help@james.apache.org
Re: [PROPOSAL] mail-samples product
Posted by Stefano Bagnara <ap...@bago.org>.
Robert Burrell Donkin ha scritto:
> On Mon, May 26, 2008 at 2:57 PM, Robert Burrell Donkin
> <ro...@gmail.com> wrote:
>> On Mon, May 26, 2008 at 2:36 PM, Stefano Bagnara <ap...@bago.org> wrote:
>>> I'm not sure I understand.
>>>
>>> What would be the content of this product? rfc2822 messages or code?
>> both
>
> examples:
>
> 1. resources in
> http://svn.apache.org/repos/asf/james/server/trunk/experimental-seda-imap-function/src/test/resources/org/apache/james/test/functional/
> plus the intelligent loader (handles encoding, line endings and
> ignores headers)
> 2. http://svn.apache.org/repos/asf/james/mime4j/trunk/src/test/java/org/apache/james/mime4j/ExampleMail.java
>
> - robert
IMHO having corpus without any metadata about what is
particular/wrong/interesting in that corpus is pointless, but if you
find consensus from others I'm not strong about this.
-0
I would add messages to mime4j, and if needed copy&paste where they are
needed. If we see a lot of duplication then we will evaluate moving it
to a product.
Stefano
---------------------------------------------------------------------
To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
For additional commands, e-mail: server-dev-help@james.apache.org
Re: [PROPOSAL] mail-samples product
Posted by Robert Burrell Donkin <ro...@gmail.com>.
On Mon, May 26, 2008 at 2:57 PM, Robert Burrell Donkin
<ro...@gmail.com> wrote:
> On Mon, May 26, 2008 at 2:36 PM, Stefano Bagnara <ap...@bago.org> wrote:
>> I'm not sure I understand.
>>
>> What would be the content of this product? rfc2822 messages or code?
>
> both
examples:
1. resources in
http://svn.apache.org/repos/asf/james/server/trunk/experimental-seda-imap-function/src/test/resources/org/apache/james/test/functional/
plus the intelligent loader (handles encoding, line endings and
ignores headers)
2. http://svn.apache.org/repos/asf/james/mime4j/trunk/src/test/java/org/apache/james/mime4j/ExampleMail.java
- robert
---------------------------------------------------------------------
To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
For additional commands, e-mail: server-dev-help@james.apache.org
Re: [PROPOSAL] mail-samples product
Posted by Robert Burrell Donkin <ro...@gmail.com>.
On Mon, May 26, 2008 at 2:36 PM, Stefano Bagnara <ap...@bago.org> wrote:
> I'm not sure I understand.
>
> What would be the content of this product? rfc2822 messages or code?
both
> What the dependencies?
minimal preferrably none
- robert
---------------------------------------------------------------------
To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
For additional commands, e-mail: server-dev-help@james.apache.org
Re: [PROPOSAL] mail-samples product
Posted by Stefano Bagnara <ap...@bago.org>.
I'm not sure I understand.
What would be the content of this product? rfc2822 messages or code?
What the dependencies?
Stefano
Robert Burrell Donkin ha scritto:
> functional and integration testing mail applications requires mail
> messages. at apache, this requiries sample mail of known provenance.
> we have a number of samples scattered across products and projects. if
> it were assembled together in one place it would represent a
> reasonable start for a corpus. a single corpus could be shared for
> testing across JAMES and may be of interest more widely.
>
> so, i'd like to propose that we start to gather together a library
> consisting of some simple mail loaders suitable for easy mail testing
> together with the mail samples used for testing. test dependencies
> would be declare on this product by any JAMES products needing
> specific samples. further, i would like to propose that we try to add
> samples to this product rather than locally.
>
> - robert
---------------------------------------------------------------------
To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
For additional commands, e-mail: server-dev-help@james.apache.org