You are viewing a plain text version of this content. The canonical link for it is here.
Posted to server-dev@james.apache.org by Norman Maurer <no...@apache.org> on 2010/03/24 19:47:11 UTC
[PROPOSAL] Replace MailRepository with Mailbox / MailboxManager for
POP3Server ...
Hi all,
I want to propose some really heavy change in current JAMES trunk, and
so next version. As all of you knows we are supporting IMAP in current
development version, which ships with its own mail store backend
called MailboxManager / Mailbox. For POP3 we use MailRepository as
backend.
I think this is a no go for a number of reasons, but the major one is
that we should be able to switch between IMAP and POP3 without the
need to migrate mails. So I rewrote the POP3Server to re-use the
MailboxManager / Mailbox stuff which is used by IMAP.
So if a user login via POP3 he will just see the folder called INBOX
and nothing else. With IMAP he will see all folders. Thats exactly
what dovecot and courier does ( both heavy used unix imap/pop3
servers).
Another advance is that we elimate one more dependency on storing
mails via javamail, which is not the way to go for the future ...
On the downside we will break backward-compatibility with every James
release we did before. So we will need to write a "migration" tool,
but this should not be to hard.
Because the change is so heavy, I dedicited to attach it to JIRA for
review and not commit it directly.
You can find it here:
https://issues.apache.org/jira/browse/JAMES-983
So what do you think ?
Bye,
Norman
Ps: The performance it really better then with the "old" backend ;)
---------------------------------------------------------------------
To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
For additional commands, e-mail: server-dev-help@james.apache.org
Re: [PROPOSAL] Replace MailRepository with Mailbox / MailboxManager
for POP3Server ...
Posted by Norman Maurer <no...@apache.org>.
Not yet, but there will be one before a release..
Bye
Norman
2010/3/25, Bernd Fondermann <be...@googlemail.com>:
> On Thu, Mar 25, 2010 at 15:48, Norman Maurer
> <no...@googlemail.com> wrote:
>> Hi Bernd,
>>
>> well its not a big change from the code-side of view, (the patch is
>> not really big) but this change will effect all users upgrading from
>> previous version. So everyone will need to migrate all the stored
>> mails. Thats not a biggie for me but I just wanted to outline it..
>>
>> Except this I don't see any other problems..
>
> ok.
> is there an automated upgrade path?
>
> Bernd
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
> For additional commands, e-mail: server-dev-help@james.apache.org
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
For additional commands, e-mail: server-dev-help@james.apache.org
Re: [PROPOSAL] Replace MailRepository with Mailbox / MailboxManager
for POP3Server ...
Posted by Bernd Fondermann <be...@googlemail.com>.
On Thu, Mar 25, 2010 at 15:48, Norman Maurer
<no...@googlemail.com> wrote:
> Hi Bernd,
>
> well its not a big change from the code-side of view, (the patch is
> not really big) but this change will effect all users upgrading from
> previous version. So everyone will need to migrate all the stored
> mails. Thats not a biggie for me but I just wanted to outline it..
>
> Except this I don't see any other problems..
ok.
is there an automated upgrade path?
Bernd
---------------------------------------------------------------------
To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
For additional commands, e-mail: server-dev-help@james.apache.org
Re: [PROPOSAL] Replace MailRepository with Mailbox / MailboxManager
for POP3Server ...
Posted by Norman Maurer <no...@googlemail.com>.
Hi Bernd,
well its not a big change from the code-side of view, (the patch is
not really big) but this change will effect all users upgrading from
previous version. So everyone will need to migrate all the stored
mails. Thats not a biggie for me but I just wanted to outline it..
Except this I don't see any other problems..
Bye,
Norman
2010/3/25 Bernd Fondermann <be...@googlemail.com>:
> On Wed, Mar 24, 2010 at 19:47, Norman Maurer <no...@apache.org> wrote:
>> Hi all,
>>
>> I want to propose some really heavy change in current JAMES trunk, and
>> so next version. As all of you knows we are supporting IMAP in current
>> development version, which ships with its own mail store backend
>> called MailboxManager / Mailbox. For POP3 we use MailRepository as
>> backend.
>> I think this is a no go for a number of reasons, but the major one is
>> that we should be able to switch between IMAP and POP3 without the
>> need to migrate mails. So I rewrote the POP3Server to re-use the
>> MailboxManager / Mailbox stuff which is used by IMAP.
>>
>> So if a user login via POP3 he will just see the folder called INBOX
>> and nothing else. With IMAP he will see all folders. Thats exactly
>> what dovecot and courier does ( both heavy used unix imap/pop3
>> servers).
>> Another advance is that we elimate one more dependency on storing
>> mails via javamail, which is not the way to go for the future ...
>> On the downside we will break backward-compatibility with every James
>> release we did before. So we will need to write a "migration" tool,
>> but this should not be to hard.
>>
>> Because the change is so heavy, I dedicited to attach it to JIRA for
>> review and not commit it directly.
>>
>> You can find it here:
>> https://issues.apache.org/jira/browse/JAMES-983
>>
>> So what do you think ?
>
> +1 on the proposal, (didn't review the code).
>
> This is what I suggested a long time ago, (and maybe if I search the
> archives I'll find it, but if not than I wish that I would have
> suggested it).
>
> Can you outline why is this such a big change and where the risks are
> (except for running faster ;-)?
>
> Bernd
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
> For additional commands, e-mail: server-dev-help@james.apache.org
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
For additional commands, e-mail: server-dev-help@james.apache.org
Re: [PROPOSAL] Replace MailRepository with Mailbox / MailboxManager
for POP3Server ...
Posted by Manuel Carrasco Moñino <ma...@apache.org>.
On Thu, Mar 25, 2010 at 3:46 PM, Tim-Christian Mundt <de...@tim-erwin.de> wrote:
> Hi,
>
>>
>> I know pop3 proto doesn't support folders, that I mean is a way to
>> configure the server to do that. Maybe at global or at user level.
>> It's like gmail behavior, when the user enables POP she can configure
>> what to do with the messages downloaded.
>
> Usually, this is configured in the client. It will delete the downloaded
> messages or just mark them read. That definitely needs to be possible.
> However, I can't see how to additionally configure this on the server
> side. The only thing could be to only mark mails as deleted instead of
> deleting them directly and only delete after a week or so. Although
> again this is a client feature if I'm not wrong. I can configure my
> client to download and delete after x days. Let's keep it simple,
> predictable and transparent.
Although the client can be configured to leave the messages in the
server, the server doesn't do anything with these messages. So the MUA
maintains a cache with some information about each message in order
not to download them again, or to ask the server to remove they after
a configured time.
The point is that if the user reads the email using other client,
messages which were downloaded, will be downloaded again (pop) or
they are marked as unread (imap).
For instance, when in gmail you activate 'mark downloaded messages as
seen', the user never downloads the messages again using pop although
she changes the computer, she doesn't loose the messages, and can view
them as read using webmail or imap.
Cheers
Manolo
>
> Regards
> Tim
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
> For additional commands, e-mail: server-dev-help@james.apache.org
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
For additional commands, e-mail: server-dev-help@james.apache.org
Re: [PROPOSAL] Replace MailRepository with Mailbox /
MailboxManager for POP3Server ...
Posted by Tim-Christian Mundt <de...@tim-erwin.de>.
Hi,
>
> I know pop3 proto doesn't support folders, that I mean is a way to
> configure the server to do that. Maybe at global or at user level.
> It's like gmail behavior, when the user enables POP she can configure
> what to do with the messages downloaded.
Usually, this is configured in the client. It will delete the downloaded
messages or just mark them read. That definitely needs to be possible.
However, I can't see how to additionally configure this on the server
side. The only thing could be to only mark mails as deleted instead of
deleting them directly and only delete after a week or so. Although
again this is a client feature if I'm not wrong. I can configure my
client to download and delete after x days. Let's keep it simple,
predictable and transparent.
Regards
Tim
---------------------------------------------------------------------
To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
For additional commands, e-mail: server-dev-help@james.apache.org
Re: [PROPOSAL] Replace MailRepository with Mailbox / MailboxManager
for POP3Server ...
Posted by Manuel Carrasco Moñino <ma...@apache.org>.
On Thu, Mar 25, 2010 at 3:02 PM, Norman Maurer
<no...@googlemail.com> wrote:
> Hi Manuel,
>
> Thx for the comments and for reviewing the stuff. Comments are inside...
>
> 2010/3/25 Manuel Carrasco Moñino <ma...@apache.org>:
>> Hi Norman, I''ve tried your patch and it works fine for me.
>>
>> Just a bunch of notes:
>> - It is necessary to uncomment the SieveMailet line to get the mails
>> in the IMAP repository. I suppose this should be the default.
>
> True, I would even rewrite the SieveMailet a bit for this.. But that
> is not a biggy
>
>> - It is supposed that James has to compile with java 1.5, but you are
>> using isEmpty() :-(
>
> Could catch, will replace this once we dedicited to commit the diff
>
>> - I think the name of the "INBOX" has to be provided by the
>> mailboxmanager instead of be hardcoded.
>
> Well INBOX is the default you would use with javamail too. So I don't
> saw this as a big problem ..
true enough
>
>> - Another thing is related with the 'DELE' command, messages are
>> marked for deleting, but it seems that they are not deleted until the
>> user does a quit, so in the case of a failure in the connection the
>> messages doesn't go deleted.
>
> I need to reread on this but I thought thats exactly how pop3 is
> supposed to work. In fact this was what the pop3server did before too
Maybe it was a bug. I think courier deletes the mail when the user
sends the DELE command, but not sure, I've to check.
>
>> - Also It would be good to add in a next release some parameters like
>> move deleted messages to trash, mark deleted messages as seen, etc,
>> so that users using various MUA don't loose messages.
>
> Thats not the scope of POP3. POP3 doesn't support folders so thats not possible.
I know pop3 proto doesn't support folders, that I mean is a way to
configure the server to do that. Maybe at global or at user level.
It's like gmail behavior, when the user enables POP she can configure
what to do with the messages downloaded.
>
>>
>> I'm glad with the improvement (thanks Norman), so I vote to remove the
>> old mailrepository.
>>
>> Manolo
>>
>
> Thx again for your comments...
>
>
>>
>>
>> On Thu, Mar 25, 2010 at 11:41 AM, Bernd Fondermann
>> <be...@googlemail.com> wrote:
>>> On Wed, Mar 24, 2010 at 19:47, Norman Maurer <no...@apache.org> wrote:
>>>> Hi all,
>>>>
>>>> I want to propose some really heavy change in current JAMES trunk, and
>>>> so next version. As all of you knows we are supporting IMAP in current
>>>> development version, which ships with its own mail store backend
>>>> called MailboxManager / Mailbox. For POP3 we use MailRepository as
>>>> backend.
>>>> I think this is a no go for a number of reasons, but the major one is
>>>> that we should be able to switch between IMAP and POP3 without the
>>>> need to migrate mails. So I rewrote the POP3Server to re-use the
>>>> MailboxManager / Mailbox stuff which is used by IMAP.
>>>>
>>>> So if a user login via POP3 he will just see the folder called INBOX
>>>> and nothing else. With IMAP he will see all folders. Thats exactly
>>>> what dovecot and courier does ( both heavy used unix imap/pop3
>>>> servers).
>>>> Another advance is that we elimate one more dependency on storing
>>>> mails via javamail, which is not the way to go for the future ...
>>>> On the downside we will break backward-compatibility with every James
>>>> release we did before. So we will need to write a "migration" tool,
>>>> but this should not be to hard.
>>>>
>>>> Because the change is so heavy, I dedicited to attach it to JIRA for
>>>> review and not commit it directly.
>>>>
>>>> You can find it here:
>>>> https://issues.apache.org/jira/browse/JAMES-983
>>>>
>>>> So what do you think ?
>>>
>>> +1 on the proposal, (didn't review the code).
>>>
>>> This is what I suggested a long time ago, (and maybe if I search the
>>> archives I'll find it, but if not than I wish that I would have
>>> suggested it).
>>>
>>> Can you outline why is this such a big change and where the risks are
>>> (except for running faster ;-)?
>>>
>>> Bernd
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
>>> For additional commands, e-mail: server-dev-help@james.apache.org
>>>
>>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
>> For additional commands, e-mail: server-dev-help@james.apache.org
>>
>>
>
>
> Bye,
> Norman
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
> For additional commands, e-mail: server-dev-help@james.apache.org
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
For additional commands, e-mail: server-dev-help@james.apache.org
Re: [PROPOSAL] Replace MailRepository with Mailbox / MailboxManager
for POP3Server ...
Posted by Manuel Carrasco Moñino <ma...@apache.org>.
Hello Norman
You are right, the call to method isEmpty in your patch is for a List
not for a String and the RFC is clear enough about the delete and quit
command.
So the patch is fine for me.
Thanks
Manolo
On Thu, Mar 25, 2010 at 6:35 PM, Norman Maurer
<no...@googlemail.com> wrote:
> Hi Manuel,
>
> just checked and it compiles without a problem with java 5.
>
> About the deletion of emails, I just re-readed the rfc on POP3 and I
> think the patch does the right thing..
>
> From rfc1939:
>
>
> DELE msg
>
> Arguments:
> a message-number (required) which may NOT refer to a
> message marked as deleted
>
> Restrictions:
> may only be given in the TRANSACTION state
>
> Discussion:
> The POP3 server marks the message as deleted. Any future
> reference to the message-number associated with the message
> in a POP3 command generates an error. The POP3 server does
> not actually delete the message until the POP3 session
> enters the UPDATE state.
>
>
> 6. The UPDATE State
>
> When the client issues the QUIT command from the TRANSACTION state,
> the POP3 session enters the UPDATE state. (Note that if the client
> issues the QUIT command from the AUTHORIZATION state, the POP3
> session terminates but does NOT enter the UPDATE state.)
>
> If a session terminates for some reason other than a client-issued
> QUIT command, the POP3 session does NOT enter the UPDATE state and
> MUST not remove any messages from the maildrop.
>
>
> Bye,
> Norman
>
> 2010/3/25 Norman Maurer <no...@googlemail.com>:
>> Hi Manuel,
>>
>> Thx for the comments and for reviewing the stuff. Comments are inside...
>>
>> 2010/3/25 Manuel Carrasco Moñino <ma...@apache.org>:
>>> Hi Norman, I''ve tried your patch and it works fine for me.
>>>
>>> Just a bunch of notes:
>>> - It is necessary to uncomment the SieveMailet line to get the mails
>>> in the IMAP repository. I suppose this should be the default.
>>
>> True, I would even rewrite the SieveMailet a bit for this.. But that
>> is not a biggy
>>
>>> - It is supposed that James has to compile with java 1.5, but you are
>>> using isEmpty() :-(
>>
>> Could catch, will replace this once we dedicited to commit the diff
>>
>>> - I think the name of the "INBOX" has to be provided by the
>>> mailboxmanager instead of be hardcoded.
>>
>> Well INBOX is the default you would use with javamail too. So I don't
>> saw this as a big problem ..
>>
>>> - Another thing is related with the 'DELE' command, messages are
>>> marked for deleting, but it seems that they are not deleted until the
>>> user does a quit, so in the case of a failure in the connection the
>>> messages doesn't go deleted.
>>
>> I need to reread on this but I thought thats exactly how pop3 is
>> supposed to work. In fact this was what the pop3server did before too
>>
>>> - Also It would be good to add in a next release some parameters like
>>> move deleted messages to trash, mark deleted messages as seen, etc,
>>> so that users using various MUA don't loose messages.
>>
>> Thats not the scope of POP3. POP3 doesn't support folders so thats not possible.
>>
>>>
>>> I'm glad with the improvement (thanks Norman), so I vote to remove the
>>> old mailrepository.
>>>
>>> Manolo
>>>
>>
>> Thx again for your comments...
>>
>>
>>>
>>>
>>> On Thu, Mar 25, 2010 at 11:41 AM, Bernd Fondermann
>>> <be...@googlemail.com> wrote:
>>>> On Wed, Mar 24, 2010 at 19:47, Norman Maurer <no...@apache.org> wrote:
>>>>> Hi all,
>>>>>
>>>>> I want to propose some really heavy change in current JAMES trunk, and
>>>>> so next version. As all of you knows we are supporting IMAP in current
>>>>> development version, which ships with its own mail store backend
>>>>> called MailboxManager / Mailbox. For POP3 we use MailRepository as
>>>>> backend.
>>>>> I think this is a no go for a number of reasons, but the major one is
>>>>> that we should be able to switch between IMAP and POP3 without the
>>>>> need to migrate mails. So I rewrote the POP3Server to re-use the
>>>>> MailboxManager / Mailbox stuff which is used by IMAP.
>>>>>
>>>>> So if a user login via POP3 he will just see the folder called INBOX
>>>>> and nothing else. With IMAP he will see all folders. Thats exactly
>>>>> what dovecot and courier does ( both heavy used unix imap/pop3
>>>>> servers).
>>>>> Another advance is that we elimate one more dependency on storing
>>>>> mails via javamail, which is not the way to go for the future ...
>>>>> On the downside we will break backward-compatibility with every James
>>>>> release we did before. So we will need to write a "migration" tool,
>>>>> but this should not be to hard.
>>>>>
>>>>> Because the change is so heavy, I dedicited to attach it to JIRA for
>>>>> review and not commit it directly.
>>>>>
>>>>> You can find it here:
>>>>> https://issues.apache.org/jira/browse/JAMES-983
>>>>>
>>>>> So what do you think ?
>>>>
>>>> +1 on the proposal, (didn't review the code).
>>>>
>>>> This is what I suggested a long time ago, (and maybe if I search the
>>>> archives I'll find it, but if not than I wish that I would have
>>>> suggested it).
>>>>
>>>> Can you outline why is this such a big change and where the risks are
>>>> (except for running faster ;-)?
>>>>
>>>> Bernd
>>>>
>>>> ---------------------------------------------------------------------
>>>> To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
>>>> For additional commands, e-mail: server-dev-help@james.apache.org
>>>>
>>>>
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
>>> For additional commands, e-mail: server-dev-help@james.apache.org
>>>
>>>
>>
>>
>> Bye,
>> Norman
>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
> For additional commands, e-mail: server-dev-help@james.apache.org
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
For additional commands, e-mail: server-dev-help@james.apache.org
Re: [PROPOSAL] Replace MailRepository with Mailbox / MailboxManager
for POP3Server ...
Posted by Norman Maurer <no...@googlemail.com>.
Hi Manuel,
just checked and it compiles without a problem with java 5.
About the deletion of emails, I just re-readed the rfc on POP3 and I
think the patch does the right thing..
>From rfc1939:
DELE msg
Arguments:
a message-number (required) which may NOT refer to a
message marked as deleted
Restrictions:
may only be given in the TRANSACTION state
Discussion:
The POP3 server marks the message as deleted. Any future
reference to the message-number associated with the message
in a POP3 command generates an error. The POP3 server does
not actually delete the message until the POP3 session
enters the UPDATE state.
6. The UPDATE State
When the client issues the QUIT command from the TRANSACTION state,
the POP3 session enters the UPDATE state. (Note that if the client
issues the QUIT command from the AUTHORIZATION state, the POP3
session terminates but does NOT enter the UPDATE state.)
If a session terminates for some reason other than a client-issued
QUIT command, the POP3 session does NOT enter the UPDATE state and
MUST not remove any messages from the maildrop.
Bye,
Norman
2010/3/25 Norman Maurer <no...@googlemail.com>:
> Hi Manuel,
>
> Thx for the comments and for reviewing the stuff. Comments are inside...
>
> 2010/3/25 Manuel Carrasco Moñino <ma...@apache.org>:
>> Hi Norman, I''ve tried your patch and it works fine for me.
>>
>> Just a bunch of notes:
>> - It is necessary to uncomment the SieveMailet line to get the mails
>> in the IMAP repository. I suppose this should be the default.
>
> True, I would even rewrite the SieveMailet a bit for this.. But that
> is not a biggy
>
>> - It is supposed that James has to compile with java 1.5, but you are
>> using isEmpty() :-(
>
> Could catch, will replace this once we dedicited to commit the diff
>
>> - I think the name of the "INBOX" has to be provided by the
>> mailboxmanager instead of be hardcoded.
>
> Well INBOX is the default you would use with javamail too. So I don't
> saw this as a big problem ..
>
>> - Another thing is related with the 'DELE' command, messages are
>> marked for deleting, but it seems that they are not deleted until the
>> user does a quit, so in the case of a failure in the connection the
>> messages doesn't go deleted.
>
> I need to reread on this but I thought thats exactly how pop3 is
> supposed to work. In fact this was what the pop3server did before too
>
>> - Also It would be good to add in a next release some parameters like
>> move deleted messages to trash, mark deleted messages as seen, etc,
>> so that users using various MUA don't loose messages.
>
> Thats not the scope of POP3. POP3 doesn't support folders so thats not possible.
>
>>
>> I'm glad with the improvement (thanks Norman), so I vote to remove the
>> old mailrepository.
>>
>> Manolo
>>
>
> Thx again for your comments...
>
>
>>
>>
>> On Thu, Mar 25, 2010 at 11:41 AM, Bernd Fondermann
>> <be...@googlemail.com> wrote:
>>> On Wed, Mar 24, 2010 at 19:47, Norman Maurer <no...@apache.org> wrote:
>>>> Hi all,
>>>>
>>>> I want to propose some really heavy change in current JAMES trunk, and
>>>> so next version. As all of you knows we are supporting IMAP in current
>>>> development version, which ships with its own mail store backend
>>>> called MailboxManager / Mailbox. For POP3 we use MailRepository as
>>>> backend.
>>>> I think this is a no go for a number of reasons, but the major one is
>>>> that we should be able to switch between IMAP and POP3 without the
>>>> need to migrate mails. So I rewrote the POP3Server to re-use the
>>>> MailboxManager / Mailbox stuff which is used by IMAP.
>>>>
>>>> So if a user login via POP3 he will just see the folder called INBOX
>>>> and nothing else. With IMAP he will see all folders. Thats exactly
>>>> what dovecot and courier does ( both heavy used unix imap/pop3
>>>> servers).
>>>> Another advance is that we elimate one more dependency on storing
>>>> mails via javamail, which is not the way to go for the future ...
>>>> On the downside we will break backward-compatibility with every James
>>>> release we did before. So we will need to write a "migration" tool,
>>>> but this should not be to hard.
>>>>
>>>> Because the change is so heavy, I dedicited to attach it to JIRA for
>>>> review and not commit it directly.
>>>>
>>>> You can find it here:
>>>> https://issues.apache.org/jira/browse/JAMES-983
>>>>
>>>> So what do you think ?
>>>
>>> +1 on the proposal, (didn't review the code).
>>>
>>> This is what I suggested a long time ago, (and maybe if I search the
>>> archives I'll find it, but if not than I wish that I would have
>>> suggested it).
>>>
>>> Can you outline why is this such a big change and where the risks are
>>> (except for running faster ;-)?
>>>
>>> Bernd
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
>>> For additional commands, e-mail: server-dev-help@james.apache.org
>>>
>>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
>> For additional commands, e-mail: server-dev-help@james.apache.org
>>
>>
>
>
> Bye,
> Norman
>
---------------------------------------------------------------------
To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
For additional commands, e-mail: server-dev-help@james.apache.org
Re: [PROPOSAL] Replace MailRepository with Mailbox / MailboxManager
for POP3Server ...
Posted by Norman Maurer <no...@googlemail.com>.
Hi Manuel,
Thx for the comments and for reviewing the stuff. Comments are inside...
2010/3/25 Manuel Carrasco Moñino <ma...@apache.org>:
> Hi Norman, I''ve tried your patch and it works fine for me.
>
> Just a bunch of notes:
> - It is necessary to uncomment the SieveMailet line to get the mails
> in the IMAP repository. I suppose this should be the default.
True, I would even rewrite the SieveMailet a bit for this.. But that
is not a biggy
> - It is supposed that James has to compile with java 1.5, but you are
> using isEmpty() :-(
Could catch, will replace this once we dedicited to commit the diff
> - I think the name of the "INBOX" has to be provided by the
> mailboxmanager instead of be hardcoded.
Well INBOX is the default you would use with javamail too. So I don't
saw this as a big problem ..
> - Another thing is related with the 'DELE' command, messages are
> marked for deleting, but it seems that they are not deleted until the
> user does a quit, so in the case of a failure in the connection the
> messages doesn't go deleted.
I need to reread on this but I thought thats exactly how pop3 is
supposed to work. In fact this was what the pop3server did before too
> - Also It would be good to add in a next release some parameters like
> move deleted messages to trash, mark deleted messages as seen, etc,
> so that users using various MUA don't loose messages.
Thats not the scope of POP3. POP3 doesn't support folders so thats not possible.
>
> I'm glad with the improvement (thanks Norman), so I vote to remove the
> old mailrepository.
>
> Manolo
>
Thx again for your comments...
>
>
> On Thu, Mar 25, 2010 at 11:41 AM, Bernd Fondermann
> <be...@googlemail.com> wrote:
>> On Wed, Mar 24, 2010 at 19:47, Norman Maurer <no...@apache.org> wrote:
>>> Hi all,
>>>
>>> I want to propose some really heavy change in current JAMES trunk, and
>>> so next version. As all of you knows we are supporting IMAP in current
>>> development version, which ships with its own mail store backend
>>> called MailboxManager / Mailbox. For POP3 we use MailRepository as
>>> backend.
>>> I think this is a no go for a number of reasons, but the major one is
>>> that we should be able to switch between IMAP and POP3 without the
>>> need to migrate mails. So I rewrote the POP3Server to re-use the
>>> MailboxManager / Mailbox stuff which is used by IMAP.
>>>
>>> So if a user login via POP3 he will just see the folder called INBOX
>>> and nothing else. With IMAP he will see all folders. Thats exactly
>>> what dovecot and courier does ( both heavy used unix imap/pop3
>>> servers).
>>> Another advance is that we elimate one more dependency on storing
>>> mails via javamail, which is not the way to go for the future ...
>>> On the downside we will break backward-compatibility with every James
>>> release we did before. So we will need to write a "migration" tool,
>>> but this should not be to hard.
>>>
>>> Because the change is so heavy, I dedicited to attach it to JIRA for
>>> review and not commit it directly.
>>>
>>> You can find it here:
>>> https://issues.apache.org/jira/browse/JAMES-983
>>>
>>> So what do you think ?
>>
>> +1 on the proposal, (didn't review the code).
>>
>> This is what I suggested a long time ago, (and maybe if I search the
>> archives I'll find it, but if not than I wish that I would have
>> suggested it).
>>
>> Can you outline why is this such a big change and where the risks are
>> (except for running faster ;-)?
>>
>> Bernd
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
>> For additional commands, e-mail: server-dev-help@james.apache.org
>>
>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
> For additional commands, e-mail: server-dev-help@james.apache.org
>
>
Bye,
Norman
---------------------------------------------------------------------
To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
For additional commands, e-mail: server-dev-help@james.apache.org
Re: [PROPOSAL] Replace MailRepository with Mailbox / MailboxManager
for POP3Server ...
Posted by Manuel Carrasco Moñino <ma...@apache.org>.
Hi Norman, I''ve tried your patch and it works fine for me.
Just a bunch of notes:
- It is necessary to uncomment the SieveMailet line to get the mails
in the IMAP repository. I suppose this should be the default.
- It is supposed that James has to compile with java 1.5, but you are
using isEmpty() :-(
- I think the name of the "INBOX" has to be provided by the
mailboxmanager instead of be hardcoded.
- Another thing is related with the 'DELE' command, messages are
marked for deleting, but it seems that they are not deleted until the
user does a quit, so in the case of a failure in the connection the
messages doesn't go deleted.
- Also It would be good to add in a next release some parameters like
move deleted messages to trash, mark deleted messages as seen, etc,
so that users using various MUA don't loose messages.
I'm glad with the improvement (thanks Norman), so I vote to remove the
old mailrepository.
Manolo
On Thu, Mar 25, 2010 at 11:41 AM, Bernd Fondermann
<be...@googlemail.com> wrote:
> On Wed, Mar 24, 2010 at 19:47, Norman Maurer <no...@apache.org> wrote:
>> Hi all,
>>
>> I want to propose some really heavy change in current JAMES trunk, and
>> so next version. As all of you knows we are supporting IMAP in current
>> development version, which ships with its own mail store backend
>> called MailboxManager / Mailbox. For POP3 we use MailRepository as
>> backend.
>> I think this is a no go for a number of reasons, but the major one is
>> that we should be able to switch between IMAP and POP3 without the
>> need to migrate mails. So I rewrote the POP3Server to re-use the
>> MailboxManager / Mailbox stuff which is used by IMAP.
>>
>> So if a user login via POP3 he will just see the folder called INBOX
>> and nothing else. With IMAP he will see all folders. Thats exactly
>> what dovecot and courier does ( both heavy used unix imap/pop3
>> servers).
>> Another advance is that we elimate one more dependency on storing
>> mails via javamail, which is not the way to go for the future ...
>> On the downside we will break backward-compatibility with every James
>> release we did before. So we will need to write a "migration" tool,
>> but this should not be to hard.
>>
>> Because the change is so heavy, I dedicited to attach it to JIRA for
>> review and not commit it directly.
>>
>> You can find it here:
>> https://issues.apache.org/jira/browse/JAMES-983
>>
>> So what do you think ?
>
> +1 on the proposal, (didn't review the code).
>
> This is what I suggested a long time ago, (and maybe if I search the
> archives I'll find it, but if not than I wish that I would have
> suggested it).
>
> Can you outline why is this such a big change and where the risks are
> (except for running faster ;-)?
>
> Bernd
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
> For additional commands, e-mail: server-dev-help@james.apache.org
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
For additional commands, e-mail: server-dev-help@james.apache.org
Re: [PROPOSAL] Replace MailRepository with Mailbox / MailboxManager
for POP3Server ...
Posted by Bernd Fondermann <be...@googlemail.com>.
On Wed, Mar 24, 2010 at 19:47, Norman Maurer <no...@apache.org> wrote:
> Hi all,
>
> I want to propose some really heavy change in current JAMES trunk, and
> so next version. As all of you knows we are supporting IMAP in current
> development version, which ships with its own mail store backend
> called MailboxManager / Mailbox. For POP3 we use MailRepository as
> backend.
> I think this is a no go for a number of reasons, but the major one is
> that we should be able to switch between IMAP and POP3 without the
> need to migrate mails. So I rewrote the POP3Server to re-use the
> MailboxManager / Mailbox stuff which is used by IMAP.
>
> So if a user login via POP3 he will just see the folder called INBOX
> and nothing else. With IMAP he will see all folders. Thats exactly
> what dovecot and courier does ( both heavy used unix imap/pop3
> servers).
> Another advance is that we elimate one more dependency on storing
> mails via javamail, which is not the way to go for the future ...
> On the downside we will break backward-compatibility with every James
> release we did before. So we will need to write a "migration" tool,
> but this should not be to hard.
>
> Because the change is so heavy, I dedicited to attach it to JIRA for
> review and not commit it directly.
>
> You can find it here:
> https://issues.apache.org/jira/browse/JAMES-983
>
> So what do you think ?
+1 on the proposal, (didn't review the code).
This is what I suggested a long time ago, (and maybe if I search the
archives I'll find it, but if not than I wish that I would have
suggested it).
Can you outline why is this such a big change and where the risks are
(except for running faster ;-)?
Bernd
---------------------------------------------------------------------
To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
For additional commands, e-mail: server-dev-help@james.apache.org
Re: [PROPOSAL] Replace MailRepository with Mailbox / MailboxManager
for POP3Server ...
Posted by Norman Maurer <no...@googlemail.com>.
Hi Eric,
just post the infos when you have them, and I will look what I can do..
Bye,
Norman
2010/3/29 Eric Charles <er...@u-mangate.com>:
> Hi Norman,
>
> With wireshark, thunderbird/james hangs at POP3 STAT command.
> I saw you patched the StatCmdHandler. It now works even without any message
> in my mailbox (after update/package/deploy).
> Great!
>
> However:
> - I received a few exceptions complaining about the transaction (can not
> initiate a new one while still an active) while retrieving messages and the
> spool was doing some work.
> - I saw yesterday some strange behaviour when I made tests with different
> clients : deleted messages were still fetched by new clients.
>
> I will further investigate to post with more consolidated info.
>
> Many tks,
>
> Eric
>
>
> On 03/29/2010 08:53 AM, Norman Maurer wrote:
>>
>> Hi Eric, I was able to reproduce your problem and just checked in the
>> fix. Please svn up and try again..
>>
>> Thx for your feedback.
>>
>> Bye,
>> Norman
>>
>>
>> 2010/3/29 Norman Maurer<no...@apache.org>:
>>
>>>
>>> Hi Eric,
>>>
>>> I just tried to acces an empty inbox via thunderbird (pop3) here. It
>>> worked without any probs.
>>>
>>> Im using windows 7 and thunderbird 3.0.3
>>>
>>> Bye,
>>> Norman
>>>
>>>
>>> 2010/3/28 Norman Maurer<no...@apache.org>:
>>>
>>>>
>>>> ---------- Forwarded message ----------
>>>> From: Norman Maurer<no...@apache.org>
>>>> Date: 2010/3/28
>>>> Subject: Re: [PROPOSAL] Replace MailRepository with Mailbox /
>>>> MailboxManager for POP3Server ...
>>>> To: Eric Charles<er...@u-mangate.com>
>>>>
>>>>
>>>> Hi Eric,
>>>>
>>>> could you maybe use wireshark or something similar to log what
>>>> thunderbird tries todo exactly.. ?
>>>>
>>>> Thx,
>>>> Norman
>>>>
>>>>
>>>> 2010/3/28 Eric Charles<er...@u-mangate.com>:
>>>>
>>>>>
>>>>> Hi Norman,
>>>>>
>>>>> I just made the following tests:
>>>>>
>>>>> - Fresh checkout from trunk and mvn package (some new dependencies were
>>>>> downloaded such as jsieve, mailet-sdk,...) => same problem on a local
>>>>> deployment with thunderbird : it hangs when mailbox is empty.
>>>>>
>>>>> - I after defined my production account on evolution
>>>>> (http://www.gnome.org/projects/evolution) : I didn't have the problem
>>>>> anymore, but really strange, evolution downloaded some messages from
>>>>> yesterday. Those messages had been deleted from my inbox via
>>>>> thunderbird,
>>>>> but was retrieved via evolution...
>>>>>
>>>>> - I tested with evolution the local deployment I just made : I can read
>>>>> the
>>>>> inbox even if empty.
>>>>>
>>>>> The problem seems to reside on the thunderbird/james conversation when
>>>>> inbox
>>>>> is empty.
>>>>>
>>>>> Tks,
>>>>> Eric
>>>>>
>>>>>
>>>>> On 03/27/2010 10:08 PM, Norman Maurer wrote:
>>>>>
>>>>>>
>>>>>> Hi Eric,
>>>>>>
>>>>>> I just tested pop3 with imail and no messages in inbox and everything
>>>>>> "just works". Will try to test it with thunderbird later..
>>>>>>
>>>>>> Bye,
>>>>>> Norman
>>>>>>
>>>>>>
>>>>>> 2010/3/27 Norman Maurer<no...@apache.org>:
>>>>>>
>>>>>>
>>>>>>>
>>>>>>> Hi Eric,
>>>>>>>
>>>>>>> I will try to find out whats wrong with the pop3 inbox stuff. If you
>>>>>>> find out anything else please feel free to just report it..
>>>>>>>
>>>>>>> Thx,
>>>>>>> Norman
>>>>>>>
>>>>>>> 2010/3/27 Eric Charles<er...@u-mangate.com>:
>>>>>>>
>>>>>>>
>>>>>>>>
>>>>>>>> Hi Norman,
>>>>>>>>
>>>>>>>> Many tks for your quick answer.
>>>>>>>>
>>>>>>>> I had defined in my Thunderbird 3.0.3 client (on linux) the pop3
>>>>>>>> account
>>>>>>>> as
>>>>>>>> the default one.
>>>>>>>> When launching thunderbird, the connection was succefully done "Host
>>>>>>>> contacted, sending login information", saying after 1 second
>>>>>>>> "Determining
>>>>>>>> which messages to index" (never saw that message before...), hanging
>>>>>>>> there a
>>>>>>>> few minutes, and finally saying "connection to server ... timed
>>>>>>>> out".
>>>>>>>> After
>>>>>>>> that, Imap account behaved also such a way...
>>>>>>>> I also tried with latest Thundrebird 3.0.3: same result...
>>>>>>>>
>>>>>>>> I have now defined the imap account as the default one, and it's
>>>>>>>> working
>>>>>>>> fine even without any mail in the inbox.
>>>>>>>> However, for the pop3 account, I still have the same behaviour.
>>>>>>>> Anyway,
>>>>>>>> I
>>>>>>>>
>>
>>
>>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
> For additional commands, e-mail: server-dev-help@james.apache.org
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
For additional commands, e-mail: server-dev-help@james.apache.org
Re: [PROPOSAL] Replace MailRepository with Mailbox / MailboxManager
for POP3Server ...
Posted by Eric Charles <er...@u-mangate.com>.
Hi Norman,
With wireshark, thunderbird/james hangs at POP3 STAT command.
I saw you patched the StatCmdHandler. It now works even without any
message in my mailbox (after update/package/deploy).
Great!
However:
- I received a few exceptions complaining about the transaction (can not
initiate a new one while still an active) while retrieving messages and
the spool was doing some work.
- I saw yesterday some strange behaviour when I made tests with
different clients : deleted messages were still fetched by new clients.
I will further investigate to post with more consolidated info.
Many tks,
Eric
On 03/29/2010 08:53 AM, Norman Maurer wrote:
> Hi Eric, I was able to reproduce your problem and just checked in the
> fix. Please svn up and try again..
>
> Thx for your feedback.
>
> Bye,
> Norman
>
>
> 2010/3/29 Norman Maurer<no...@apache.org>:
>
>> Hi Eric,
>>
>> I just tried to acces an empty inbox via thunderbird (pop3) here. It
>> worked without any probs.
>>
>> Im using windows 7 and thunderbird 3.0.3
>>
>> Bye,
>> Norman
>>
>>
>> 2010/3/28 Norman Maurer<no...@apache.org>:
>>
>>> ---------- Forwarded message ----------
>>> From: Norman Maurer<no...@apache.org>
>>> Date: 2010/3/28
>>> Subject: Re: [PROPOSAL] Replace MailRepository with Mailbox /
>>> MailboxManager for POP3Server ...
>>> To: Eric Charles<er...@u-mangate.com>
>>>
>>>
>>> Hi Eric,
>>>
>>> could you maybe use wireshark or something similar to log what
>>> thunderbird tries todo exactly.. ?
>>>
>>> Thx,
>>> Norman
>>>
>>>
>>> 2010/3/28 Eric Charles<er...@u-mangate.com>:
>>>
>>>> Hi Norman,
>>>>
>>>> I just made the following tests:
>>>>
>>>> - Fresh checkout from trunk and mvn package (some new dependencies were
>>>> downloaded such as jsieve, mailet-sdk,...) => same problem on a local
>>>> deployment with thunderbird : it hangs when mailbox is empty.
>>>>
>>>> - I after defined my production account on evolution
>>>> (http://www.gnome.org/projects/evolution) : I didn't have the problem
>>>> anymore, but really strange, evolution downloaded some messages from
>>>> yesterday. Those messages had been deleted from my inbox via thunderbird,
>>>> but was retrieved via evolution...
>>>>
>>>> - I tested with evolution the local deployment I just made : I can read the
>>>> inbox even if empty.
>>>>
>>>> The problem seems to reside on the thunderbird/james conversation when inbox
>>>> is empty.
>>>>
>>>> Tks,
>>>> Eric
>>>>
>>>>
>>>> On 03/27/2010 10:08 PM, Norman Maurer wrote:
>>>>
>>>>> Hi Eric,
>>>>>
>>>>> I just tested pop3 with imail and no messages in inbox and everything
>>>>> "just works". Will try to test it with thunderbird later..
>>>>>
>>>>> Bye,
>>>>> Norman
>>>>>
>>>>>
>>>>> 2010/3/27 Norman Maurer<no...@apache.org>:
>>>>>
>>>>>
>>>>>> Hi Eric,
>>>>>>
>>>>>> I will try to find out whats wrong with the pop3 inbox stuff. If you
>>>>>> find out anything else please feel free to just report it..
>>>>>>
>>>>>> Thx,
>>>>>> Norman
>>>>>>
>>>>>> 2010/3/27 Eric Charles<er...@u-mangate.com>:
>>>>>>
>>>>>>
>>>>>>> Hi Norman,
>>>>>>>
>>>>>>> Many tks for your quick answer.
>>>>>>>
>>>>>>> I had defined in my Thunderbird 3.0.3 client (on linux) the pop3 account
>>>>>>> as
>>>>>>> the default one.
>>>>>>> When launching thunderbird, the connection was succefully done "Host
>>>>>>> contacted, sending login information", saying after 1 second
>>>>>>> "Determining
>>>>>>> which messages to index" (never saw that message before...), hanging
>>>>>>> there a
>>>>>>> few minutes, and finally saying "connection to server ... timed out".
>>>>>>> After
>>>>>>> that, Imap account behaved also such a way...
>>>>>>> I also tried with latest Thundrebird 3.0.3: same result...
>>>>>>>
>>>>>>> I have now defined the imap account as the default one, and it's working
>>>>>>> fine even without any mail in the inbox.
>>>>>>> However, for the pop3 account, I still have the same behaviour. Anyway,
>>>>>>> I
>>>>>>>
>
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
For additional commands, e-mail: server-dev-help@james.apache.org
Re: [PROPOSAL] Replace MailRepository with Mailbox / MailboxManager
for POP3Server ...
Posted by Norman Maurer <no...@apache.org>.
Hi Eric, I was able to reproduce your problem and just checked in the
fix. Please svn up and try again..
Thx for your feedback.
Bye,
Norman
2010/3/29 Norman Maurer <no...@apache.org>:
> Hi Eric,
>
> I just tried to acces an empty inbox via thunderbird (pop3) here. It
> worked without any probs.
>
> Im using windows 7 and thunderbird 3.0.3
>
> Bye,
> Norman
>
>
> 2010/3/28 Norman Maurer <no...@apache.org>:
>> ---------- Forwarded message ----------
>> From: Norman Maurer <no...@apache.org>
>> Date: 2010/3/28
>> Subject: Re: [PROPOSAL] Replace MailRepository with Mailbox /
>> MailboxManager for POP3Server ...
>> To: Eric Charles <er...@u-mangate.com>
>>
>>
>> Hi Eric,
>>
>> could you maybe use wireshark or something similar to log what
>> thunderbird tries todo exactly.. ?
>>
>> Thx,
>> Norman
>>
>>
>> 2010/3/28 Eric Charles <er...@u-mangate.com>:
>>> Hi Norman,
>>>
>>> I just made the following tests:
>>>
>>> - Fresh checkout from trunk and mvn package (some new dependencies were
>>> downloaded such as jsieve, mailet-sdk,...) => same problem on a local
>>> deployment with thunderbird : it hangs when mailbox is empty.
>>>
>>> - I after defined my production account on evolution
>>> (http://www.gnome.org/projects/evolution) : I didn't have the problem
>>> anymore, but really strange, evolution downloaded some messages from
>>> yesterday. Those messages had been deleted from my inbox via thunderbird,
>>> but was retrieved via evolution...
>>>
>>> - I tested with evolution the local deployment I just made : I can read the
>>> inbox even if empty.
>>>
>>> The problem seems to reside on the thunderbird/james conversation when inbox
>>> is empty.
>>>
>>> Tks,
>>> Eric
>>>
>>>
>>> On 03/27/2010 10:08 PM, Norman Maurer wrote:
>>>>
>>>> Hi Eric,
>>>>
>>>> I just tested pop3 with imail and no messages in inbox and everything
>>>> "just works". Will try to test it with thunderbird later..
>>>>
>>>> Bye,
>>>> Norman
>>>>
>>>>
>>>> 2010/3/27 Norman Maurer<no...@apache.org>:
>>>>
>>>>>
>>>>> Hi Eric,
>>>>>
>>>>> I will try to find out whats wrong with the pop3 inbox stuff. If you
>>>>> find out anything else please feel free to just report it..
>>>>>
>>>>> Thx,
>>>>> Norman
>>>>>
>>>>> 2010/3/27 Eric Charles<er...@u-mangate.com>:
>>>>>
>>>>>>
>>>>>> Hi Norman,
>>>>>>
>>>>>> Many tks for your quick answer.
>>>>>>
>>>>>> I had defined in my Thunderbird 3.0.3 client (on linux) the pop3 account
>>>>>> as
>>>>>> the default one.
>>>>>> When launching thunderbird, the connection was succefully done "Host
>>>>>> contacted, sending login information", saying after 1 second
>>>>>> "Determining
>>>>>> which messages to index" (never saw that message before...), hanging
>>>>>> there a
>>>>>> few minutes, and finally saying "connection to server ... timed out".
>>>>>> After
>>>>>> that, Imap account behaved also such a way...
>>>>>> I also tried with latest Thundrebird 3.0.3: same result...
>>>>>>
>>>>>> I have now defined the imap account as the default one, and it's working
>>>>>> fine even without any mail in the inbox.
>>>>>> However, for the pop3 account, I still have the same behaviour. Anyway,
>>>>>> I
>>>>>> have a temporary workaround right now.
>>>>>> I will try to debug it but it may take some time to jump into the new
>>>>>> architecture (I hacked james 3 years ago, but now we have some new great
>>>>>> stuff such as jpa, activemq, jackrabbit,...).
>>>>>>
>>>>>> Regarding the OOM, I saw some days ago the JAMES-981 regarding the
>>>>>> ConsumerTemplate.
>>>>>> However, the problem was still present even after you commited JAMES-981
>>>>>> into trunk, so I don't think the problem was coming from that.
>>>>>> I tried to analyse the 2GB heap dump with eclipse memory analyser, but
>>>>>> it
>>>>>> failed (too much swapping, my RAM is only 1GB).
>>>>>> Currently, the process memory with the new trunk version I deployed
>>>>>> today
>>>>>> seems stable.
>>>>>> I will keep posted if I still have the issue, or if finally, the memory
>>>>>> remains stable.
>>>>>>
>>>>>> Tks a lot and keep up the excellent work,
>>>>>>
>>>>>> Eric
>>>>>>
>>>>>>
>>>>>>
>>>>>> On 01/-10/-28163 08:59 PM, Norman Maurer wrote:
>>>>>>
>>>>>>>
>>>>>>> Hi Eric,
>>>>>>>
>>>>>>> thx for the feedback . Does this happens with pop3 or imap ? Or with
>>>>>>> both? What client you use?
>>>>>>>
>>>>>>> About the OOM Exception, chances are good that this is fixed now. I
>>>>>>> did something bad with ConsumerTemplate in RemoteDelivery nailet,
>>>>>>> which could lead to such problems.
>>>>>>>
>>>>>>> Bye
>>>>>>> Norman
>>>>>>>
>>>>>>> 2010/3/27, Eric Charles<er...@u-mangate.com>:
>>>>>>>
>>>>>>>
>>>>>>>>
>>>>>>>> Great Norman,
>>>>>>>>
>>>>>>>> I just upgraded to the current trunk to benefit from :
>>>>>>>> - JAMES-983: common POP3/IMAP MailRepository.
>>>>>>>> - JAMES-984: activemq 5.3.1 hoping it will resolve some OutOfMemory
>>>>>>>> exceptions I had (*)
>>>>>>>>
>>>>>>>> I deployed and now (configured with enableVirtualHosting=true and
>>>>>>>> JDBCDomainList), I've got the following:
>>>>>>>> - When my mailbox contains at least one mail, No problem: I can read
>>>>>>>> it
>>>>>>>> without any problem.
>>>>>>>> - When my mailbox is empty, my mail client simply waits and finally
>>>>>>>> give
>>>>>>>> me a timeout (closing my client and launching it again with mails in
>>>>>>>> the
>>>>>>>> inbox, everything is fine again).
>>>>>>>>
>>>>>>>> Can anybody else reproduce it?
>>>>>>>> Is there additional specific configuration I have to apply ?
>>>>>>>>
>>>>>>>> Tks a lot,
>>>>>>>>
>>>>>>>> Eric
>>>>>>>>
>>>>>>>>
>>>>>>>> (*) Just for information, about the OutOfMemory I had with activemq
>>>>>>>> 3.5.0:
>>>>>>>> - Testing different configurations from
>>>>>>>> http://activemq.apache.org/javalangoutofmemory.html didn't help.
>>>>>>>> - Stressing a local deployment with apache-sever-postage, server was
>>>>>>>> holding the pressure during hours, however, memory was slightly but
>>>>>>>> constantly growing.
>>>>>>>> - I have a heap dump to be analyzed (still todo)
>>>>>>>> - Reading 6 memory leak bugs resolved in activemq 3.5.1.
>>>>>>>>
>>>>>>>>
>>>>>>>> (https://issues.apache.org/activemq/secure/ReleaseNote.jspa?projectId=10520&styleName=Html&version=12183),
>>>>>>>> I decided to try to migrate to activemq 5.3.1, and by chance, Norman
>>>>>>>> checked it in two days ago. I still have to wait a few days to see if
>>>>>>>> the OutOfMemory problem is resolved.
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> On 12/23/-28158 08:59 PM, Norman Maurer wrote:
>>>>>>>>
>>>>>>>>
>>>>>>>>>
>>>>>>>>> Ok it seems like this works for everyone so far.. I will commit it
>>>>>>>>> this weekend ..
>>>>>>>>>
>>>>>>>>> Thanks again for all the feedback / questions.
>>>>>>>>>
>>>>>>>>> Bye,
>>>>>>>>> Norman
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> 2010/3/26 Stefano Bagnara<ap...@bago.org>:
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> 2010/3/24 Norman Maurer<no...@apache.org>:
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> Hi all,
>>>>>>>>>>>
>>>>>>>>>>> I want to propose some really heavy change in current JAMES trunk,
>>>>>>>>>>> and
>>>>>>>>>>> so next version. As all of you knows we are supporting IMAP in
>>>>>>>>>>> current
>>>>>>>>>>> development version, which ships with its own mail store backend
>>>>>>>>>>> called MailboxManager / Mailbox. For POP3 we use MailRepository as
>>>>>>>>>>> backend.
>>>>>>>>>>> I think this is a no go for a number of reasons, but the major one
>>>>>>>>>>> is
>>>>>>>>>>> that we should be able to switch between IMAP and POP3 without the
>>>>>>>>>>> need to migrate mails. So I rewrote the POP3Server to re-use the
>>>>>>>>>>> MailboxManager / Mailbox stuff which is used by IMAP.
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> I think this is a good think. I also hope MailboxManager/Mailbox API
>>>>>>>>>> can be improved and simplified, but using a single API is the only
>>>>>>>>>> way
>>>>>>>>>> to go. Once we use only one we'll better understand how to improve
>>>>>>>>>> it.
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> So if a user login via POP3 he will just see the folder called
>>>>>>>>>>> INBOX
>>>>>>>>>>> and nothing else. With IMAP he will see all folders. Thats exactly
>>>>>>>>>>> what dovecot and courier does ( both heavy used unix imap/pop3
>>>>>>>>>>> servers).
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> A good extension would be to have a "login pattern" to read custom
>>>>>>>>>> folders..
>>>>>>>>>> e.g: I login as "username#FOLDER" with username password and this
>>>>>>>>>> way
>>>>>>>>>> I get access to FOLDER instead of INBOX.
>>>>>>>>>> The same could be applied to the delete behaviour (something like
>>>>>>>>>> the
>>>>>>>>>> "recent:" prefix hack in gmail).
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> Another advance is that we elimate one more dependency on storing
>>>>>>>>>>> mails via javamail, which is not the way to go for the future ...
>>>>>>>>>>> On the downside we will break backward-compatibility with every
>>>>>>>>>>> James
>>>>>>>>>>> release we did before. So we will need to write a "migration" tool,
>>>>>>>>>>> but this should not be to hard.
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> IMO at this point we should plainly ignore backward compatibility.
>>>>>>>>>> AFTER we'll have a working release we'll define a migration path
>>>>>>>>>> (with
>>>>>>>>>> the help of users wanting to upgrade).
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> Because the change is so heavy, I dedicited to attach it to JIRA
>>>>>>>>>>> for
>>>>>>>>>>> review and not commit it directly.
>>>>>>>>>>>
>>>>>>>>>>> You can find it here:
>>>>>>>>>>> https://issues.apache.org/jira/browse/JAMES-983
>>>>>>>>>>>
>>>>>>>>>>> So what do you think ?
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> +1
>>>>>>>>>>
>>>>>>>>>> Stefano
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> ---------------------------------------------------------------------
>>>>>>>>>> To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
>>>>>>>>>> For additional commands, e-mail: server-dev-help@james.apache.org
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>> ---------------------------------------------------------------------
>>>>>>>>> To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
>>>>>>>>> For additional commands, e-mail: server-dev-help@james.apache.org
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>> ---------------------------------------------------------------------
>>>>>>> To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
>>>>>>> For additional commands, e-mail: server-dev-help@james.apache.org
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>
>>>
>>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
For additional commands, e-mail: server-dev-help@james.apache.org
Re: [PROPOSAL] Replace MailRepository with Mailbox / MailboxManager
for POP3Server ...
Posted by Norman Maurer <no...@apache.org>.
Hi Eric,
I just tried to acces an empty inbox via thunderbird (pop3) here. It
worked without any probs.
Im using windows 7 and thunderbird 3.0.3
Bye,
Norman
2010/3/28 Norman Maurer <no...@apache.org>:
> ---------- Forwarded message ----------
> From: Norman Maurer <no...@apache.org>
> Date: 2010/3/28
> Subject: Re: [PROPOSAL] Replace MailRepository with Mailbox /
> MailboxManager for POP3Server ...
> To: Eric Charles <er...@u-mangate.com>
>
>
> Hi Eric,
>
> could you maybe use wireshark or something similar to log what
> thunderbird tries todo exactly.. ?
>
> Thx,
> Norman
>
>
> 2010/3/28 Eric Charles <er...@u-mangate.com>:
>> Hi Norman,
>>
>> I just made the following tests:
>>
>> - Fresh checkout from trunk and mvn package (some new dependencies were
>> downloaded such as jsieve, mailet-sdk,...) => same problem on a local
>> deployment with thunderbird : it hangs when mailbox is empty.
>>
>> - I after defined my production account on evolution
>> (http://www.gnome.org/projects/evolution) : I didn't have the problem
>> anymore, but really strange, evolution downloaded some messages from
>> yesterday. Those messages had been deleted from my inbox via thunderbird,
>> but was retrieved via evolution...
>>
>> - I tested with evolution the local deployment I just made : I can read the
>> inbox even if empty.
>>
>> The problem seems to reside on the thunderbird/james conversation when inbox
>> is empty.
>>
>> Tks,
>> Eric
>>
>>
>> On 03/27/2010 10:08 PM, Norman Maurer wrote:
>>>
>>> Hi Eric,
>>>
>>> I just tested pop3 with imail and no messages in inbox and everything
>>> "just works". Will try to test it with thunderbird later..
>>>
>>> Bye,
>>> Norman
>>>
>>>
>>> 2010/3/27 Norman Maurer<no...@apache.org>:
>>>
>>>>
>>>> Hi Eric,
>>>>
>>>> I will try to find out whats wrong with the pop3 inbox stuff. If you
>>>> find out anything else please feel free to just report it..
>>>>
>>>> Thx,
>>>> Norman
>>>>
>>>> 2010/3/27 Eric Charles<er...@u-mangate.com>:
>>>>
>>>>>
>>>>> Hi Norman,
>>>>>
>>>>> Many tks for your quick answer.
>>>>>
>>>>> I had defined in my Thunderbird 3.0.3 client (on linux) the pop3 account
>>>>> as
>>>>> the default one.
>>>>> When launching thunderbird, the connection was succefully done "Host
>>>>> contacted, sending login information", saying after 1 second
>>>>> "Determining
>>>>> which messages to index" (never saw that message before...), hanging
>>>>> there a
>>>>> few minutes, and finally saying "connection to server ... timed out".
>>>>> After
>>>>> that, Imap account behaved also such a way...
>>>>> I also tried with latest Thundrebird 3.0.3: same result...
>>>>>
>>>>> I have now defined the imap account as the default one, and it's working
>>>>> fine even without any mail in the inbox.
>>>>> However, for the pop3 account, I still have the same behaviour. Anyway,
>>>>> I
>>>>> have a temporary workaround right now.
>>>>> I will try to debug it but it may take some time to jump into the new
>>>>> architecture (I hacked james 3 years ago, but now we have some new great
>>>>> stuff such as jpa, activemq, jackrabbit,...).
>>>>>
>>>>> Regarding the OOM, I saw some days ago the JAMES-981 regarding the
>>>>> ConsumerTemplate.
>>>>> However, the problem was still present even after you commited JAMES-981
>>>>> into trunk, so I don't think the problem was coming from that.
>>>>> I tried to analyse the 2GB heap dump with eclipse memory analyser, but
>>>>> it
>>>>> failed (too much swapping, my RAM is only 1GB).
>>>>> Currently, the process memory with the new trunk version I deployed
>>>>> today
>>>>> seems stable.
>>>>> I will keep posted if I still have the issue, or if finally, the memory
>>>>> remains stable.
>>>>>
>>>>> Tks a lot and keep up the excellent work,
>>>>>
>>>>> Eric
>>>>>
>>>>>
>>>>>
>>>>> On 01/-10/-28163 08:59 PM, Norman Maurer wrote:
>>>>>
>>>>>>
>>>>>> Hi Eric,
>>>>>>
>>>>>> thx for the feedback . Does this happens with pop3 or imap ? Or with
>>>>>> both? What client you use?
>>>>>>
>>>>>> About the OOM Exception, chances are good that this is fixed now. I
>>>>>> did something bad with ConsumerTemplate in RemoteDelivery nailet,
>>>>>> which could lead to such problems.
>>>>>>
>>>>>> Bye
>>>>>> Norman
>>>>>>
>>>>>> 2010/3/27, Eric Charles<er...@u-mangate.com>:
>>>>>>
>>>>>>
>>>>>>>
>>>>>>> Great Norman,
>>>>>>>
>>>>>>> I just upgraded to the current trunk to benefit from :
>>>>>>> - JAMES-983: common POP3/IMAP MailRepository.
>>>>>>> - JAMES-984: activemq 5.3.1 hoping it will resolve some OutOfMemory
>>>>>>> exceptions I had (*)
>>>>>>>
>>>>>>> I deployed and now (configured with enableVirtualHosting=true and
>>>>>>> JDBCDomainList), I've got the following:
>>>>>>> - When my mailbox contains at least one mail, No problem: I can read
>>>>>>> it
>>>>>>> without any problem.
>>>>>>> - When my mailbox is empty, my mail client simply waits and finally
>>>>>>> give
>>>>>>> me a timeout (closing my client and launching it again with mails in
>>>>>>> the
>>>>>>> inbox, everything is fine again).
>>>>>>>
>>>>>>> Can anybody else reproduce it?
>>>>>>> Is there additional specific configuration I have to apply ?
>>>>>>>
>>>>>>> Tks a lot,
>>>>>>>
>>>>>>> Eric
>>>>>>>
>>>>>>>
>>>>>>> (*) Just for information, about the OutOfMemory I had with activemq
>>>>>>> 3.5.0:
>>>>>>> - Testing different configurations from
>>>>>>> http://activemq.apache.org/javalangoutofmemory.html didn't help.
>>>>>>> - Stressing a local deployment with apache-sever-postage, server was
>>>>>>> holding the pressure during hours, however, memory was slightly but
>>>>>>> constantly growing.
>>>>>>> - I have a heap dump to be analyzed (still todo)
>>>>>>> - Reading 6 memory leak bugs resolved in activemq 3.5.1.
>>>>>>>
>>>>>>>
>>>>>>> (https://issues.apache.org/activemq/secure/ReleaseNote.jspa?projectId=10520&styleName=Html&version=12183),
>>>>>>> I decided to try to migrate to activemq 5.3.1, and by chance, Norman
>>>>>>> checked it in two days ago. I still have to wait a few days to see if
>>>>>>> the OutOfMemory problem is resolved.
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> On 12/23/-28158 08:59 PM, Norman Maurer wrote:
>>>>>>>
>>>>>>>
>>>>>>>>
>>>>>>>> Ok it seems like this works for everyone so far.. I will commit it
>>>>>>>> this weekend ..
>>>>>>>>
>>>>>>>> Thanks again for all the feedback / questions.
>>>>>>>>
>>>>>>>> Bye,
>>>>>>>> Norman
>>>>>>>>
>>>>>>>>
>>>>>>>> 2010/3/26 Stefano Bagnara<ap...@bago.org>:
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>>
>>>>>>>>> 2010/3/24 Norman Maurer<no...@apache.org>:
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> Hi all,
>>>>>>>>>>
>>>>>>>>>> I want to propose some really heavy change in current JAMES trunk,
>>>>>>>>>> and
>>>>>>>>>> so next version. As all of you knows we are supporting IMAP in
>>>>>>>>>> current
>>>>>>>>>> development version, which ships with its own mail store backend
>>>>>>>>>> called MailboxManager / Mailbox. For POP3 we use MailRepository as
>>>>>>>>>> backend.
>>>>>>>>>> I think this is a no go for a number of reasons, but the major one
>>>>>>>>>> is
>>>>>>>>>> that we should be able to switch between IMAP and POP3 without the
>>>>>>>>>> need to migrate mails. So I rewrote the POP3Server to re-use the
>>>>>>>>>> MailboxManager / Mailbox stuff which is used by IMAP.
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>> I think this is a good think. I also hope MailboxManager/Mailbox API
>>>>>>>>> can be improved and simplified, but using a single API is the only
>>>>>>>>> way
>>>>>>>>> to go. Once we use only one we'll better understand how to improve
>>>>>>>>> it.
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> So if a user login via POP3 he will just see the folder called
>>>>>>>>>> INBOX
>>>>>>>>>> and nothing else. With IMAP he will see all folders. Thats exactly
>>>>>>>>>> what dovecot and courier does ( both heavy used unix imap/pop3
>>>>>>>>>> servers).
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>> A good extension would be to have a "login pattern" to read custom
>>>>>>>>> folders..
>>>>>>>>> e.g: I login as "username#FOLDER" with username password and this
>>>>>>>>> way
>>>>>>>>> I get access to FOLDER instead of INBOX.
>>>>>>>>> The same could be applied to the delete behaviour (something like
>>>>>>>>> the
>>>>>>>>> "recent:" prefix hack in gmail).
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> Another advance is that we elimate one more dependency on storing
>>>>>>>>>> mails via javamail, which is not the way to go for the future ...
>>>>>>>>>> On the downside we will break backward-compatibility with every
>>>>>>>>>> James
>>>>>>>>>> release we did before. So we will need to write a "migration" tool,
>>>>>>>>>> but this should not be to hard.
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>> IMO at this point we should plainly ignore backward compatibility.
>>>>>>>>> AFTER we'll have a working release we'll define a migration path
>>>>>>>>> (with
>>>>>>>>> the help of users wanting to upgrade).
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> Because the change is so heavy, I dedicited to attach it to JIRA
>>>>>>>>>> for
>>>>>>>>>> review and not commit it directly.
>>>>>>>>>>
>>>>>>>>>> You can find it here:
>>>>>>>>>> https://issues.apache.org/jira/browse/JAMES-983
>>>>>>>>>>
>>>>>>>>>> So what do you think ?
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>> +1
>>>>>>>>>
>>>>>>>>> Stefano
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> ---------------------------------------------------------------------
>>>>>>>>> To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
>>>>>>>>> For additional commands, e-mail: server-dev-help@james.apache.org
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>>>> ---------------------------------------------------------------------
>>>>>>>> To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
>>>>>>>> For additional commands, e-mail: server-dev-help@james.apache.org
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>
>>>>>> ---------------------------------------------------------------------
>>>>>> To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
>>>>>> For additional commands, e-mail: server-dev-help@james.apache.org
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>
>>>>
>>
>>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
For additional commands, e-mail: server-dev-help@james.apache.org
Fwd: [PROPOSAL] Replace MailRepository with Mailbox / MailboxManager
for POP3Server ...
Posted by Norman Maurer <no...@apache.org>.
---------- Forwarded message ----------
From: Norman Maurer <no...@apache.org>
Date: 2010/3/28
Subject: Re: [PROPOSAL] Replace MailRepository with Mailbox /
MailboxManager for POP3Server ...
To: Eric Charles <er...@u-mangate.com>
Hi Eric,
could you maybe use wireshark or something similar to log what
thunderbird tries todo exactly.. ?
Thx,
Norman
2010/3/28 Eric Charles <er...@u-mangate.com>:
> Hi Norman,
>
> I just made the following tests:
>
> - Fresh checkout from trunk and mvn package (some new dependencies were
> downloaded such as jsieve, mailet-sdk,...) => same problem on a local
> deployment with thunderbird : it hangs when mailbox is empty.
>
> - I after defined my production account on evolution
> (http://www.gnome.org/projects/evolution) : I didn't have the problem
> anymore, but really strange, evolution downloaded some messages from
> yesterday. Those messages had been deleted from my inbox via thunderbird,
> but was retrieved via evolution...
>
> - I tested with evolution the local deployment I just made : I can read the
> inbox even if empty.
>
> The problem seems to reside on the thunderbird/james conversation when inbox
> is empty.
>
> Tks,
> Eric
>
>
> On 03/27/2010 10:08 PM, Norman Maurer wrote:
>>
>> Hi Eric,
>>
>> I just tested pop3 with imail and no messages in inbox and everything
>> "just works". Will try to test it with thunderbird later..
>>
>> Bye,
>> Norman
>>
>>
>> 2010/3/27 Norman Maurer<no...@apache.org>:
>>
>>>
>>> Hi Eric,
>>>
>>> I will try to find out whats wrong with the pop3 inbox stuff. If you
>>> find out anything else please feel free to just report it..
>>>
>>> Thx,
>>> Norman
>>>
>>> 2010/3/27 Eric Charles<er...@u-mangate.com>:
>>>
>>>>
>>>> Hi Norman,
>>>>
>>>> Many tks for your quick answer.
>>>>
>>>> I had defined in my Thunderbird 3.0.3 client (on linux) the pop3 account
>>>> as
>>>> the default one.
>>>> When launching thunderbird, the connection was succefully done "Host
>>>> contacted, sending login information", saying after 1 second
>>>> "Determining
>>>> which messages to index" (never saw that message before...), hanging
>>>> there a
>>>> few minutes, and finally saying "connection to server ... timed out".
>>>> After
>>>> that, Imap account behaved also such a way...
>>>> I also tried with latest Thundrebird 3.0.3: same result...
>>>>
>>>> I have now defined the imap account as the default one, and it's working
>>>> fine even without any mail in the inbox.
>>>> However, for the pop3 account, I still have the same behaviour. Anyway,
>>>> I
>>>> have a temporary workaround right now.
>>>> I will try to debug it but it may take some time to jump into the new
>>>> architecture (I hacked james 3 years ago, but now we have some new great
>>>> stuff such as jpa, activemq, jackrabbit,...).
>>>>
>>>> Regarding the OOM, I saw some days ago the JAMES-981 regarding the
>>>> ConsumerTemplate.
>>>> However, the problem was still present even after you commited JAMES-981
>>>> into trunk, so I don't think the problem was coming from that.
>>>> I tried to analyse the 2GB heap dump with eclipse memory analyser, but
>>>> it
>>>> failed (too much swapping, my RAM is only 1GB).
>>>> Currently, the process memory with the new trunk version I deployed
>>>> today
>>>> seems stable.
>>>> I will keep posted if I still have the issue, or if finally, the memory
>>>> remains stable.
>>>>
>>>> Tks a lot and keep up the excellent work,
>>>>
>>>> Eric
>>>>
>>>>
>>>>
>>>> On 01/-10/-28163 08:59 PM, Norman Maurer wrote:
>>>>
>>>>>
>>>>> Hi Eric,
>>>>>
>>>>> thx for the feedback . Does this happens with pop3 or imap ? Or with
>>>>> both? What client you use?
>>>>>
>>>>> About the OOM Exception, chances are good that this is fixed now. I
>>>>> did something bad with ConsumerTemplate in RemoteDelivery nailet,
>>>>> which could lead to such problems.
>>>>>
>>>>> Bye
>>>>> Norman
>>>>>
>>>>> 2010/3/27, Eric Charles<er...@u-mangate.com>:
>>>>>
>>>>>
>>>>>>
>>>>>> Great Norman,
>>>>>>
>>>>>> I just upgraded to the current trunk to benefit from :
>>>>>> - JAMES-983: common POP3/IMAP MailRepository.
>>>>>> - JAMES-984: activemq 5.3.1 hoping it will resolve some OutOfMemory
>>>>>> exceptions I had (*)
>>>>>>
>>>>>> I deployed and now (configured with enableVirtualHosting=true and
>>>>>> JDBCDomainList), I've got the following:
>>>>>> - When my mailbox contains at least one mail, No problem: I can read
>>>>>> it
>>>>>> without any problem.
>>>>>> - When my mailbox is empty, my mail client simply waits and finally
>>>>>> give
>>>>>> me a timeout (closing my client and launching it again with mails in
>>>>>> the
>>>>>> inbox, everything is fine again).
>>>>>>
>>>>>> Can anybody else reproduce it?
>>>>>> Is there additional specific configuration I have to apply ?
>>>>>>
>>>>>> Tks a lot,
>>>>>>
>>>>>> Eric
>>>>>>
>>>>>>
>>>>>> (*) Just for information, about the OutOfMemory I had with activemq
>>>>>> 3.5.0:
>>>>>> - Testing different configurations from
>>>>>> http://activemq.apache.org/javalangoutofmemory.html didn't help.
>>>>>> - Stressing a local deployment with apache-sever-postage, server was
>>>>>> holding the pressure during hours, however, memory was slightly but
>>>>>> constantly growing.
>>>>>> - I have a heap dump to be analyzed (still todo)
>>>>>> - Reading 6 memory leak bugs resolved in activemq 3.5.1.
>>>>>>
>>>>>>
>>>>>> (https://issues.apache.org/activemq/secure/ReleaseNote.jspa?projectId=10520&styleName=Html&version=12183),
>>>>>> I decided to try to migrate to activemq 5.3.1, and by chance, Norman
>>>>>> checked it in two days ago. I still have to wait a few days to see if
>>>>>> the OutOfMemory problem is resolved.
>>>>>>
>>>>>>
>>>>>>
>>>>>> On 12/23/-28158 08:59 PM, Norman Maurer wrote:
>>>>>>
>>>>>>
>>>>>>>
>>>>>>> Ok it seems like this works for everyone so far.. I will commit it
>>>>>>> this weekend ..
>>>>>>>
>>>>>>> Thanks again for all the feedback / questions.
>>>>>>>
>>>>>>> Bye,
>>>>>>> Norman
>>>>>>>
>>>>>>>
>>>>>>> 2010/3/26 Stefano Bagnara<ap...@bago.org>:
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>>
>>>>>>>> 2010/3/24 Norman Maurer<no...@apache.org>:
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>>
>>>>>>>>> Hi all,
>>>>>>>>>
>>>>>>>>> I want to propose some really heavy change in current JAMES trunk,
>>>>>>>>> and
>>>>>>>>> so next version. As all of you knows we are supporting IMAP in
>>>>>>>>> current
>>>>>>>>> development version, which ships with its own mail store backend
>>>>>>>>> called MailboxManager / Mailbox. For POP3 we use MailRepository as
>>>>>>>>> backend.
>>>>>>>>> I think this is a no go for a number of reasons, but the major one
>>>>>>>>> is
>>>>>>>>> that we should be able to switch between IMAP and POP3 without the
>>>>>>>>> need to migrate mails. So I rewrote the POP3Server to re-use the
>>>>>>>>> MailboxManager / Mailbox stuff which is used by IMAP.
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>>>> I think this is a good think. I also hope MailboxManager/Mailbox API
>>>>>>>> can be improved and simplified, but using a single API is the only
>>>>>>>> way
>>>>>>>> to go. Once we use only one we'll better understand how to improve
>>>>>>>> it.
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>>
>>>>>>>>> So if a user login via POP3 he will just see the folder called
>>>>>>>>> INBOX
>>>>>>>>> and nothing else. With IMAP he will see all folders. Thats exactly
>>>>>>>>> what dovecot and courier does ( both heavy used unix imap/pop3
>>>>>>>>> servers).
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>>>> A good extension would be to have a "login pattern" to read custom
>>>>>>>> folders..
>>>>>>>> e.g: I login as "username#FOLDER" with username password and this
>>>>>>>> way
>>>>>>>> I get access to FOLDER instead of INBOX.
>>>>>>>> The same could be applied to the delete behaviour (something like
>>>>>>>> the
>>>>>>>> "recent:" prefix hack in gmail).
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>>
>>>>>>>>> Another advance is that we elimate one more dependency on storing
>>>>>>>>> mails via javamail, which is not the way to go for the future ...
>>>>>>>>> On the downside we will break backward-compatibility with every
>>>>>>>>> James
>>>>>>>>> release we did before. So we will need to write a "migration" tool,
>>>>>>>>> but this should not be to hard.
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>>>> IMO at this point we should plainly ignore backward compatibility.
>>>>>>>> AFTER we'll have a working release we'll define a migration path
>>>>>>>> (with
>>>>>>>> the help of users wanting to upgrade).
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>>
>>>>>>>>> Because the change is so heavy, I dedicited to attach it to JIRA
>>>>>>>>> for
>>>>>>>>> review and not commit it directly.
>>>>>>>>>
>>>>>>>>> You can find it here:
>>>>>>>>> https://issues.apache.org/jira/browse/JAMES-983
>>>>>>>>>
>>>>>>>>> So what do you think ?
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>>>> +1
>>>>>>>>
>>>>>>>> Stefano
>>>>>>>>
>>>>>>>>
>>>>>>>> ---------------------------------------------------------------------
>>>>>>>> To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
>>>>>>>> For additional commands, e-mail: server-dev-help@james.apache.org
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>> ---------------------------------------------------------------------
>>>>>>> To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
>>>>>>> For additional commands, e-mail: server-dev-help@james.apache.org
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>> ---------------------------------------------------------------------
>>>>> To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
>>>>> For additional commands, e-mail: server-dev-help@james.apache.org
>>>>>
>>>>>
>>>>>
>>>>>
>>>>
>>>>
>>>
>>>
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
For additional commands, e-mail: server-dev-help@james.apache.org
Re: [PROPOSAL] Replace MailRepository with Mailbox / MailboxManager
for POP3Server ...
Posted by Eric Charles <er...@u-mangate.com>.
Hi Norman,
I just made the following tests:
- Fresh checkout from trunk and mvn package (some new dependencies were
downloaded such as jsieve, mailet-sdk,...) => same problem on a local
deployment with thunderbird : it hangs when mailbox is empty.
- I after defined my production account on evolution
(http://www.gnome.org/projects/evolution) : I didn't have the problem
anymore, but really strange, evolution downloaded some messages from
yesterday. Those messages had been deleted from my inbox via
thunderbird, but was retrieved via evolution...
- I tested with evolution the local deployment I just made : I can read
the inbox even if empty.
The problem seems to reside on the thunderbird/james conversation when
inbox is empty.
Tks,
Eric
On 03/27/2010 10:08 PM, Norman Maurer wrote:
> Hi Eric,
>
> I just tested pop3 with imail and no messages in inbox and everything
> "just works". Will try to test it with thunderbird later..
>
> Bye,
> Norman
>
>
> 2010/3/27 Norman Maurer<no...@apache.org>:
>
>> Hi Eric,
>>
>> I will try to find out whats wrong with the pop3 inbox stuff. If you
>> find out anything else please feel free to just report it..
>>
>> Thx,
>> Norman
>>
>> 2010/3/27 Eric Charles<er...@u-mangate.com>:
>>
>>> Hi Norman,
>>>
>>> Many tks for your quick answer.
>>>
>>> I had defined in my Thunderbird 3.0.3 client (on linux) the pop3 account as
>>> the default one.
>>> When launching thunderbird, the connection was succefully done "Host
>>> contacted, sending login information", saying after 1 second "Determining
>>> which messages to index" (never saw that message before...), hanging there a
>>> few minutes, and finally saying "connection to server ... timed out". After
>>> that, Imap account behaved also such a way...
>>> I also tried with latest Thundrebird 3.0.3: same result...
>>>
>>> I have now defined the imap account as the default one, and it's working
>>> fine even without any mail in the inbox.
>>> However, for the pop3 account, I still have the same behaviour. Anyway, I
>>> have a temporary workaround right now.
>>> I will try to debug it but it may take some time to jump into the new
>>> architecture (I hacked james 3 years ago, but now we have some new great
>>> stuff such as jpa, activemq, jackrabbit,...).
>>>
>>> Regarding the OOM, I saw some days ago the JAMES-981 regarding the
>>> ConsumerTemplate.
>>> However, the problem was still present even after you commited JAMES-981
>>> into trunk, so I don't think the problem was coming from that.
>>> I tried to analyse the 2GB heap dump with eclipse memory analyser, but it
>>> failed (too much swapping, my RAM is only 1GB).
>>> Currently, the process memory with the new trunk version I deployed today
>>> seems stable.
>>> I will keep posted if I still have the issue, or if finally, the memory
>>> remains stable.
>>>
>>> Tks a lot and keep up the excellent work,
>>>
>>> Eric
>>>
>>>
>>>
>>> On 01/-10/-28163 08:59 PM, Norman Maurer wrote:
>>>
>>>> Hi Eric,
>>>>
>>>> thx for the feedback . Does this happens with pop3 or imap ? Or with
>>>> both? What client you use?
>>>>
>>>> About the OOM Exception, chances are good that this is fixed now. I
>>>> did something bad with ConsumerTemplate in RemoteDelivery nailet,
>>>> which could lead to such problems.
>>>>
>>>> Bye
>>>> Norman
>>>>
>>>> 2010/3/27, Eric Charles<er...@u-mangate.com>:
>>>>
>>>>
>>>>> Great Norman,
>>>>>
>>>>> I just upgraded to the current trunk to benefit from :
>>>>> - JAMES-983: common POP3/IMAP MailRepository.
>>>>> - JAMES-984: activemq 5.3.1 hoping it will resolve some OutOfMemory
>>>>> exceptions I had (*)
>>>>>
>>>>> I deployed and now (configured with enableVirtualHosting=true and
>>>>> JDBCDomainList), I've got the following:
>>>>> - When my mailbox contains at least one mail, No problem: I can read it
>>>>> without any problem.
>>>>> - When my mailbox is empty, my mail client simply waits and finally give
>>>>> me a timeout (closing my client and launching it again with mails in the
>>>>> inbox, everything is fine again).
>>>>>
>>>>> Can anybody else reproduce it?
>>>>> Is there additional specific configuration I have to apply ?
>>>>>
>>>>> Tks a lot,
>>>>>
>>>>> Eric
>>>>>
>>>>>
>>>>> (*) Just for information, about the OutOfMemory I had with activemq
>>>>> 3.5.0:
>>>>> - Testing different configurations from
>>>>> http://activemq.apache.org/javalangoutofmemory.html didn't help.
>>>>> - Stressing a local deployment with apache-sever-postage, server was
>>>>> holding the pressure during hours, however, memory was slightly but
>>>>> constantly growing.
>>>>> - I have a heap dump to be analyzed (still todo)
>>>>> - Reading 6 memory leak bugs resolved in activemq 3.5.1.
>>>>>
>>>>> (https://issues.apache.org/activemq/secure/ReleaseNote.jspa?projectId=10520&styleName=Html&version=12183),
>>>>> I decided to try to migrate to activemq 5.3.1, and by chance, Norman
>>>>> checked it in two days ago. I still have to wait a few days to see if
>>>>> the OutOfMemory problem is resolved.
>>>>>
>>>>>
>>>>>
>>>>> On 12/23/-28158 08:59 PM, Norman Maurer wrote:
>>>>>
>>>>>
>>>>>> Ok it seems like this works for everyone so far.. I will commit it
>>>>>> this weekend ..
>>>>>>
>>>>>> Thanks again for all the feedback / questions.
>>>>>>
>>>>>> Bye,
>>>>>> Norman
>>>>>>
>>>>>>
>>>>>> 2010/3/26 Stefano Bagnara<ap...@bago.org>:
>>>>>>
>>>>>>
>>>>>>
>>>>>>> 2010/3/24 Norman Maurer<no...@apache.org>:
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>> Hi all,
>>>>>>>>
>>>>>>>> I want to propose some really heavy change in current JAMES trunk, and
>>>>>>>> so next version. As all of you knows we are supporting IMAP in current
>>>>>>>> development version, which ships with its own mail store backend
>>>>>>>> called MailboxManager / Mailbox. For POP3 we use MailRepository as
>>>>>>>> backend.
>>>>>>>> I think this is a no go for a number of reasons, but the major one is
>>>>>>>> that we should be able to switch between IMAP and POP3 without the
>>>>>>>> need to migrate mails. So I rewrote the POP3Server to re-use the
>>>>>>>> MailboxManager / Mailbox stuff which is used by IMAP.
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>> I think this is a good think. I also hope MailboxManager/Mailbox API
>>>>>>> can be improved and simplified, but using a single API is the only way
>>>>>>> to go. Once we use only one we'll better understand how to improve it.
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>> So if a user login via POP3 he will just see the folder called INBOX
>>>>>>>> and nothing else. With IMAP he will see all folders. Thats exactly
>>>>>>>> what dovecot and courier does ( both heavy used unix imap/pop3
>>>>>>>> servers).
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>> A good extension would be to have a "login pattern" to read custom
>>>>>>> folders..
>>>>>>> e.g: I login as "username#FOLDER" with username password and this way
>>>>>>> I get access to FOLDER instead of INBOX.
>>>>>>> The same could be applied to the delete behaviour (something like the
>>>>>>> "recent:" prefix hack in gmail).
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>> Another advance is that we elimate one more dependency on storing
>>>>>>>> mails via javamail, which is not the way to go for the future ...
>>>>>>>> On the downside we will break backward-compatibility with every James
>>>>>>>> release we did before. So we will need to write a "migration" tool,
>>>>>>>> but this should not be to hard.
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>> IMO at this point we should plainly ignore backward compatibility.
>>>>>>> AFTER we'll have a working release we'll define a migration path (with
>>>>>>> the help of users wanting to upgrade).
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>> Because the change is so heavy, I dedicited to attach it to JIRA for
>>>>>>>> review and not commit it directly.
>>>>>>>>
>>>>>>>> You can find it here:
>>>>>>>> https://issues.apache.org/jira/browse/JAMES-983
>>>>>>>>
>>>>>>>> So what do you think ?
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>> +1
>>>>>>>
>>>>>>> Stefano
>>>>>>>
>>>>>>> ---------------------------------------------------------------------
>>>>>>> To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
>>>>>>> For additional commands, e-mail: server-dev-help@james.apache.org
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>> ---------------------------------------------------------------------
>>>>>> To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
>>>>>> For additional commands, e-mail: server-dev-help@james.apache.org
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>> ---------------------------------------------------------------------
>>>> To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
>>>> For additional commands, e-mail: server-dev-help@james.apache.org
>>>>
>>>>
>>>>
>>>>
>>>
>>>
>>
---------------------------------------------------------------------
To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
For additional commands, e-mail: server-dev-help@james.apache.org
Re: Re: Re: [PROPOSAL] Replace MailRepository with Mailbox /
MailboxManager for POP3Server ...
Posted by Norman Maurer <no...@apache.org>.
Hi Eric,
I just tested pop3 with imail and no messages in inbox and everything
"just works". Will try to test it with thunderbird later..
Bye,
Norman
2010/3/27 Norman Maurer <no...@apache.org>:
> Hi Eric,
>
> I will try to find out whats wrong with the pop3 inbox stuff. If you
> find out anything else please feel free to just report it..
>
> Thx,
> Norman
>
> 2010/3/27 Eric Charles <er...@u-mangate.com>:
>> Hi Norman,
>>
>> Many tks for your quick answer.
>>
>> I had defined in my Thunderbird 3.0.3 client (on linux) the pop3 account as
>> the default one.
>> When launching thunderbird, the connection was succefully done "Host
>> contacted, sending login information", saying after 1 second "Determining
>> which messages to index" (never saw that message before...), hanging there a
>> few minutes, and finally saying "connection to server ... timed out". After
>> that, Imap account behaved also such a way...
>> I also tried with latest Thundrebird 3.0.3: same result...
>>
>> I have now defined the imap account as the default one, and it's working
>> fine even without any mail in the inbox.
>> However, for the pop3 account, I still have the same behaviour. Anyway, I
>> have a temporary workaround right now.
>> I will try to debug it but it may take some time to jump into the new
>> architecture (I hacked james 3 years ago, but now we have some new great
>> stuff such as jpa, activemq, jackrabbit,...).
>>
>> Regarding the OOM, I saw some days ago the JAMES-981 regarding the
>> ConsumerTemplate.
>> However, the problem was still present even after you commited JAMES-981
>> into trunk, so I don't think the problem was coming from that.
>> I tried to analyse the 2GB heap dump with eclipse memory analyser, but it
>> failed (too much swapping, my RAM is only 1GB).
>> Currently, the process memory with the new trunk version I deployed today
>> seems stable.
>> I will keep posted if I still have the issue, or if finally, the memory
>> remains stable.
>>
>> Tks a lot and keep up the excellent work,
>>
>> Eric
>>
>>
>>
>> On 01/-10/-28163 08:59 PM, Norman Maurer wrote:
>>>
>>> Hi Eric,
>>>
>>> thx for the feedback . Does this happens with pop3 or imap ? Or with
>>> both? What client you use?
>>>
>>> About the OOM Exception, chances are good that this is fixed now. I
>>> did something bad with ConsumerTemplate in RemoteDelivery nailet,
>>> which could lead to such problems.
>>>
>>> Bye
>>> Norman
>>>
>>> 2010/3/27, Eric Charles<er...@u-mangate.com>:
>>>
>>>>
>>>> Great Norman,
>>>>
>>>> I just upgraded to the current trunk to benefit from :
>>>> - JAMES-983: common POP3/IMAP MailRepository.
>>>> - JAMES-984: activemq 5.3.1 hoping it will resolve some OutOfMemory
>>>> exceptions I had (*)
>>>>
>>>> I deployed and now (configured with enableVirtualHosting=true and
>>>> JDBCDomainList), I've got the following:
>>>> - When my mailbox contains at least one mail, No problem: I can read it
>>>> without any problem.
>>>> - When my mailbox is empty, my mail client simply waits and finally give
>>>> me a timeout (closing my client and launching it again with mails in the
>>>> inbox, everything is fine again).
>>>>
>>>> Can anybody else reproduce it?
>>>> Is there additional specific configuration I have to apply ?
>>>>
>>>> Tks a lot,
>>>>
>>>> Eric
>>>>
>>>>
>>>> (*) Just for information, about the OutOfMemory I had with activemq
>>>> 3.5.0:
>>>> - Testing different configurations from
>>>> http://activemq.apache.org/javalangoutofmemory.html didn't help.
>>>> - Stressing a local deployment with apache-sever-postage, server was
>>>> holding the pressure during hours, however, memory was slightly but
>>>> constantly growing.
>>>> - I have a heap dump to be analyzed (still todo)
>>>> - Reading 6 memory leak bugs resolved in activemq 3.5.1.
>>>>
>>>> (https://issues.apache.org/activemq/secure/ReleaseNote.jspa?projectId=10520&styleName=Html&version=12183),
>>>> I decided to try to migrate to activemq 5.3.1, and by chance, Norman
>>>> checked it in two days ago. I still have to wait a few days to see if
>>>> the OutOfMemory problem is resolved.
>>>>
>>>>
>>>>
>>>> On 12/23/-28158 08:59 PM, Norman Maurer wrote:
>>>>
>>>>>
>>>>> Ok it seems like this works for everyone so far.. I will commit it
>>>>> this weekend ..
>>>>>
>>>>> Thanks again for all the feedback / questions.
>>>>>
>>>>> Bye,
>>>>> Norman
>>>>>
>>>>>
>>>>> 2010/3/26 Stefano Bagnara<ap...@bago.org>:
>>>>>
>>>>>
>>>>>>
>>>>>> 2010/3/24 Norman Maurer<no...@apache.org>:
>>>>>>
>>>>>>
>>>>>>>
>>>>>>> Hi all,
>>>>>>>
>>>>>>> I want to propose some really heavy change in current JAMES trunk, and
>>>>>>> so next version. As all of you knows we are supporting IMAP in current
>>>>>>> development version, which ships with its own mail store backend
>>>>>>> called MailboxManager / Mailbox. For POP3 we use MailRepository as
>>>>>>> backend.
>>>>>>> I think this is a no go for a number of reasons, but the major one is
>>>>>>> that we should be able to switch between IMAP and POP3 without the
>>>>>>> need to migrate mails. So I rewrote the POP3Server to re-use the
>>>>>>> MailboxManager / Mailbox stuff which is used by IMAP.
>>>>>>>
>>>>>>>
>>>>>>
>>>>>> I think this is a good think. I also hope MailboxManager/Mailbox API
>>>>>> can be improved and simplified, but using a single API is the only way
>>>>>> to go. Once we use only one we'll better understand how to improve it.
>>>>>>
>>>>>>
>>>>>>
>>>>>>>
>>>>>>> So if a user login via POP3 he will just see the folder called INBOX
>>>>>>> and nothing else. With IMAP he will see all folders. Thats exactly
>>>>>>> what dovecot and courier does ( both heavy used unix imap/pop3
>>>>>>> servers).
>>>>>>>
>>>>>>>
>>>>>>
>>>>>> A good extension would be to have a "login pattern" to read custom
>>>>>> folders..
>>>>>> e.g: I login as "username#FOLDER" with username password and this way
>>>>>> I get access to FOLDER instead of INBOX.
>>>>>> The same could be applied to the delete behaviour (something like the
>>>>>> "recent:" prefix hack in gmail).
>>>>>>
>>>>>>
>>>>>>
>>>>>>>
>>>>>>> Another advance is that we elimate one more dependency on storing
>>>>>>> mails via javamail, which is not the way to go for the future ...
>>>>>>> On the downside we will break backward-compatibility with every James
>>>>>>> release we did before. So we will need to write a "migration" tool,
>>>>>>> but this should not be to hard.
>>>>>>>
>>>>>>>
>>>>>>
>>>>>> IMO at this point we should plainly ignore backward compatibility.
>>>>>> AFTER we'll have a working release we'll define a migration path (with
>>>>>> the help of users wanting to upgrade).
>>>>>>
>>>>>>
>>>>>>
>>>>>>>
>>>>>>> Because the change is so heavy, I dedicited to attach it to JIRA for
>>>>>>> review and not commit it directly.
>>>>>>>
>>>>>>> You can find it here:
>>>>>>> https://issues.apache.org/jira/browse/JAMES-983
>>>>>>>
>>>>>>> So what do you think ?
>>>>>>>
>>>>>>>
>>>>>>
>>>>>> +1
>>>>>>
>>>>>> Stefano
>>>>>>
>>>>>> ---------------------------------------------------------------------
>>>>>> To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
>>>>>> For additional commands, e-mail: server-dev-help@james.apache.org
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>> ---------------------------------------------------------------------
>>>>> To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
>>>>> For additional commands, e-mail: server-dev-help@james.apache.org
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>
>>>>
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
>>> For additional commands, e-mail: server-dev-help@james.apache.org
>>>
>>>
>>>
>>
>>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
For additional commands, e-mail: server-dev-help@james.apache.org
Re: Re: Re: [PROPOSAL] Replace MailRepository with Mailbox /
MailboxManager for POP3Server ...
Posted by Norman Maurer <no...@apache.org>.
Hi Eric,
I will try to find out whats wrong with the pop3 inbox stuff. If you
find out anything else please feel free to just report it..
Thx,
Norman
2010/3/27 Eric Charles <er...@u-mangate.com>:
> Hi Norman,
>
> Many tks for your quick answer.
>
> I had defined in my Thunderbird 3.0.3 client (on linux) the pop3 account as
> the default one.
> When launching thunderbird, the connection was succefully done "Host
> contacted, sending login information", saying after 1 second "Determining
> which messages to index" (never saw that message before...), hanging there a
> few minutes, and finally saying "connection to server ... timed out". After
> that, Imap account behaved also such a way...
> I also tried with latest Thundrebird 3.0.3: same result...
>
> I have now defined the imap account as the default one, and it's working
> fine even without any mail in the inbox.
> However, for the pop3 account, I still have the same behaviour. Anyway, I
> have a temporary workaround right now.
> I will try to debug it but it may take some time to jump into the new
> architecture (I hacked james 3 years ago, but now we have some new great
> stuff such as jpa, activemq, jackrabbit,...).
>
> Regarding the OOM, I saw some days ago the JAMES-981 regarding the
> ConsumerTemplate.
> However, the problem was still present even after you commited JAMES-981
> into trunk, so I don't think the problem was coming from that.
> I tried to analyse the 2GB heap dump with eclipse memory analyser, but it
> failed (too much swapping, my RAM is only 1GB).
> Currently, the process memory with the new trunk version I deployed today
> seems stable.
> I will keep posted if I still have the issue, or if finally, the memory
> remains stable.
>
> Tks a lot and keep up the excellent work,
>
> Eric
>
>
>
> On 01/-10/-28163 08:59 PM, Norman Maurer wrote:
>>
>> Hi Eric,
>>
>> thx for the feedback . Does this happens with pop3 or imap ? Or with
>> both? What client you use?
>>
>> About the OOM Exception, chances are good that this is fixed now. I
>> did something bad with ConsumerTemplate in RemoteDelivery nailet,
>> which could lead to such problems.
>>
>> Bye
>> Norman
>>
>> 2010/3/27, Eric Charles<er...@u-mangate.com>:
>>
>>>
>>> Great Norman,
>>>
>>> I just upgraded to the current trunk to benefit from :
>>> - JAMES-983: common POP3/IMAP MailRepository.
>>> - JAMES-984: activemq 5.3.1 hoping it will resolve some OutOfMemory
>>> exceptions I had (*)
>>>
>>> I deployed and now (configured with enableVirtualHosting=true and
>>> JDBCDomainList), I've got the following:
>>> - When my mailbox contains at least one mail, No problem: I can read it
>>> without any problem.
>>> - When my mailbox is empty, my mail client simply waits and finally give
>>> me a timeout (closing my client and launching it again with mails in the
>>> inbox, everything is fine again).
>>>
>>> Can anybody else reproduce it?
>>> Is there additional specific configuration I have to apply ?
>>>
>>> Tks a lot,
>>>
>>> Eric
>>>
>>>
>>> (*) Just for information, about the OutOfMemory I had with activemq
>>> 3.5.0:
>>> - Testing different configurations from
>>> http://activemq.apache.org/javalangoutofmemory.html didn't help.
>>> - Stressing a local deployment with apache-sever-postage, server was
>>> holding the pressure during hours, however, memory was slightly but
>>> constantly growing.
>>> - I have a heap dump to be analyzed (still todo)
>>> - Reading 6 memory leak bugs resolved in activemq 3.5.1.
>>>
>>> (https://issues.apache.org/activemq/secure/ReleaseNote.jspa?projectId=10520&styleName=Html&version=12183),
>>> I decided to try to migrate to activemq 5.3.1, and by chance, Norman
>>> checked it in two days ago. I still have to wait a few days to see if
>>> the OutOfMemory problem is resolved.
>>>
>>>
>>>
>>> On 12/23/-28158 08:59 PM, Norman Maurer wrote:
>>>
>>>>
>>>> Ok it seems like this works for everyone so far.. I will commit it
>>>> this weekend ..
>>>>
>>>> Thanks again for all the feedback / questions.
>>>>
>>>> Bye,
>>>> Norman
>>>>
>>>>
>>>> 2010/3/26 Stefano Bagnara<ap...@bago.org>:
>>>>
>>>>
>>>>>
>>>>> 2010/3/24 Norman Maurer<no...@apache.org>:
>>>>>
>>>>>
>>>>>>
>>>>>> Hi all,
>>>>>>
>>>>>> I want to propose some really heavy change in current JAMES trunk, and
>>>>>> so next version. As all of you knows we are supporting IMAP in current
>>>>>> development version, which ships with its own mail store backend
>>>>>> called MailboxManager / Mailbox. For POP3 we use MailRepository as
>>>>>> backend.
>>>>>> I think this is a no go for a number of reasons, but the major one is
>>>>>> that we should be able to switch between IMAP and POP3 without the
>>>>>> need to migrate mails. So I rewrote the POP3Server to re-use the
>>>>>> MailboxManager / Mailbox stuff which is used by IMAP.
>>>>>>
>>>>>>
>>>>>
>>>>> I think this is a good think. I also hope MailboxManager/Mailbox API
>>>>> can be improved and simplified, but using a single API is the only way
>>>>> to go. Once we use only one we'll better understand how to improve it.
>>>>>
>>>>>
>>>>>
>>>>>>
>>>>>> So if a user login via POP3 he will just see the folder called INBOX
>>>>>> and nothing else. With IMAP he will see all folders. Thats exactly
>>>>>> what dovecot and courier does ( both heavy used unix imap/pop3
>>>>>> servers).
>>>>>>
>>>>>>
>>>>>
>>>>> A good extension would be to have a "login pattern" to read custom
>>>>> folders..
>>>>> e.g: I login as "username#FOLDER" with username password and this way
>>>>> I get access to FOLDER instead of INBOX.
>>>>> The same could be applied to the delete behaviour (something like the
>>>>> "recent:" prefix hack in gmail).
>>>>>
>>>>>
>>>>>
>>>>>>
>>>>>> Another advance is that we elimate one more dependency on storing
>>>>>> mails via javamail, which is not the way to go for the future ...
>>>>>> On the downside we will break backward-compatibility with every James
>>>>>> release we did before. So we will need to write a "migration" tool,
>>>>>> but this should not be to hard.
>>>>>>
>>>>>>
>>>>>
>>>>> IMO at this point we should plainly ignore backward compatibility.
>>>>> AFTER we'll have a working release we'll define a migration path (with
>>>>> the help of users wanting to upgrade).
>>>>>
>>>>>
>>>>>
>>>>>>
>>>>>> Because the change is so heavy, I dedicited to attach it to JIRA for
>>>>>> review and not commit it directly.
>>>>>>
>>>>>> You can find it here:
>>>>>> https://issues.apache.org/jira/browse/JAMES-983
>>>>>>
>>>>>> So what do you think ?
>>>>>>
>>>>>>
>>>>>
>>>>> +1
>>>>>
>>>>> Stefano
>>>>>
>>>>> ---------------------------------------------------------------------
>>>>> To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
>>>>> For additional commands, e-mail: server-dev-help@james.apache.org
>>>>>
>>>>>
>>>>>
>>>>>
>>>>
>>>> ---------------------------------------------------------------------
>>>> To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
>>>> For additional commands, e-mail: server-dev-help@james.apache.org
>>>>
>>>>
>>>>
>>>>
>>>>
>>>
>>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
>> For additional commands, e-mail: server-dev-help@james.apache.org
>>
>>
>>
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
For additional commands, e-mail: server-dev-help@james.apache.org
Re: Re: Re: [PROPOSAL] Replace MailRepository with Mailbox / MailboxManager
for POP3Server ...
Posted by Eric Charles <er...@u-mangate.com>.
Hi Norman,
Many tks for your quick answer.
I had defined in my Thunderbird 3.0.3 client (on linux) the pop3 account
as the default one.
When launching thunderbird, the connection was succefully done "Host
contacted, sending login information", saying after 1 second
"Determining which messages to index" (never saw that message
before...), hanging there a few minutes, and finally saying "connection
to server ... timed out". After that, Imap account behaved also such a
way...
I also tried with latest Thundrebird 3.0.3: same result...
I have now defined the imap account as the default one, and it's working
fine even without any mail in the inbox.
However, for the pop3 account, I still have the same behaviour. Anyway,
I have a temporary workaround right now.
I will try to debug it but it may take some time to jump into the new
architecture (I hacked james 3 years ago, but now we have some new great
stuff such as jpa, activemq, jackrabbit,...).
Regarding the OOM, I saw some days ago the JAMES-981 regarding the
ConsumerTemplate.
However, the problem was still present even after you commited JAMES-981
into trunk, so I don't think the problem was coming from that.
I tried to analyse the 2GB heap dump with eclipse memory analyser, but
it failed (too much swapping, my RAM is only 1GB).
Currently, the process memory with the new trunk version I deployed
today seems stable.
I will keep posted if I still have the issue, or if finally, the memory
remains stable.
Tks a lot and keep up the excellent work,
Eric
On 01/-10/-28163 08:59 PM, Norman Maurer wrote:
> Hi Eric,
>
> thx for the feedback . Does this happens with pop3 or imap ? Or with
> both? What client you use?
>
> About the OOM Exception, chances are good that this is fixed now. I
> did something bad with ConsumerTemplate in RemoteDelivery nailet,
> which could lead to such problems.
>
> Bye
> Norman
>
> 2010/3/27, Eric Charles<er...@u-mangate.com>:
>
>> Great Norman,
>>
>> I just upgraded to the current trunk to benefit from :
>> - JAMES-983: common POP3/IMAP MailRepository.
>> - JAMES-984: activemq 5.3.1 hoping it will resolve some OutOfMemory
>> exceptions I had (*)
>>
>> I deployed and now (configured with enableVirtualHosting=true and
>> JDBCDomainList), I've got the following:
>> - When my mailbox contains at least one mail, No problem: I can read it
>> without any problem.
>> - When my mailbox is empty, my mail client simply waits and finally give
>> me a timeout (closing my client and launching it again with mails in the
>> inbox, everything is fine again).
>>
>> Can anybody else reproduce it?
>> Is there additional specific configuration I have to apply ?
>>
>> Tks a lot,
>>
>> Eric
>>
>>
>> (*) Just for information, about the OutOfMemory I had with activemq 3.5.0:
>> - Testing different configurations from
>> http://activemq.apache.org/javalangoutofmemory.html didn't help.
>> - Stressing a local deployment with apache-sever-postage, server was
>> holding the pressure during hours, however, memory was slightly but
>> constantly growing.
>> - I have a heap dump to be analyzed (still todo)
>> - Reading 6 memory leak bugs resolved in activemq 3.5.1.
>> (https://issues.apache.org/activemq/secure/ReleaseNote.jspa?projectId=10520&styleName=Html&version=12183),
>> I decided to try to migrate to activemq 5.3.1, and by chance, Norman
>> checked it in two days ago. I still have to wait a few days to see if
>> the OutOfMemory problem is resolved.
>>
>>
>>
>> On 12/23/-28158 08:59 PM, Norman Maurer wrote:
>>
>>> Ok it seems like this works for everyone so far.. I will commit it
>>> this weekend ..
>>>
>>> Thanks again for all the feedback / questions.
>>>
>>> Bye,
>>> Norman
>>>
>>>
>>> 2010/3/26 Stefano Bagnara<ap...@bago.org>:
>>>
>>>
>>>> 2010/3/24 Norman Maurer<no...@apache.org>:
>>>>
>>>>
>>>>> Hi all,
>>>>>
>>>>> I want to propose some really heavy change in current JAMES trunk, and
>>>>> so next version. As all of you knows we are supporting IMAP in current
>>>>> development version, which ships with its own mail store backend
>>>>> called MailboxManager / Mailbox. For POP3 we use MailRepository as
>>>>> backend.
>>>>> I think this is a no go for a number of reasons, but the major one is
>>>>> that we should be able to switch between IMAP and POP3 without the
>>>>> need to migrate mails. So I rewrote the POP3Server to re-use the
>>>>> MailboxManager / Mailbox stuff which is used by IMAP.
>>>>>
>>>>>
>>>> I think this is a good think. I also hope MailboxManager/Mailbox API
>>>> can be improved and simplified, but using a single API is the only way
>>>> to go. Once we use only one we'll better understand how to improve it.
>>>>
>>>>
>>>>
>>>>> So if a user login via POP3 he will just see the folder called INBOX
>>>>> and nothing else. With IMAP he will see all folders. Thats exactly
>>>>> what dovecot and courier does ( both heavy used unix imap/pop3
>>>>> servers).
>>>>>
>>>>>
>>>> A good extension would be to have a "login pattern" to read custom
>>>> folders..
>>>> e.g: I login as "username#FOLDER" with username password and this way
>>>> I get access to FOLDER instead of INBOX.
>>>> The same could be applied to the delete behaviour (something like the
>>>> "recent:" prefix hack in gmail).
>>>>
>>>>
>>>>
>>>>> Another advance is that we elimate one more dependency on storing
>>>>> mails via javamail, which is not the way to go for the future ...
>>>>> On the downside we will break backward-compatibility with every James
>>>>> release we did before. So we will need to write a "migration" tool,
>>>>> but this should not be to hard.
>>>>>
>>>>>
>>>> IMO at this point we should plainly ignore backward compatibility.
>>>> AFTER we'll have a working release we'll define a migration path (with
>>>> the help of users wanting to upgrade).
>>>>
>>>>
>>>>
>>>>> Because the change is so heavy, I dedicited to attach it to JIRA for
>>>>> review and not commit it directly.
>>>>>
>>>>> You can find it here:
>>>>> https://issues.apache.org/jira/browse/JAMES-983
>>>>>
>>>>> So what do you think ?
>>>>>
>>>>>
>>>> +1
>>>>
>>>> Stefano
>>>>
>>>> ---------------------------------------------------------------------
>>>> To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
>>>> For additional commands, e-mail: server-dev-help@james.apache.org
>>>>
>>>>
>>>>
>>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
>>> For additional commands, e-mail: server-dev-help@james.apache.org
>>>
>>>
>>>
>>>
>>>
>>
>>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
> For additional commands, e-mail: server-dev-help@james.apache.org
>
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
For additional commands, e-mail: server-dev-help@james.apache.org
Re: Re: [PROPOSAL] Replace MailRepository with Mailbox /
MailboxManager for POP3Server ...
Posted by Norman Maurer <no...@apache.org>.
Hi Eric,
thx for the feedback . Does this happens with pop3 or imap ? Or with
both? What client you use?
About the OOM Exception, chances are good that this is fixed now. I
did something bad with ConsumerTemplate in RemoteDelivery nailet,
which could lead to such problems.
Bye
Norman
2010/3/27, Eric Charles <er...@u-mangate.com>:
> Great Norman,
>
> I just upgraded to the current trunk to benefit from :
> - JAMES-983: common POP3/IMAP MailRepository.
> - JAMES-984: activemq 5.3.1 hoping it will resolve some OutOfMemory
> exceptions I had (*)
>
> I deployed and now (configured with enableVirtualHosting=true and
> JDBCDomainList), I've got the following:
> - When my mailbox contains at least one mail, No problem: I can read it
> without any problem.
> - When my mailbox is empty, my mail client simply waits and finally give
> me a timeout (closing my client and launching it again with mails in the
> inbox, everything is fine again).
>
> Can anybody else reproduce it?
> Is there additional specific configuration I have to apply ?
>
> Tks a lot,
>
> Eric
>
>
> (*) Just for information, about the OutOfMemory I had with activemq 3.5.0:
> - Testing different configurations from
> http://activemq.apache.org/javalangoutofmemory.html didn't help.
> - Stressing a local deployment with apache-sever-postage, server was
> holding the pressure during hours, however, memory was slightly but
> constantly growing.
> - I have a heap dump to be analyzed (still todo)
> - Reading 6 memory leak bugs resolved in activemq 3.5.1.
> (https://issues.apache.org/activemq/secure/ReleaseNote.jspa?projectId=10520&styleName=Html&version=12183),
> I decided to try to migrate to activemq 5.3.1, and by chance, Norman
> checked it in two days ago. I still have to wait a few days to see if
> the OutOfMemory problem is resolved.
>
>
>
> On 12/23/-28158 08:59 PM, Norman Maurer wrote:
>> Ok it seems like this works for everyone so far.. I will commit it
>> this weekend ..
>>
>> Thanks again for all the feedback / questions.
>>
>> Bye,
>> Norman
>>
>>
>> 2010/3/26 Stefano Bagnara<ap...@bago.org>:
>>
>>> 2010/3/24 Norman Maurer<no...@apache.org>:
>>>
>>>> Hi all,
>>>>
>>>> I want to propose some really heavy change in current JAMES trunk, and
>>>> so next version. As all of you knows we are supporting IMAP in current
>>>> development version, which ships with its own mail store backend
>>>> called MailboxManager / Mailbox. For POP3 we use MailRepository as
>>>> backend.
>>>> I think this is a no go for a number of reasons, but the major one is
>>>> that we should be able to switch between IMAP and POP3 without the
>>>> need to migrate mails. So I rewrote the POP3Server to re-use the
>>>> MailboxManager / Mailbox stuff which is used by IMAP.
>>>>
>>> I think this is a good think. I also hope MailboxManager/Mailbox API
>>> can be improved and simplified, but using a single API is the only way
>>> to go. Once we use only one we'll better understand how to improve it.
>>>
>>>
>>>> So if a user login via POP3 he will just see the folder called INBOX
>>>> and nothing else. With IMAP he will see all folders. Thats exactly
>>>> what dovecot and courier does ( both heavy used unix imap/pop3
>>>> servers).
>>>>
>>> A good extension would be to have a "login pattern" to read custom
>>> folders..
>>> e.g: I login as "username#FOLDER" with username password and this way
>>> I get access to FOLDER instead of INBOX.
>>> The same could be applied to the delete behaviour (something like the
>>> "recent:" prefix hack in gmail).
>>>
>>>
>>>> Another advance is that we elimate one more dependency on storing
>>>> mails via javamail, which is not the way to go for the future ...
>>>> On the downside we will break backward-compatibility with every James
>>>> release we did before. So we will need to write a "migration" tool,
>>>> but this should not be to hard.
>>>>
>>> IMO at this point we should plainly ignore backward compatibility.
>>> AFTER we'll have a working release we'll define a migration path (with
>>> the help of users wanting to upgrade).
>>>
>>>
>>>> Because the change is so heavy, I dedicited to attach it to JIRA for
>>>> review and not commit it directly.
>>>>
>>>> You can find it here:
>>>> https://issues.apache.org/jira/browse/JAMES-983
>>>>
>>>> So what do you think ?
>>>>
>>> +1
>>>
>>> Stefano
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
>>> For additional commands, e-mail: server-dev-help@james.apache.org
>>>
>>>
>>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
>> For additional commands, e-mail: server-dev-help@james.apache.org
>>
>>
>>
>>
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
For additional commands, e-mail: server-dev-help@james.apache.org
Re: Re: [PROPOSAL] Replace MailRepository with Mailbox / MailboxManager
for POP3Server ...
Posted by Eric Charles <er...@u-mangate.com>.
Great Norman,
I just upgraded to the current trunk to benefit from :
- JAMES-983: common POP3/IMAP MailRepository.
- JAMES-984: activemq 5.3.1 hoping it will resolve some OutOfMemory
exceptions I had (*)
I deployed and now (configured with enableVirtualHosting=true and
JDBCDomainList), I've got the following:
- When my mailbox contains at least one mail, No problem: I can read it
without any problem.
- When my mailbox is empty, my mail client simply waits and finally give
me a timeout (closing my client and launching it again with mails in the
inbox, everything is fine again).
Can anybody else reproduce it?
Is there additional specific configuration I have to apply ?
Tks a lot,
Eric
(*) Just for information, about the OutOfMemory I had with activemq 3.5.0:
- Testing different configurations from
http://activemq.apache.org/javalangoutofmemory.html didn't help.
- Stressing a local deployment with apache-sever-postage, server was
holding the pressure during hours, however, memory was slightly but
constantly growing.
- I have a heap dump to be analyzed (still todo)
- Reading 6 memory leak bugs resolved in activemq 3.5.1.
(https://issues.apache.org/activemq/secure/ReleaseNote.jspa?projectId=10520&styleName=Html&version=12183),
I decided to try to migrate to activemq 5.3.1, and by chance, Norman
checked it in two days ago. I still have to wait a few days to see if
the OutOfMemory problem is resolved.
On 12/23/-28158 08:59 PM, Norman Maurer wrote:
> Ok it seems like this works for everyone so far.. I will commit it
> this weekend ..
>
> Thanks again for all the feedback / questions.
>
> Bye,
> Norman
>
>
> 2010/3/26 Stefano Bagnara<ap...@bago.org>:
>
>> 2010/3/24 Norman Maurer<no...@apache.org>:
>>
>>> Hi all,
>>>
>>> I want to propose some really heavy change in current JAMES trunk, and
>>> so next version. As all of you knows we are supporting IMAP in current
>>> development version, which ships with its own mail store backend
>>> called MailboxManager / Mailbox. For POP3 we use MailRepository as
>>> backend.
>>> I think this is a no go for a number of reasons, but the major one is
>>> that we should be able to switch between IMAP and POP3 without the
>>> need to migrate mails. So I rewrote the POP3Server to re-use the
>>> MailboxManager / Mailbox stuff which is used by IMAP.
>>>
>> I think this is a good think. I also hope MailboxManager/Mailbox API
>> can be improved and simplified, but using a single API is the only way
>> to go. Once we use only one we'll better understand how to improve it.
>>
>>
>>> So if a user login via POP3 he will just see the folder called INBOX
>>> and nothing else. With IMAP he will see all folders. Thats exactly
>>> what dovecot and courier does ( both heavy used unix imap/pop3
>>> servers).
>>>
>> A good extension would be to have a "login pattern" to read custom folders..
>> e.g: I login as "username#FOLDER" with username password and this way
>> I get access to FOLDER instead of INBOX.
>> The same could be applied to the delete behaviour (something like the
>> "recent:" prefix hack in gmail).
>>
>>
>>> Another advance is that we elimate one more dependency on storing
>>> mails via javamail, which is not the way to go for the future ...
>>> On the downside we will break backward-compatibility with every James
>>> release we did before. So we will need to write a "migration" tool,
>>> but this should not be to hard.
>>>
>> IMO at this point we should plainly ignore backward compatibility.
>> AFTER we'll have a working release we'll define a migration path (with
>> the help of users wanting to upgrade).
>>
>>
>>> Because the change is so heavy, I dedicited to attach it to JIRA for
>>> review and not commit it directly.
>>>
>>> You can find it here:
>>> https://issues.apache.org/jira/browse/JAMES-983
>>>
>>> So what do you think ?
>>>
>> +1
>>
>> Stefano
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
>> For additional commands, e-mail: server-dev-help@james.apache.org
>>
>>
>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
> For additional commands, e-mail: server-dev-help@james.apache.org
>
>
>
>
Re: [PROPOSAL] Replace MailRepository with Mailbox / MailboxManager
for POP3Server ...
Posted by Norman Maurer <no...@googlemail.com>.
Ok it seems like this works for everyone so far.. I will commit it
this weekend ..
Thanks again for all the feedback / questions.
Bye,
Norman
2010/3/26 Stefano Bagnara <ap...@bago.org>:
> 2010/3/24 Norman Maurer <no...@apache.org>:
>> Hi all,
>>
>> I want to propose some really heavy change in current JAMES trunk, and
>> so next version. As all of you knows we are supporting IMAP in current
>> development version, which ships with its own mail store backend
>> called MailboxManager / Mailbox. For POP3 we use MailRepository as
>> backend.
>> I think this is a no go for a number of reasons, but the major one is
>> that we should be able to switch between IMAP and POP3 without the
>> need to migrate mails. So I rewrote the POP3Server to re-use the
>> MailboxManager / Mailbox stuff which is used by IMAP.
>
> I think this is a good think. I also hope MailboxManager/Mailbox API
> can be improved and simplified, but using a single API is the only way
> to go. Once we use only one we'll better understand how to improve it.
>
>> So if a user login via POP3 he will just see the folder called INBOX
>> and nothing else. With IMAP he will see all folders. Thats exactly
>> what dovecot and courier does ( both heavy used unix imap/pop3
>> servers).
>
> A good extension would be to have a "login pattern" to read custom folders..
> e.g: I login as "username#FOLDER" with username password and this way
> I get access to FOLDER instead of INBOX.
> The same could be applied to the delete behaviour (something like the
> "recent:" prefix hack in gmail).
>
>> Another advance is that we elimate one more dependency on storing
>> mails via javamail, which is not the way to go for the future ...
>> On the downside we will break backward-compatibility with every James
>> release we did before. So we will need to write a "migration" tool,
>> but this should not be to hard.
>
> IMO at this point we should plainly ignore backward compatibility.
> AFTER we'll have a working release we'll define a migration path (with
> the help of users wanting to upgrade).
>
>> Because the change is so heavy, I dedicited to attach it to JIRA for
>> review and not commit it directly.
>>
>> You can find it here:
>> https://issues.apache.org/jira/browse/JAMES-983
>>
>> So what do you think ?
>
> +1
>
> Stefano
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
> For additional commands, e-mail: server-dev-help@james.apache.org
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
For additional commands, e-mail: server-dev-help@james.apache.org
Re: [PROPOSAL] Replace MailRepository with Mailbox / MailboxManager
for POP3Server ...
Posted by Stefano Bagnara <ap...@bago.org>.
2010/3/24 Norman Maurer <no...@apache.org>:
> Hi all,
>
> I want to propose some really heavy change in current JAMES trunk, and
> so next version. As all of you knows we are supporting IMAP in current
> development version, which ships with its own mail store backend
> called MailboxManager / Mailbox. For POP3 we use MailRepository as
> backend.
> I think this is a no go for a number of reasons, but the major one is
> that we should be able to switch between IMAP and POP3 without the
> need to migrate mails. So I rewrote the POP3Server to re-use the
> MailboxManager / Mailbox stuff which is used by IMAP.
I think this is a good think. I also hope MailboxManager/Mailbox API
can be improved and simplified, but using a single API is the only way
to go. Once we use only one we'll better understand how to improve it.
> So if a user login via POP3 he will just see the folder called INBOX
> and nothing else. With IMAP he will see all folders. Thats exactly
> what dovecot and courier does ( both heavy used unix imap/pop3
> servers).
A good extension would be to have a "login pattern" to read custom folders..
e.g: I login as "username#FOLDER" with username password and this way
I get access to FOLDER instead of INBOX.
The same could be applied to the delete behaviour (something like the
"recent:" prefix hack in gmail).
> Another advance is that we elimate one more dependency on storing
> mails via javamail, which is not the way to go for the future ...
> On the downside we will break backward-compatibility with every James
> release we did before. So we will need to write a "migration" tool,
> but this should not be to hard.
IMO at this point we should plainly ignore backward compatibility.
AFTER we'll have a working release we'll define a migration path (with
the help of users wanting to upgrade).
> Because the change is so heavy, I dedicited to attach it to JIRA for
> review and not commit it directly.
>
> You can find it here:
> https://issues.apache.org/jira/browse/JAMES-983
>
> So what do you think ?
+1
Stefano
---------------------------------------------------------------------
To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
For additional commands, e-mail: server-dev-help@james.apache.org