You are viewing a plain text version of this content. The canonical link for it is here.
Posted to server-dev@james.apache.org by Norman Maurer <no...@apache.org> on 2010/03/27 14:23:12 UTC

Re: Re: [PROPOSAL] Replace MailRepository with Mailbox / MailboxManager for POP3Server ...

Hi Eric,

thx for the feedback . Does this happens with pop3 or imap ? Or with
both? What client you use?

About the OOM Exception, chances are good that this is fixed now. I
did something bad with ConsumerTemplate in RemoteDelivery nailet,
which could lead to such problems.

Bye
Norman

2010/3/27, Eric Charles <er...@u-mangate.com>:
> Great Norman,
>
> I just upgraded to the current trunk to benefit from :
> - JAMES-983: common POP3/IMAP MailRepository.
> - JAMES-984: activemq 5.3.1 hoping it will resolve some OutOfMemory
> exceptions I had (*)
>
> I deployed and now (configured with enableVirtualHosting=true and
> JDBCDomainList), I've got the following:
> - When my mailbox contains at least one mail, No problem: I can read it
> without any problem.
> - When my mailbox is empty, my mail client simply waits and finally give
> me a timeout (closing my client and launching it again with mails in the
> inbox, everything is fine again).
>
> Can anybody else reproduce it?
> Is there additional specific configuration I have to apply ?
>
> Tks a lot,
>
> Eric
>
>
> (*) Just for information, about the OutOfMemory I had with activemq 3.5.0:
> - Testing different configurations from
> http://activemq.apache.org/javalangoutofmemory.html didn't help.
> - Stressing a local deployment with apache-sever-postage, server was
> holding the pressure during hours, however, memory was slightly but
> constantly growing.
> - I have a heap dump to be analyzed (still todo)
> - Reading 6 memory leak bugs resolved in activemq 3.5.1.
> (https://issues.apache.org/activemq/secure/ReleaseNote.jspa?projectId=10520&styleName=Html&version=12183),
> I decided to try to migrate to activemq 5.3.1, and by chance, Norman
> checked it in two days ago. I still have to wait a few days to see if
> the OutOfMemory problem is resolved.
>
>
>
> On 12/23/-28158 08:59 PM, Norman Maurer wrote:
>> Ok it seems like this works for everyone so far.. I will commit it
>> this weekend ..
>>
>> Thanks again for all the feedback / questions.
>>
>> Bye,
>> Norman
>>
>>
>> 2010/3/26 Stefano Bagnara<ap...@bago.org>:
>>
>>> 2010/3/24 Norman Maurer<no...@apache.org>:
>>>
>>>> Hi all,
>>>>
>>>> I want to propose some really heavy change in current JAMES trunk, and
>>>> so next version. As all of you knows we are supporting IMAP in current
>>>> development version, which ships with its own mail store backend
>>>> called MailboxManager / Mailbox. For POP3 we use MailRepository as
>>>> backend.
>>>> I think this is a no go for a number of reasons, but the major one is
>>>> that we should be able to switch between IMAP and POP3 without the
>>>> need to migrate mails. So I rewrote the POP3Server to re-use the
>>>> MailboxManager / Mailbox stuff which is used by IMAP.
>>>>
>>> I think this is a good think. I also hope MailboxManager/Mailbox API
>>> can be improved and simplified, but using a single API is the only way
>>> to go. Once we use only one we'll better understand how to improve it.
>>>
>>>
>>>> So if a user login via POP3 he will just see the folder called INBOX
>>>> and nothing else. With IMAP he will see all folders. Thats exactly
>>>> what dovecot and courier does ( both heavy used unix imap/pop3
>>>> servers).
>>>>
>>> A good extension would be to have a "login pattern" to read custom
>>> folders..
>>> e.g: I login as "username#FOLDER" with username password and this way
>>> I get access to FOLDER instead of INBOX.
>>> The same could be applied to the delete behaviour (something like the
>>> "recent:" prefix hack in gmail).
>>>
>>>
>>>> Another advance is that we elimate one more dependency on storing
>>>> mails via javamail, which is not the way to go for the future ...
>>>> On the downside we will break backward-compatibility with every James
>>>> release we did before. So we will need to write a "migration" tool,
>>>> but this should not be to hard.
>>>>
>>> IMO at this point we should plainly ignore backward compatibility.
>>> AFTER we'll have a working release we'll define a migration path (with
>>> the help of users wanting to upgrade).
>>>
>>>
>>>> Because the change is so heavy, I dedicited to attach it to JIRA  for
>>>> review and not commit it directly.
>>>>
>>>> You can find it here:
>>>> https://issues.apache.org/jira/browse/JAMES-983
>>>>
>>>> So what do you think ?
>>>>
>>> +1
>>>
>>> Stefano
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
>>> For additional commands, e-mail: server-dev-help@james.apache.org
>>>
>>>
>>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
>> For additional commands, e-mail: server-dev-help@james.apache.org
>>
>>
>>
>>
>
>

---------------------------------------------------------------------
To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
For additional commands, e-mail: server-dev-help@james.apache.org


Re: [PROPOSAL] Replace MailRepository with Mailbox / MailboxManager for POP3Server ...

Posted by Norman Maurer <no...@googlemail.com>.
Hi Eric,

just post the infos when you have them, and I will look what I can do..

Bye,
Norman


2010/3/29 Eric Charles <er...@u-mangate.com>:
> Hi Norman,
>
> With wireshark, thunderbird/james hangs at POP3 STAT command.
> I saw you patched the StatCmdHandler. It now works even without any message
> in my mailbox (after update/package/deploy).
> Great!
>
> However:
> - I received a few exceptions complaining about the transaction (can not
> initiate a new one while still an active) while retrieving messages and the
> spool was doing some work.
> - I saw yesterday some strange behaviour when I made tests with different
> clients : deleted messages were still fetched by new clients.
>
> I will further investigate to post with more consolidated info.
>
> Many tks,
>
> Eric
>
>
> On 03/29/2010 08:53 AM, Norman Maurer wrote:
>>
>> Hi Eric, I was able to reproduce your problem and just checked in the
>> fix. Please svn up and try again..
>>
>> Thx for your feedback.
>>
>> Bye,
>> Norman
>>
>>
>> 2010/3/29 Norman Maurer<no...@apache.org>:
>>
>>>
>>> Hi Eric,
>>>
>>> I just tried to acces an empty inbox via thunderbird (pop3) here. It
>>> worked without any probs.
>>>
>>> Im using windows 7 and thunderbird 3.0.3
>>>
>>> Bye,
>>> Norman
>>>
>>>
>>> 2010/3/28 Norman Maurer<no...@apache.org>:
>>>
>>>>
>>>> ---------- Forwarded message ----------
>>>> From: Norman Maurer<no...@apache.org>
>>>> Date: 2010/3/28
>>>> Subject: Re: [PROPOSAL] Replace MailRepository with Mailbox /
>>>> MailboxManager for POP3Server ...
>>>> To: Eric Charles<er...@u-mangate.com>
>>>>
>>>>
>>>> Hi Eric,
>>>>
>>>> could you maybe use wireshark or something similar to log what
>>>> thunderbird tries todo exactly.. ?
>>>>
>>>> Thx,
>>>> Norman
>>>>
>>>>
>>>> 2010/3/28 Eric Charles<er...@u-mangate.com>:
>>>>
>>>>>
>>>>> Hi Norman,
>>>>>
>>>>> I just made the following tests:
>>>>>
>>>>> - Fresh checkout from trunk and mvn package (some new dependencies were
>>>>> downloaded such as jsieve, mailet-sdk,...) =>  same problem on a local
>>>>> deployment with thunderbird : it hangs when mailbox is empty.
>>>>>
>>>>> - I after defined my production account on evolution
>>>>> (http://www.gnome.org/projects/evolution) : I didn't have the problem
>>>>> anymore, but really strange, evolution downloaded some messages from
>>>>> yesterday. Those messages had been deleted from my inbox via
>>>>> thunderbird,
>>>>> but was retrieved via evolution...
>>>>>
>>>>> - I tested with evolution the local deployment I just made : I can read
>>>>> the
>>>>> inbox even if empty.
>>>>>
>>>>> The problem seems to reside on the thunderbird/james conversation when
>>>>> inbox
>>>>> is empty.
>>>>>
>>>>> Tks,
>>>>> Eric
>>>>>
>>>>>
>>>>> On 03/27/2010 10:08 PM, Norman Maurer wrote:
>>>>>
>>>>>>
>>>>>> Hi Eric,
>>>>>>
>>>>>> I just tested pop3 with imail and no messages in inbox and everything
>>>>>> "just works". Will try to test it with thunderbird later..
>>>>>>
>>>>>> Bye,
>>>>>> Norman
>>>>>>
>>>>>>
>>>>>> 2010/3/27 Norman Maurer<no...@apache.org>:
>>>>>>
>>>>>>
>>>>>>>
>>>>>>> Hi Eric,
>>>>>>>
>>>>>>> I will try to find out whats wrong with the pop3 inbox stuff. If you
>>>>>>> find out anything else please feel free to just report it..
>>>>>>>
>>>>>>> Thx,
>>>>>>> Norman
>>>>>>>
>>>>>>> 2010/3/27 Eric Charles<er...@u-mangate.com>:
>>>>>>>
>>>>>>>
>>>>>>>>
>>>>>>>> Hi Norman,
>>>>>>>>
>>>>>>>> Many tks for your quick answer.
>>>>>>>>
>>>>>>>> I had defined in my Thunderbird 3.0.3 client (on linux) the pop3
>>>>>>>> account
>>>>>>>> as
>>>>>>>> the default one.
>>>>>>>> When launching thunderbird, the connection was succefully done "Host
>>>>>>>> contacted, sending login information", saying after 1 second
>>>>>>>> "Determining
>>>>>>>> which messages to index" (never saw that message before...), hanging
>>>>>>>> there a
>>>>>>>> few minutes, and finally saying "connection to server ... timed
>>>>>>>> out".
>>>>>>>> After
>>>>>>>> that, Imap account behaved also such a way...
>>>>>>>> I also tried with latest Thundrebird 3.0.3: same result...
>>>>>>>>
>>>>>>>> I have now defined the imap account as the default one, and it's
>>>>>>>> working
>>>>>>>> fine even without any mail in the inbox.
>>>>>>>> However, for the pop3 account, I still have the same behaviour.
>>>>>>>>  Anyway,
>>>>>>>> I
>>>>>>>>
>>
>>
>>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
> For additional commands, e-mail: server-dev-help@james.apache.org
>
>

---------------------------------------------------------------------
To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
For additional commands, e-mail: server-dev-help@james.apache.org


Re: [PROPOSAL] Replace MailRepository with Mailbox / MailboxManager for POP3Server ...

Posted by Eric Charles <er...@u-mangate.com>.
Hi Norman,

With wireshark, thunderbird/james hangs at POP3 STAT command.
I saw you patched the StatCmdHandler. It now works even without any 
message in my mailbox (after update/package/deploy).
Great!

However:
- I received a few exceptions complaining about the transaction (can not 
initiate a new one while still an active) while retrieving messages and 
the spool was doing some work.
- I saw yesterday some strange behaviour when I made tests with 
different clients : deleted messages were still fetched by new clients.

I will further investigate to post with more consolidated info.

Many tks,

Eric


On 03/29/2010 08:53 AM, Norman Maurer wrote:
> Hi Eric, I was able to reproduce your problem and just checked in the
> fix. Please svn up and try again..
>
> Thx for your feedback.
>
> Bye,
> Norman
>
>
> 2010/3/29 Norman Maurer<no...@apache.org>:
>    
>> Hi Eric,
>>
>> I just tried to acces an empty inbox via thunderbird (pop3) here. It
>> worked without any probs.
>>
>> Im using windows 7 and thunderbird 3.0.3
>>
>> Bye,
>> Norman
>>
>>
>> 2010/3/28 Norman Maurer<no...@apache.org>:
>>      
>>> ---------- Forwarded message ----------
>>> From: Norman Maurer<no...@apache.org>
>>> Date: 2010/3/28
>>> Subject: Re: [PROPOSAL] Replace MailRepository with Mailbox /
>>> MailboxManager for POP3Server ...
>>> To: Eric Charles<er...@u-mangate.com>
>>>
>>>
>>> Hi Eric,
>>>
>>> could you maybe use wireshark or something similar to log what
>>> thunderbird tries todo exactly.. ?
>>>
>>> Thx,
>>> Norman
>>>
>>>
>>> 2010/3/28 Eric Charles<er...@u-mangate.com>:
>>>        
>>>> Hi Norman,
>>>>
>>>> I just made the following tests:
>>>>
>>>> - Fresh checkout from trunk and mvn package (some new dependencies were
>>>> downloaded such as jsieve, mailet-sdk,...) =>  same problem on a local
>>>> deployment with thunderbird : it hangs when mailbox is empty.
>>>>
>>>> - I after defined my production account on evolution
>>>> (http://www.gnome.org/projects/evolution) : I didn't have the problem
>>>> anymore, but really strange, evolution downloaded some messages from
>>>> yesterday. Those messages had been deleted from my inbox via thunderbird,
>>>> but was retrieved via evolution...
>>>>
>>>> - I tested with evolution the local deployment I just made : I can read the
>>>> inbox even if empty.
>>>>
>>>> The problem seems to reside on the thunderbird/james conversation when inbox
>>>> is empty.
>>>>
>>>> Tks,
>>>> Eric
>>>>
>>>>
>>>> On 03/27/2010 10:08 PM, Norman Maurer wrote:
>>>>          
>>>>> Hi Eric,
>>>>>
>>>>> I just tested pop3 with imail and no messages in inbox and everything
>>>>> "just works". Will try to test it with thunderbird later..
>>>>>
>>>>> Bye,
>>>>> Norman
>>>>>
>>>>>
>>>>> 2010/3/27 Norman Maurer<no...@apache.org>:
>>>>>
>>>>>            
>>>>>> Hi Eric,
>>>>>>
>>>>>> I will try to find out whats wrong with the pop3 inbox stuff. If you
>>>>>> find out anything else please feel free to just report it..
>>>>>>
>>>>>> Thx,
>>>>>> Norman
>>>>>>
>>>>>> 2010/3/27 Eric Charles<er...@u-mangate.com>:
>>>>>>
>>>>>>              
>>>>>>> Hi Norman,
>>>>>>>
>>>>>>> Many tks for your quick answer.
>>>>>>>
>>>>>>> I had defined in my Thunderbird 3.0.3 client (on linux) the pop3 account
>>>>>>> as
>>>>>>> the default one.
>>>>>>> When launching thunderbird, the connection was succefully done "Host
>>>>>>> contacted, sending login information", saying after 1 second
>>>>>>> "Determining
>>>>>>> which messages to index" (never saw that message before...), hanging
>>>>>>> there a
>>>>>>> few minutes, and finally saying "connection to server ... timed out".
>>>>>>> After
>>>>>>> that, Imap account behaved also such a way...
>>>>>>> I also tried with latest Thundrebird 3.0.3: same result...
>>>>>>>
>>>>>>> I have now defined the imap account as the default one, and it's working
>>>>>>> fine even without any mail in the inbox.
>>>>>>> However, for the pop3 account, I still have the same behaviour.  Anyway,
>>>>>>> I
>>>>>>>                
>
>
>    


---------------------------------------------------------------------
To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
For additional commands, e-mail: server-dev-help@james.apache.org


Re: [PROPOSAL] Replace MailRepository with Mailbox / MailboxManager for POP3Server ...

Posted by Norman Maurer <no...@apache.org>.
Hi Eric, I was able to reproduce your problem and just checked in the
fix. Please svn up and try again..

Thx for your feedback.

Bye,
Norman


2010/3/29 Norman Maurer <no...@apache.org>:
> Hi Eric,
>
> I just tried to acces an empty inbox via thunderbird (pop3) here. It
> worked without any probs.
>
> Im using windows 7 and thunderbird 3.0.3
>
> Bye,
> Norman
>
>
> 2010/3/28 Norman Maurer <no...@apache.org>:
>> ---------- Forwarded message ----------
>> From: Norman Maurer <no...@apache.org>
>> Date: 2010/3/28
>> Subject: Re: [PROPOSAL] Replace MailRepository with Mailbox /
>> MailboxManager for POP3Server ...
>> To: Eric Charles <er...@u-mangate.com>
>>
>>
>> Hi Eric,
>>
>> could you maybe use wireshark or something similar to log what
>> thunderbird tries todo exactly.. ?
>>
>> Thx,
>> Norman
>>
>>
>> 2010/3/28 Eric Charles <er...@u-mangate.com>:
>>> Hi Norman,
>>>
>>> I just made the following tests:
>>>
>>> - Fresh checkout from trunk and mvn package (some new dependencies were
>>> downloaded such as jsieve, mailet-sdk,...) => same problem on a local
>>> deployment with thunderbird : it hangs when mailbox is empty.
>>>
>>> - I after defined my production account on evolution
>>> (http://www.gnome.org/projects/evolution) : I didn't have the problem
>>> anymore, but really strange, evolution downloaded some messages from
>>> yesterday. Those messages had been deleted from my inbox via thunderbird,
>>> but was retrieved via evolution...
>>>
>>> - I tested with evolution the local deployment I just made : I can read the
>>> inbox even if empty.
>>>
>>> The problem seems to reside on the thunderbird/james conversation when inbox
>>> is empty.
>>>
>>> Tks,
>>> Eric
>>>
>>>
>>> On 03/27/2010 10:08 PM, Norman Maurer wrote:
>>>>
>>>> Hi Eric,
>>>>
>>>> I just tested pop3 with imail and no messages in inbox and everything
>>>> "just works". Will try to test it with thunderbird later..
>>>>
>>>> Bye,
>>>> Norman
>>>>
>>>>
>>>> 2010/3/27 Norman Maurer<no...@apache.org>:
>>>>
>>>>>
>>>>> Hi Eric,
>>>>>
>>>>> I will try to find out whats wrong with the pop3 inbox stuff. If you
>>>>> find out anything else please feel free to just report it..
>>>>>
>>>>> Thx,
>>>>> Norman
>>>>>
>>>>> 2010/3/27 Eric Charles<er...@u-mangate.com>:
>>>>>
>>>>>>
>>>>>> Hi Norman,
>>>>>>
>>>>>> Many tks for your quick answer.
>>>>>>
>>>>>> I had defined in my Thunderbird 3.0.3 client (on linux) the pop3 account
>>>>>> as
>>>>>> the default one.
>>>>>> When launching thunderbird, the connection was succefully done "Host
>>>>>> contacted, sending login information", saying after 1 second
>>>>>> "Determining
>>>>>> which messages to index" (never saw that message before...), hanging
>>>>>> there a
>>>>>> few minutes, and finally saying "connection to server ... timed out".
>>>>>> After
>>>>>> that, Imap account behaved also such a way...
>>>>>> I also tried with latest Thundrebird 3.0.3: same result...
>>>>>>
>>>>>> I have now defined the imap account as the default one, and it's working
>>>>>> fine even without any mail in the inbox.
>>>>>> However, for the pop3 account, I still have the same behaviour.  Anyway,
>>>>>> I
>>>>>> have a temporary workaround right now.
>>>>>> I will try to debug it but it may take some time to jump into the new
>>>>>> architecture (I hacked james 3 years ago, but now we have some new great
>>>>>> stuff  such as jpa, activemq, jackrabbit,...).
>>>>>>
>>>>>> Regarding the OOM, I saw some days ago the JAMES-981 regarding the
>>>>>> ConsumerTemplate.
>>>>>> However, the problem was still present even after you commited JAMES-981
>>>>>> into trunk, so I don't think the problem was coming from that.
>>>>>> I tried to analyse the 2GB heap dump with eclipse memory analyser, but
>>>>>> it
>>>>>> failed (too much swapping, my RAM is only 1GB).
>>>>>> Currently, the process memory with the new trunk version I deployed
>>>>>> today
>>>>>> seems stable.
>>>>>> I will keep posted if I still have the issue, or if finally, the memory
>>>>>> remains stable.
>>>>>>
>>>>>> Tks a lot and keep up the excellent work,
>>>>>>
>>>>>> Eric
>>>>>>
>>>>>>
>>>>>>
>>>>>> On 01/-10/-28163 08:59 PM, Norman Maurer wrote:
>>>>>>
>>>>>>>
>>>>>>> Hi Eric,
>>>>>>>
>>>>>>> thx for the feedback . Does this happens with pop3 or imap ? Or with
>>>>>>> both? What client you use?
>>>>>>>
>>>>>>> About the OOM Exception, chances are good that this is fixed now. I
>>>>>>> did something bad with ConsumerTemplate in RemoteDelivery nailet,
>>>>>>> which could lead to such problems.
>>>>>>>
>>>>>>> Bye
>>>>>>> Norman
>>>>>>>
>>>>>>> 2010/3/27, Eric Charles<er...@u-mangate.com>:
>>>>>>>
>>>>>>>
>>>>>>>>
>>>>>>>> Great Norman,
>>>>>>>>
>>>>>>>> I just upgraded to the current trunk to benefit from :
>>>>>>>> - JAMES-983: common POP3/IMAP MailRepository.
>>>>>>>> - JAMES-984: activemq 5.3.1 hoping it will resolve some OutOfMemory
>>>>>>>> exceptions I had (*)
>>>>>>>>
>>>>>>>> I deployed and now (configured with enableVirtualHosting=true and
>>>>>>>> JDBCDomainList), I've got the following:
>>>>>>>> - When my mailbox contains at least one mail, No problem: I can read
>>>>>>>> it
>>>>>>>> without any problem.
>>>>>>>> - When my mailbox is empty, my mail client simply waits and finally
>>>>>>>> give
>>>>>>>> me a timeout (closing my client and launching it again with mails in
>>>>>>>> the
>>>>>>>> inbox, everything is fine again).
>>>>>>>>
>>>>>>>> Can anybody else reproduce it?
>>>>>>>> Is there additional specific configuration I have to apply ?
>>>>>>>>
>>>>>>>> Tks a lot,
>>>>>>>>
>>>>>>>> Eric
>>>>>>>>
>>>>>>>>
>>>>>>>> (*) Just for information, about the OutOfMemory I had with activemq
>>>>>>>> 3.5.0:
>>>>>>>> - Testing different configurations from
>>>>>>>> http://activemq.apache.org/javalangoutofmemory.html didn't help.
>>>>>>>> - Stressing a local deployment with apache-sever-postage, server was
>>>>>>>> holding the pressure during hours, however, memory was slightly but
>>>>>>>> constantly growing.
>>>>>>>> - I have a heap dump to be analyzed (still todo)
>>>>>>>> - Reading 6 memory leak bugs resolved in activemq 3.5.1.
>>>>>>>>
>>>>>>>>
>>>>>>>> (https://issues.apache.org/activemq/secure/ReleaseNote.jspa?projectId=10520&styleName=Html&version=12183),
>>>>>>>> I decided to try to migrate to activemq 5.3.1, and by chance, Norman
>>>>>>>> checked it in two days ago. I still have to wait a few days to see if
>>>>>>>> the OutOfMemory problem is resolved.
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> On 12/23/-28158 08:59 PM, Norman Maurer wrote:
>>>>>>>>
>>>>>>>>
>>>>>>>>>
>>>>>>>>> Ok it seems like this works for everyone so far.. I will commit it
>>>>>>>>> this weekend ..
>>>>>>>>>
>>>>>>>>> Thanks again for all the feedback / questions.
>>>>>>>>>
>>>>>>>>> Bye,
>>>>>>>>> Norman
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> 2010/3/26 Stefano Bagnara<ap...@bago.org>:
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> 2010/3/24 Norman Maurer<no...@apache.org>:
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> Hi all,
>>>>>>>>>>>
>>>>>>>>>>> I want to propose some really heavy change in current JAMES trunk,
>>>>>>>>>>> and
>>>>>>>>>>> so next version. As all of you knows we are supporting IMAP in
>>>>>>>>>>> current
>>>>>>>>>>> development version, which ships with its own mail store backend
>>>>>>>>>>> called MailboxManager / Mailbox. For POP3 we use MailRepository as
>>>>>>>>>>> backend.
>>>>>>>>>>> I think this is a no go for a number of reasons, but the major one
>>>>>>>>>>> is
>>>>>>>>>>> that we should be able to switch between IMAP and POP3 without the
>>>>>>>>>>> need to migrate mails. So I rewrote the POP3Server to re-use the
>>>>>>>>>>> MailboxManager / Mailbox stuff which is used by IMAP.
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> I think this is a good think. I also hope MailboxManager/Mailbox API
>>>>>>>>>> can be improved and simplified, but using a single API is the only
>>>>>>>>>> way
>>>>>>>>>> to go. Once we use only one we'll better understand how to improve
>>>>>>>>>> it.
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> So if a user login via POP3 he will just see the folder called
>>>>>>>>>>> INBOX
>>>>>>>>>>> and nothing else. With IMAP he will see all folders. Thats exactly
>>>>>>>>>>> what dovecot and courier does ( both heavy used unix imap/pop3
>>>>>>>>>>> servers).
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> A good extension would be to have a "login pattern" to read custom
>>>>>>>>>> folders..
>>>>>>>>>> e.g: I login as "username#FOLDER" with username password and this
>>>>>>>>>> way
>>>>>>>>>> I get access to FOLDER instead of INBOX.
>>>>>>>>>> The same could be applied to the delete behaviour (something like
>>>>>>>>>> the
>>>>>>>>>> "recent:" prefix hack in gmail).
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> Another advance is that we elimate one more dependency on storing
>>>>>>>>>>> mails via javamail, which is not the way to go for the future ...
>>>>>>>>>>> On the downside we will break backward-compatibility with every
>>>>>>>>>>> James
>>>>>>>>>>> release we did before. So we will need to write a "migration" tool,
>>>>>>>>>>> but this should not be to hard.
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> IMO at this point we should plainly ignore backward compatibility.
>>>>>>>>>> AFTER we'll have a working release we'll define a migration path
>>>>>>>>>> (with
>>>>>>>>>> the help of users wanting to upgrade).
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> Because the change is so heavy, I dedicited to attach it to JIRA
>>>>>>>>>>>  for
>>>>>>>>>>> review and not commit it directly.
>>>>>>>>>>>
>>>>>>>>>>> You can find it here:
>>>>>>>>>>> https://issues.apache.org/jira/browse/JAMES-983
>>>>>>>>>>>
>>>>>>>>>>> So what do you think ?
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> +1
>>>>>>>>>>
>>>>>>>>>> Stefano
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> ---------------------------------------------------------------------
>>>>>>>>>> To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
>>>>>>>>>> For additional commands, e-mail: server-dev-help@james.apache.org
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>> ---------------------------------------------------------------------
>>>>>>>>> To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
>>>>>>>>> For additional commands, e-mail: server-dev-help@james.apache.org
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>> ---------------------------------------------------------------------
>>>>>>> To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
>>>>>>> For additional commands, e-mail: server-dev-help@james.apache.org
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>
>>>
>>
>

---------------------------------------------------------------------
To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
For additional commands, e-mail: server-dev-help@james.apache.org


Re: [PROPOSAL] Replace MailRepository with Mailbox / MailboxManager for POP3Server ...

Posted by Norman Maurer <no...@apache.org>.
Hi Eric,

I just tried to acces an empty inbox via thunderbird (pop3) here. It
worked without any probs.

Im using windows 7 and thunderbird 3.0.3

Bye,
Norman


2010/3/28 Norman Maurer <no...@apache.org>:
> ---------- Forwarded message ----------
> From: Norman Maurer <no...@apache.org>
> Date: 2010/3/28
> Subject: Re: [PROPOSAL] Replace MailRepository with Mailbox /
> MailboxManager for POP3Server ...
> To: Eric Charles <er...@u-mangate.com>
>
>
> Hi Eric,
>
> could you maybe use wireshark or something similar to log what
> thunderbird tries todo exactly.. ?
>
> Thx,
> Norman
>
>
> 2010/3/28 Eric Charles <er...@u-mangate.com>:
>> Hi Norman,
>>
>> I just made the following tests:
>>
>> - Fresh checkout from trunk and mvn package (some new dependencies were
>> downloaded such as jsieve, mailet-sdk,...) => same problem on a local
>> deployment with thunderbird : it hangs when mailbox is empty.
>>
>> - I after defined my production account on evolution
>> (http://www.gnome.org/projects/evolution) : I didn't have the problem
>> anymore, but really strange, evolution downloaded some messages from
>> yesterday. Those messages had been deleted from my inbox via thunderbird,
>> but was retrieved via evolution...
>>
>> - I tested with evolution the local deployment I just made : I can read the
>> inbox even if empty.
>>
>> The problem seems to reside on the thunderbird/james conversation when inbox
>> is empty.
>>
>> Tks,
>> Eric
>>
>>
>> On 03/27/2010 10:08 PM, Norman Maurer wrote:
>>>
>>> Hi Eric,
>>>
>>> I just tested pop3 with imail and no messages in inbox and everything
>>> "just works". Will try to test it with thunderbird later..
>>>
>>> Bye,
>>> Norman
>>>
>>>
>>> 2010/3/27 Norman Maurer<no...@apache.org>:
>>>
>>>>
>>>> Hi Eric,
>>>>
>>>> I will try to find out whats wrong with the pop3 inbox stuff. If you
>>>> find out anything else please feel free to just report it..
>>>>
>>>> Thx,
>>>> Norman
>>>>
>>>> 2010/3/27 Eric Charles<er...@u-mangate.com>:
>>>>
>>>>>
>>>>> Hi Norman,
>>>>>
>>>>> Many tks for your quick answer.
>>>>>
>>>>> I had defined in my Thunderbird 3.0.3 client (on linux) the pop3 account
>>>>> as
>>>>> the default one.
>>>>> When launching thunderbird, the connection was succefully done "Host
>>>>> contacted, sending login information", saying after 1 second
>>>>> "Determining
>>>>> which messages to index" (never saw that message before...), hanging
>>>>> there a
>>>>> few minutes, and finally saying "connection to server ... timed out".
>>>>> After
>>>>> that, Imap account behaved also such a way...
>>>>> I also tried with latest Thundrebird 3.0.3: same result...
>>>>>
>>>>> I have now defined the imap account as the default one, and it's working
>>>>> fine even without any mail in the inbox.
>>>>> However, for the pop3 account, I still have the same behaviour.  Anyway,
>>>>> I
>>>>> have a temporary workaround right now.
>>>>> I will try to debug it but it may take some time to jump into the new
>>>>> architecture (I hacked james 3 years ago, but now we have some new great
>>>>> stuff  such as jpa, activemq, jackrabbit,...).
>>>>>
>>>>> Regarding the OOM, I saw some days ago the JAMES-981 regarding the
>>>>> ConsumerTemplate.
>>>>> However, the problem was still present even after you commited JAMES-981
>>>>> into trunk, so I don't think the problem was coming from that.
>>>>> I tried to analyse the 2GB heap dump with eclipse memory analyser, but
>>>>> it
>>>>> failed (too much swapping, my RAM is only 1GB).
>>>>> Currently, the process memory with the new trunk version I deployed
>>>>> today
>>>>> seems stable.
>>>>> I will keep posted if I still have the issue, or if finally, the memory
>>>>> remains stable.
>>>>>
>>>>> Tks a lot and keep up the excellent work,
>>>>>
>>>>> Eric
>>>>>
>>>>>
>>>>>
>>>>> On 01/-10/-28163 08:59 PM, Norman Maurer wrote:
>>>>>
>>>>>>
>>>>>> Hi Eric,
>>>>>>
>>>>>> thx for the feedback . Does this happens with pop3 or imap ? Or with
>>>>>> both? What client you use?
>>>>>>
>>>>>> About the OOM Exception, chances are good that this is fixed now. I
>>>>>> did something bad with ConsumerTemplate in RemoteDelivery nailet,
>>>>>> which could lead to such problems.
>>>>>>
>>>>>> Bye
>>>>>> Norman
>>>>>>
>>>>>> 2010/3/27, Eric Charles<er...@u-mangate.com>:
>>>>>>
>>>>>>
>>>>>>>
>>>>>>> Great Norman,
>>>>>>>
>>>>>>> I just upgraded to the current trunk to benefit from :
>>>>>>> - JAMES-983: common POP3/IMAP MailRepository.
>>>>>>> - JAMES-984: activemq 5.3.1 hoping it will resolve some OutOfMemory
>>>>>>> exceptions I had (*)
>>>>>>>
>>>>>>> I deployed and now (configured with enableVirtualHosting=true and
>>>>>>> JDBCDomainList), I've got the following:
>>>>>>> - When my mailbox contains at least one mail, No problem: I can read
>>>>>>> it
>>>>>>> without any problem.
>>>>>>> - When my mailbox is empty, my mail client simply waits and finally
>>>>>>> give
>>>>>>> me a timeout (closing my client and launching it again with mails in
>>>>>>> the
>>>>>>> inbox, everything is fine again).
>>>>>>>
>>>>>>> Can anybody else reproduce it?
>>>>>>> Is there additional specific configuration I have to apply ?
>>>>>>>
>>>>>>> Tks a lot,
>>>>>>>
>>>>>>> Eric
>>>>>>>
>>>>>>>
>>>>>>> (*) Just for information, about the OutOfMemory I had with activemq
>>>>>>> 3.5.0:
>>>>>>> - Testing different configurations from
>>>>>>> http://activemq.apache.org/javalangoutofmemory.html didn't help.
>>>>>>> - Stressing a local deployment with apache-sever-postage, server was
>>>>>>> holding the pressure during hours, however, memory was slightly but
>>>>>>> constantly growing.
>>>>>>> - I have a heap dump to be analyzed (still todo)
>>>>>>> - Reading 6 memory leak bugs resolved in activemq 3.5.1.
>>>>>>>
>>>>>>>
>>>>>>> (https://issues.apache.org/activemq/secure/ReleaseNote.jspa?projectId=10520&styleName=Html&version=12183),
>>>>>>> I decided to try to migrate to activemq 5.3.1, and by chance, Norman
>>>>>>> checked it in two days ago. I still have to wait a few days to see if
>>>>>>> the OutOfMemory problem is resolved.
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> On 12/23/-28158 08:59 PM, Norman Maurer wrote:
>>>>>>>
>>>>>>>
>>>>>>>>
>>>>>>>> Ok it seems like this works for everyone so far.. I will commit it
>>>>>>>> this weekend ..
>>>>>>>>
>>>>>>>> Thanks again for all the feedback / questions.
>>>>>>>>
>>>>>>>> Bye,
>>>>>>>> Norman
>>>>>>>>
>>>>>>>>
>>>>>>>> 2010/3/26 Stefano Bagnara<ap...@bago.org>:
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>>
>>>>>>>>> 2010/3/24 Norman Maurer<no...@apache.org>:
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> Hi all,
>>>>>>>>>>
>>>>>>>>>> I want to propose some really heavy change in current JAMES trunk,
>>>>>>>>>> and
>>>>>>>>>> so next version. As all of you knows we are supporting IMAP in
>>>>>>>>>> current
>>>>>>>>>> development version, which ships with its own mail store backend
>>>>>>>>>> called MailboxManager / Mailbox. For POP3 we use MailRepository as
>>>>>>>>>> backend.
>>>>>>>>>> I think this is a no go for a number of reasons, but the major one
>>>>>>>>>> is
>>>>>>>>>> that we should be able to switch between IMAP and POP3 without the
>>>>>>>>>> need to migrate mails. So I rewrote the POP3Server to re-use the
>>>>>>>>>> MailboxManager / Mailbox stuff which is used by IMAP.
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>> I think this is a good think. I also hope MailboxManager/Mailbox API
>>>>>>>>> can be improved and simplified, but using a single API is the only
>>>>>>>>> way
>>>>>>>>> to go. Once we use only one we'll better understand how to improve
>>>>>>>>> it.
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> So if a user login via POP3 he will just see the folder called
>>>>>>>>>> INBOX
>>>>>>>>>> and nothing else. With IMAP he will see all folders. Thats exactly
>>>>>>>>>> what dovecot and courier does ( both heavy used unix imap/pop3
>>>>>>>>>> servers).
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>> A good extension would be to have a "login pattern" to read custom
>>>>>>>>> folders..
>>>>>>>>> e.g: I login as "username#FOLDER" with username password and this
>>>>>>>>> way
>>>>>>>>> I get access to FOLDER instead of INBOX.
>>>>>>>>> The same could be applied to the delete behaviour (something like
>>>>>>>>> the
>>>>>>>>> "recent:" prefix hack in gmail).
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> Another advance is that we elimate one more dependency on storing
>>>>>>>>>> mails via javamail, which is not the way to go for the future ...
>>>>>>>>>> On the downside we will break backward-compatibility with every
>>>>>>>>>> James
>>>>>>>>>> release we did before. So we will need to write a "migration" tool,
>>>>>>>>>> but this should not be to hard.
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>> IMO at this point we should plainly ignore backward compatibility.
>>>>>>>>> AFTER we'll have a working release we'll define a migration path
>>>>>>>>> (with
>>>>>>>>> the help of users wanting to upgrade).
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> Because the change is so heavy, I dedicited to attach it to JIRA
>>>>>>>>>>  for
>>>>>>>>>> review and not commit it directly.
>>>>>>>>>>
>>>>>>>>>> You can find it here:
>>>>>>>>>> https://issues.apache.org/jira/browse/JAMES-983
>>>>>>>>>>
>>>>>>>>>> So what do you think ?
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>> +1
>>>>>>>>>
>>>>>>>>> Stefano
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> ---------------------------------------------------------------------
>>>>>>>>> To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
>>>>>>>>> For additional commands, e-mail: server-dev-help@james.apache.org
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>>>> ---------------------------------------------------------------------
>>>>>>>> To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
>>>>>>>> For additional commands, e-mail: server-dev-help@james.apache.org
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>
>>>>>> ---------------------------------------------------------------------
>>>>>> To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
>>>>>> For additional commands, e-mail: server-dev-help@james.apache.org
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>
>>>>
>>
>>
>

---------------------------------------------------------------------
To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
For additional commands, e-mail: server-dev-help@james.apache.org


Fwd: [PROPOSAL] Replace MailRepository with Mailbox / MailboxManager for POP3Server ...

Posted by Norman Maurer <no...@apache.org>.
---------- Forwarded message ----------
From: Norman Maurer <no...@apache.org>
Date: 2010/3/28
Subject: Re: [PROPOSAL] Replace MailRepository with Mailbox /
MailboxManager for POP3Server ...
To: Eric Charles <er...@u-mangate.com>


Hi Eric,

could you maybe use wireshark or something similar to log what
thunderbird tries todo exactly.. ?

Thx,
Norman


2010/3/28 Eric Charles <er...@u-mangate.com>:
> Hi Norman,
>
> I just made the following tests:
>
> - Fresh checkout from trunk and mvn package (some new dependencies were
> downloaded such as jsieve, mailet-sdk,...) => same problem on a local
> deployment with thunderbird : it hangs when mailbox is empty.
>
> - I after defined my production account on evolution
> (http://www.gnome.org/projects/evolution) : I didn't have the problem
> anymore, but really strange, evolution downloaded some messages from
> yesterday. Those messages had been deleted from my inbox via thunderbird,
> but was retrieved via evolution...
>
> - I tested with evolution the local deployment I just made : I can read the
> inbox even if empty.
>
> The problem seems to reside on the thunderbird/james conversation when inbox
> is empty.
>
> Tks,
> Eric
>
>
> On 03/27/2010 10:08 PM, Norman Maurer wrote:
>>
>> Hi Eric,
>>
>> I just tested pop3 with imail and no messages in inbox and everything
>> "just works". Will try to test it with thunderbird later..
>>
>> Bye,
>> Norman
>>
>>
>> 2010/3/27 Norman Maurer<no...@apache.org>:
>>
>>>
>>> Hi Eric,
>>>
>>> I will try to find out whats wrong with the pop3 inbox stuff. If you
>>> find out anything else please feel free to just report it..
>>>
>>> Thx,
>>> Norman
>>>
>>> 2010/3/27 Eric Charles<er...@u-mangate.com>:
>>>
>>>>
>>>> Hi Norman,
>>>>
>>>> Many tks for your quick answer.
>>>>
>>>> I had defined in my Thunderbird 3.0.3 client (on linux) the pop3 account
>>>> as
>>>> the default one.
>>>> When launching thunderbird, the connection was succefully done "Host
>>>> contacted, sending login information", saying after 1 second
>>>> "Determining
>>>> which messages to index" (never saw that message before...), hanging
>>>> there a
>>>> few minutes, and finally saying "connection to server ... timed out".
>>>> After
>>>> that, Imap account behaved also such a way...
>>>> I also tried with latest Thundrebird 3.0.3: same result...
>>>>
>>>> I have now defined the imap account as the default one, and it's working
>>>> fine even without any mail in the inbox.
>>>> However, for the pop3 account, I still have the same behaviour.  Anyway,
>>>> I
>>>> have a temporary workaround right now.
>>>> I will try to debug it but it may take some time to jump into the new
>>>> architecture (I hacked james 3 years ago, but now we have some new great
>>>> stuff  such as jpa, activemq, jackrabbit,...).
>>>>
>>>> Regarding the OOM, I saw some days ago the JAMES-981 regarding the
>>>> ConsumerTemplate.
>>>> However, the problem was still present even after you commited JAMES-981
>>>> into trunk, so I don't think the problem was coming from that.
>>>> I tried to analyse the 2GB heap dump with eclipse memory analyser, but
>>>> it
>>>> failed (too much swapping, my RAM is only 1GB).
>>>> Currently, the process memory with the new trunk version I deployed
>>>> today
>>>> seems stable.
>>>> I will keep posted if I still have the issue, or if finally, the memory
>>>> remains stable.
>>>>
>>>> Tks a lot and keep up the excellent work,
>>>>
>>>> Eric
>>>>
>>>>
>>>>
>>>> On 01/-10/-28163 08:59 PM, Norman Maurer wrote:
>>>>
>>>>>
>>>>> Hi Eric,
>>>>>
>>>>> thx for the feedback . Does this happens with pop3 or imap ? Or with
>>>>> both? What client you use?
>>>>>
>>>>> About the OOM Exception, chances are good that this is fixed now. I
>>>>> did something bad with ConsumerTemplate in RemoteDelivery nailet,
>>>>> which could lead to such problems.
>>>>>
>>>>> Bye
>>>>> Norman
>>>>>
>>>>> 2010/3/27, Eric Charles<er...@u-mangate.com>:
>>>>>
>>>>>
>>>>>>
>>>>>> Great Norman,
>>>>>>
>>>>>> I just upgraded to the current trunk to benefit from :
>>>>>> - JAMES-983: common POP3/IMAP MailRepository.
>>>>>> - JAMES-984: activemq 5.3.1 hoping it will resolve some OutOfMemory
>>>>>> exceptions I had (*)
>>>>>>
>>>>>> I deployed and now (configured with enableVirtualHosting=true and
>>>>>> JDBCDomainList), I've got the following:
>>>>>> - When my mailbox contains at least one mail, No problem: I can read
>>>>>> it
>>>>>> without any problem.
>>>>>> - When my mailbox is empty, my mail client simply waits and finally
>>>>>> give
>>>>>> me a timeout (closing my client and launching it again with mails in
>>>>>> the
>>>>>> inbox, everything is fine again).
>>>>>>
>>>>>> Can anybody else reproduce it?
>>>>>> Is there additional specific configuration I have to apply ?
>>>>>>
>>>>>> Tks a lot,
>>>>>>
>>>>>> Eric
>>>>>>
>>>>>>
>>>>>> (*) Just for information, about the OutOfMemory I had with activemq
>>>>>> 3.5.0:
>>>>>> - Testing different configurations from
>>>>>> http://activemq.apache.org/javalangoutofmemory.html didn't help.
>>>>>> - Stressing a local deployment with apache-sever-postage, server was
>>>>>> holding the pressure during hours, however, memory was slightly but
>>>>>> constantly growing.
>>>>>> - I have a heap dump to be analyzed (still todo)
>>>>>> - Reading 6 memory leak bugs resolved in activemq 3.5.1.
>>>>>>
>>>>>>
>>>>>> (https://issues.apache.org/activemq/secure/ReleaseNote.jspa?projectId=10520&styleName=Html&version=12183),
>>>>>> I decided to try to migrate to activemq 5.3.1, and by chance, Norman
>>>>>> checked it in two days ago. I still have to wait a few days to see if
>>>>>> the OutOfMemory problem is resolved.
>>>>>>
>>>>>>
>>>>>>
>>>>>> On 12/23/-28158 08:59 PM, Norman Maurer wrote:
>>>>>>
>>>>>>
>>>>>>>
>>>>>>> Ok it seems like this works for everyone so far.. I will commit it
>>>>>>> this weekend ..
>>>>>>>
>>>>>>> Thanks again for all the feedback / questions.
>>>>>>>
>>>>>>> Bye,
>>>>>>> Norman
>>>>>>>
>>>>>>>
>>>>>>> 2010/3/26 Stefano Bagnara<ap...@bago.org>:
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>>
>>>>>>>> 2010/3/24 Norman Maurer<no...@apache.org>:
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>>
>>>>>>>>> Hi all,
>>>>>>>>>
>>>>>>>>> I want to propose some really heavy change in current JAMES trunk,
>>>>>>>>> and
>>>>>>>>> so next version. As all of you knows we are supporting IMAP in
>>>>>>>>> current
>>>>>>>>> development version, which ships with its own mail store backend
>>>>>>>>> called MailboxManager / Mailbox. For POP3 we use MailRepository as
>>>>>>>>> backend.
>>>>>>>>> I think this is a no go for a number of reasons, but the major one
>>>>>>>>> is
>>>>>>>>> that we should be able to switch between IMAP and POP3 without the
>>>>>>>>> need to migrate mails. So I rewrote the POP3Server to re-use the
>>>>>>>>> MailboxManager / Mailbox stuff which is used by IMAP.
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>>>> I think this is a good think. I also hope MailboxManager/Mailbox API
>>>>>>>> can be improved and simplified, but using a single API is the only
>>>>>>>> way
>>>>>>>> to go. Once we use only one we'll better understand how to improve
>>>>>>>> it.
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>>
>>>>>>>>> So if a user login via POP3 he will just see the folder called
>>>>>>>>> INBOX
>>>>>>>>> and nothing else. With IMAP he will see all folders. Thats exactly
>>>>>>>>> what dovecot and courier does ( both heavy used unix imap/pop3
>>>>>>>>> servers).
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>>>> A good extension would be to have a "login pattern" to read custom
>>>>>>>> folders..
>>>>>>>> e.g: I login as "username#FOLDER" with username password and this
>>>>>>>> way
>>>>>>>> I get access to FOLDER instead of INBOX.
>>>>>>>> The same could be applied to the delete behaviour (something like
>>>>>>>> the
>>>>>>>> "recent:" prefix hack in gmail).
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>>
>>>>>>>>> Another advance is that we elimate one more dependency on storing
>>>>>>>>> mails via javamail, which is not the way to go for the future ...
>>>>>>>>> On the downside we will break backward-compatibility with every
>>>>>>>>> James
>>>>>>>>> release we did before. So we will need to write a "migration" tool,
>>>>>>>>> but this should not be to hard.
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>>>> IMO at this point we should plainly ignore backward compatibility.
>>>>>>>> AFTER we'll have a working release we'll define a migration path
>>>>>>>> (with
>>>>>>>> the help of users wanting to upgrade).
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>>
>>>>>>>>> Because the change is so heavy, I dedicited to attach it to JIRA
>>>>>>>>>  for
>>>>>>>>> review and not commit it directly.
>>>>>>>>>
>>>>>>>>> You can find it here:
>>>>>>>>> https://issues.apache.org/jira/browse/JAMES-983
>>>>>>>>>
>>>>>>>>> So what do you think ?
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>>>> +1
>>>>>>>>
>>>>>>>> Stefano
>>>>>>>>
>>>>>>>>
>>>>>>>> ---------------------------------------------------------------------
>>>>>>>> To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
>>>>>>>> For additional commands, e-mail: server-dev-help@james.apache.org
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>> ---------------------------------------------------------------------
>>>>>>> To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
>>>>>>> For additional commands, e-mail: server-dev-help@james.apache.org
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>> ---------------------------------------------------------------------
>>>>> To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
>>>>> For additional commands, e-mail: server-dev-help@james.apache.org
>>>>>
>>>>>
>>>>>
>>>>>
>>>>
>>>>
>>>
>>>
>
>

---------------------------------------------------------------------
To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
For additional commands, e-mail: server-dev-help@james.apache.org


Re: [PROPOSAL] Replace MailRepository with Mailbox / MailboxManager for POP3Server ...

Posted by Eric Charles <er...@u-mangate.com>.
Hi Norman,

I just made the following tests:

- Fresh checkout from trunk and mvn package (some new dependencies were 
downloaded such as jsieve, mailet-sdk,...) => same problem on a local 
deployment with thunderbird : it hangs when mailbox is empty.

- I after defined my production account on evolution 
(http://www.gnome.org/projects/evolution) : I didn't have the problem 
anymore, but really strange, evolution downloaded some messages from 
yesterday. Those messages had been deleted from my inbox via 
thunderbird, but was retrieved via evolution...

- I tested with evolution the local deployment I just made : I can read 
the inbox even if empty.

The problem seems to reside on the thunderbird/james conversation when 
inbox is empty.

Tks,
Eric


On 03/27/2010 10:08 PM, Norman Maurer wrote:
> Hi Eric,
>
> I just tested pop3 with imail and no messages in inbox and everything
> "just works". Will try to test it with thunderbird later..
>
> Bye,
> Norman
>
>
> 2010/3/27 Norman Maurer<no...@apache.org>:
>    
>> Hi Eric,
>>
>> I will try to find out whats wrong with the pop3 inbox stuff. If you
>> find out anything else please feel free to just report it..
>>
>> Thx,
>> Norman
>>
>> 2010/3/27 Eric Charles<er...@u-mangate.com>:
>>      
>>> Hi Norman,
>>>
>>> Many tks for your quick answer.
>>>
>>> I had defined in my Thunderbird 3.0.3 client (on linux) the pop3 account as
>>> the default one.
>>> When launching thunderbird, the connection was succefully done "Host
>>> contacted, sending login information", saying after 1 second "Determining
>>> which messages to index" (never saw that message before...), hanging there a
>>> few minutes, and finally saying "connection to server ... timed out". After
>>> that, Imap account behaved also such a way...
>>> I also tried with latest Thundrebird 3.0.3: same result...
>>>
>>> I have now defined the imap account as the default one, and it's working
>>> fine even without any mail in the inbox.
>>> However, for the pop3 account, I still have the same behaviour.  Anyway, I
>>> have a temporary workaround right now.
>>> I will try to debug it but it may take some time to jump into the new
>>> architecture (I hacked james 3 years ago, but now we have some new great
>>> stuff  such as jpa, activemq, jackrabbit,...).
>>>
>>> Regarding the OOM, I saw some days ago the JAMES-981 regarding the
>>> ConsumerTemplate.
>>> However, the problem was still present even after you commited JAMES-981
>>> into trunk, so I don't think the problem was coming from that.
>>> I tried to analyse the 2GB heap dump with eclipse memory analyser, but it
>>> failed (too much swapping, my RAM is only 1GB).
>>> Currently, the process memory with the new trunk version I deployed today
>>> seems stable.
>>> I will keep posted if I still have the issue, or if finally, the memory
>>> remains stable.
>>>
>>> Tks a lot and keep up the excellent work,
>>>
>>> Eric
>>>
>>>
>>>
>>> On 01/-10/-28163 08:59 PM, Norman Maurer wrote:
>>>        
>>>> Hi Eric,
>>>>
>>>> thx for the feedback . Does this happens with pop3 or imap ? Or with
>>>> both? What client you use?
>>>>
>>>> About the OOM Exception, chances are good that this is fixed now. I
>>>> did something bad with ConsumerTemplate in RemoteDelivery nailet,
>>>> which could lead to such problems.
>>>>
>>>> Bye
>>>> Norman
>>>>
>>>> 2010/3/27, Eric Charles<er...@u-mangate.com>:
>>>>
>>>>          
>>>>> Great Norman,
>>>>>
>>>>> I just upgraded to the current trunk to benefit from :
>>>>> - JAMES-983: common POP3/IMAP MailRepository.
>>>>> - JAMES-984: activemq 5.3.1 hoping it will resolve some OutOfMemory
>>>>> exceptions I had (*)
>>>>>
>>>>> I deployed and now (configured with enableVirtualHosting=true and
>>>>> JDBCDomainList), I've got the following:
>>>>> - When my mailbox contains at least one mail, No problem: I can read it
>>>>> without any problem.
>>>>> - When my mailbox is empty, my mail client simply waits and finally give
>>>>> me a timeout (closing my client and launching it again with mails in the
>>>>> inbox, everything is fine again).
>>>>>
>>>>> Can anybody else reproduce it?
>>>>> Is there additional specific configuration I have to apply ?
>>>>>
>>>>> Tks a lot,
>>>>>
>>>>> Eric
>>>>>
>>>>>
>>>>> (*) Just for information, about the OutOfMemory I had with activemq
>>>>> 3.5.0:
>>>>> - Testing different configurations from
>>>>> http://activemq.apache.org/javalangoutofmemory.html didn't help.
>>>>> - Stressing a local deployment with apache-sever-postage, server was
>>>>> holding the pressure during hours, however, memory was slightly but
>>>>> constantly growing.
>>>>> - I have a heap dump to be analyzed (still todo)
>>>>> - Reading 6 memory leak bugs resolved in activemq 3.5.1.
>>>>>
>>>>> (https://issues.apache.org/activemq/secure/ReleaseNote.jspa?projectId=10520&styleName=Html&version=12183),
>>>>> I decided to try to migrate to activemq 5.3.1, and by chance, Norman
>>>>> checked it in two days ago. I still have to wait a few days to see if
>>>>> the OutOfMemory problem is resolved.
>>>>>
>>>>>
>>>>>
>>>>> On 12/23/-28158 08:59 PM, Norman Maurer wrote:
>>>>>
>>>>>            
>>>>>> Ok it seems like this works for everyone so far.. I will commit it
>>>>>> this weekend ..
>>>>>>
>>>>>> Thanks again for all the feedback / questions.
>>>>>>
>>>>>> Bye,
>>>>>> Norman
>>>>>>
>>>>>>
>>>>>> 2010/3/26 Stefano Bagnara<ap...@bago.org>:
>>>>>>
>>>>>>
>>>>>>              
>>>>>>> 2010/3/24 Norman Maurer<no...@apache.org>:
>>>>>>>
>>>>>>>
>>>>>>>                
>>>>>>>> Hi all,
>>>>>>>>
>>>>>>>> I want to propose some really heavy change in current JAMES trunk, and
>>>>>>>> so next version. As all of you knows we are supporting IMAP in current
>>>>>>>> development version, which ships with its own mail store backend
>>>>>>>> called MailboxManager / Mailbox. For POP3 we use MailRepository as
>>>>>>>> backend.
>>>>>>>> I think this is a no go for a number of reasons, but the major one is
>>>>>>>> that we should be able to switch between IMAP and POP3 without the
>>>>>>>> need to migrate mails. So I rewrote the POP3Server to re-use the
>>>>>>>> MailboxManager / Mailbox stuff which is used by IMAP.
>>>>>>>>
>>>>>>>>
>>>>>>>>                  
>>>>>>> I think this is a good think. I also hope MailboxManager/Mailbox API
>>>>>>> can be improved and simplified, but using a single API is the only way
>>>>>>> to go. Once we use only one we'll better understand how to improve it.
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>                
>>>>>>>> So if a user login via POP3 he will just see the folder called INBOX
>>>>>>>> and nothing else. With IMAP he will see all folders. Thats exactly
>>>>>>>> what dovecot and courier does ( both heavy used unix imap/pop3
>>>>>>>> servers).
>>>>>>>>
>>>>>>>>
>>>>>>>>                  
>>>>>>> A good extension would be to have a "login pattern" to read custom
>>>>>>> folders..
>>>>>>> e.g: I login as "username#FOLDER" with username password and this way
>>>>>>> I get access to FOLDER instead of INBOX.
>>>>>>> The same could be applied to the delete behaviour (something like the
>>>>>>> "recent:" prefix hack in gmail).
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>                
>>>>>>>> Another advance is that we elimate one more dependency on storing
>>>>>>>> mails via javamail, which is not the way to go for the future ...
>>>>>>>> On the downside we will break backward-compatibility with every James
>>>>>>>> release we did before. So we will need to write a "migration" tool,
>>>>>>>> but this should not be to hard.
>>>>>>>>
>>>>>>>>
>>>>>>>>                  
>>>>>>> IMO at this point we should plainly ignore backward compatibility.
>>>>>>> AFTER we'll have a working release we'll define a migration path (with
>>>>>>> the help of users wanting to upgrade).
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>                
>>>>>>>> Because the change is so heavy, I dedicited to attach it to JIRA  for
>>>>>>>> review and not commit it directly.
>>>>>>>>
>>>>>>>> You can find it here:
>>>>>>>> https://issues.apache.org/jira/browse/JAMES-983
>>>>>>>>
>>>>>>>> So what do you think ?
>>>>>>>>
>>>>>>>>
>>>>>>>>                  
>>>>>>> +1
>>>>>>>
>>>>>>> Stefano
>>>>>>>
>>>>>>> ---------------------------------------------------------------------
>>>>>>> To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
>>>>>>> For additional commands, e-mail: server-dev-help@james.apache.org
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>                
>>>>>> ---------------------------------------------------------------------
>>>>>> To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
>>>>>> For additional commands, e-mail: server-dev-help@james.apache.org
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>              
>>>>>
>>>>>            
>>>> ---------------------------------------------------------------------
>>>> To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
>>>> For additional commands, e-mail: server-dev-help@james.apache.org
>>>>
>>>>
>>>>
>>>>          
>>>
>>>        
>>      


---------------------------------------------------------------------
To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
For additional commands, e-mail: server-dev-help@james.apache.org


Re: Re: Re: [PROPOSAL] Replace MailRepository with Mailbox / MailboxManager for POP3Server ...

Posted by Norman Maurer <no...@apache.org>.
Hi Eric,

I just tested pop3 with imail and no messages in inbox and everything
"just works". Will try to test it with thunderbird later..

Bye,
Norman


2010/3/27 Norman Maurer <no...@apache.org>:
> Hi Eric,
>
> I will try to find out whats wrong with the pop3 inbox stuff. If you
> find out anything else please feel free to just report it..
>
> Thx,
> Norman
>
> 2010/3/27 Eric Charles <er...@u-mangate.com>:
>> Hi Norman,
>>
>> Many tks for your quick answer.
>>
>> I had defined in my Thunderbird 3.0.3 client (on linux) the pop3 account as
>> the default one.
>> When launching thunderbird, the connection was succefully done "Host
>> contacted, sending login information", saying after 1 second "Determining
>> which messages to index" (never saw that message before...), hanging there a
>> few minutes, and finally saying "connection to server ... timed out". After
>> that, Imap account behaved also such a way...
>> I also tried with latest Thundrebird 3.0.3: same result...
>>
>> I have now defined the imap account as the default one, and it's working
>> fine even without any mail in the inbox.
>> However, for the pop3 account, I still have the same behaviour.  Anyway, I
>> have a temporary workaround right now.
>> I will try to debug it but it may take some time to jump into the new
>> architecture (I hacked james 3 years ago, but now we have some new great
>> stuff  such as jpa, activemq, jackrabbit,...).
>>
>> Regarding the OOM, I saw some days ago the JAMES-981 regarding the
>> ConsumerTemplate.
>> However, the problem was still present even after you commited JAMES-981
>> into trunk, so I don't think the problem was coming from that.
>> I tried to analyse the 2GB heap dump with eclipse memory analyser, but it
>> failed (too much swapping, my RAM is only 1GB).
>> Currently, the process memory with the new trunk version I deployed today
>> seems stable.
>> I will keep posted if I still have the issue, or if finally, the memory
>> remains stable.
>>
>> Tks a lot and keep up the excellent work,
>>
>> Eric
>>
>>
>>
>> On 01/-10/-28163 08:59 PM, Norman Maurer wrote:
>>>
>>> Hi Eric,
>>>
>>> thx for the feedback . Does this happens with pop3 or imap ? Or with
>>> both? What client you use?
>>>
>>> About the OOM Exception, chances are good that this is fixed now. I
>>> did something bad with ConsumerTemplate in RemoteDelivery nailet,
>>> which could lead to such problems.
>>>
>>> Bye
>>> Norman
>>>
>>> 2010/3/27, Eric Charles<er...@u-mangate.com>:
>>>
>>>>
>>>> Great Norman,
>>>>
>>>> I just upgraded to the current trunk to benefit from :
>>>> - JAMES-983: common POP3/IMAP MailRepository.
>>>> - JAMES-984: activemq 5.3.1 hoping it will resolve some OutOfMemory
>>>> exceptions I had (*)
>>>>
>>>> I deployed and now (configured with enableVirtualHosting=true and
>>>> JDBCDomainList), I've got the following:
>>>> - When my mailbox contains at least one mail, No problem: I can read it
>>>> without any problem.
>>>> - When my mailbox is empty, my mail client simply waits and finally give
>>>> me a timeout (closing my client and launching it again with mails in the
>>>> inbox, everything is fine again).
>>>>
>>>> Can anybody else reproduce it?
>>>> Is there additional specific configuration I have to apply ?
>>>>
>>>> Tks a lot,
>>>>
>>>> Eric
>>>>
>>>>
>>>> (*) Just for information, about the OutOfMemory I had with activemq
>>>> 3.5.0:
>>>> - Testing different configurations from
>>>> http://activemq.apache.org/javalangoutofmemory.html didn't help.
>>>> - Stressing a local deployment with apache-sever-postage, server was
>>>> holding the pressure during hours, however, memory was slightly but
>>>> constantly growing.
>>>> - I have a heap dump to be analyzed (still todo)
>>>> - Reading 6 memory leak bugs resolved in activemq 3.5.1.
>>>>
>>>> (https://issues.apache.org/activemq/secure/ReleaseNote.jspa?projectId=10520&styleName=Html&version=12183),
>>>> I decided to try to migrate to activemq 5.3.1, and by chance, Norman
>>>> checked it in two days ago. I still have to wait a few days to see if
>>>> the OutOfMemory problem is resolved.
>>>>
>>>>
>>>>
>>>> On 12/23/-28158 08:59 PM, Norman Maurer wrote:
>>>>
>>>>>
>>>>> Ok it seems like this works for everyone so far.. I will commit it
>>>>> this weekend ..
>>>>>
>>>>> Thanks again for all the feedback / questions.
>>>>>
>>>>> Bye,
>>>>> Norman
>>>>>
>>>>>
>>>>> 2010/3/26 Stefano Bagnara<ap...@bago.org>:
>>>>>
>>>>>
>>>>>>
>>>>>> 2010/3/24 Norman Maurer<no...@apache.org>:
>>>>>>
>>>>>>
>>>>>>>
>>>>>>> Hi all,
>>>>>>>
>>>>>>> I want to propose some really heavy change in current JAMES trunk, and
>>>>>>> so next version. As all of you knows we are supporting IMAP in current
>>>>>>> development version, which ships with its own mail store backend
>>>>>>> called MailboxManager / Mailbox. For POP3 we use MailRepository as
>>>>>>> backend.
>>>>>>> I think this is a no go for a number of reasons, but the major one is
>>>>>>> that we should be able to switch between IMAP and POP3 without the
>>>>>>> need to migrate mails. So I rewrote the POP3Server to re-use the
>>>>>>> MailboxManager / Mailbox stuff which is used by IMAP.
>>>>>>>
>>>>>>>
>>>>>>
>>>>>> I think this is a good think. I also hope MailboxManager/Mailbox API
>>>>>> can be improved and simplified, but using a single API is the only way
>>>>>> to go. Once we use only one we'll better understand how to improve it.
>>>>>>
>>>>>>
>>>>>>
>>>>>>>
>>>>>>> So if a user login via POP3 he will just see the folder called INBOX
>>>>>>> and nothing else. With IMAP he will see all folders. Thats exactly
>>>>>>> what dovecot and courier does ( both heavy used unix imap/pop3
>>>>>>> servers).
>>>>>>>
>>>>>>>
>>>>>>
>>>>>> A good extension would be to have a "login pattern" to read custom
>>>>>> folders..
>>>>>> e.g: I login as "username#FOLDER" with username password and this way
>>>>>> I get access to FOLDER instead of INBOX.
>>>>>> The same could be applied to the delete behaviour (something like the
>>>>>> "recent:" prefix hack in gmail).
>>>>>>
>>>>>>
>>>>>>
>>>>>>>
>>>>>>> Another advance is that we elimate one more dependency on storing
>>>>>>> mails via javamail, which is not the way to go for the future ...
>>>>>>> On the downside we will break backward-compatibility with every James
>>>>>>> release we did before. So we will need to write a "migration" tool,
>>>>>>> but this should not be to hard.
>>>>>>>
>>>>>>>
>>>>>>
>>>>>> IMO at this point we should plainly ignore backward compatibility.
>>>>>> AFTER we'll have a working release we'll define a migration path (with
>>>>>> the help of users wanting to upgrade).
>>>>>>
>>>>>>
>>>>>>
>>>>>>>
>>>>>>> Because the change is so heavy, I dedicited to attach it to JIRA  for
>>>>>>> review and not commit it directly.
>>>>>>>
>>>>>>> You can find it here:
>>>>>>> https://issues.apache.org/jira/browse/JAMES-983
>>>>>>>
>>>>>>> So what do you think ?
>>>>>>>
>>>>>>>
>>>>>>
>>>>>> +1
>>>>>>
>>>>>> Stefano
>>>>>>
>>>>>> ---------------------------------------------------------------------
>>>>>> To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
>>>>>> For additional commands, e-mail: server-dev-help@james.apache.org
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>> ---------------------------------------------------------------------
>>>>> To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
>>>>> For additional commands, e-mail: server-dev-help@james.apache.org
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>
>>>>
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
>>> For additional commands, e-mail: server-dev-help@james.apache.org
>>>
>>>
>>>
>>
>>
>

---------------------------------------------------------------------
To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
For additional commands, e-mail: server-dev-help@james.apache.org


Re: Re: Re: [PROPOSAL] Replace MailRepository with Mailbox / MailboxManager for POP3Server ...

Posted by Norman Maurer <no...@apache.org>.
Hi Eric,

I will try to find out whats wrong with the pop3 inbox stuff. If you
find out anything else please feel free to just report it..

Thx,
Norman

2010/3/27 Eric Charles <er...@u-mangate.com>:
> Hi Norman,
>
> Many tks for your quick answer.
>
> I had defined in my Thunderbird 3.0.3 client (on linux) the pop3 account as
> the default one.
> When launching thunderbird, the connection was succefully done "Host
> contacted, sending login information", saying after 1 second "Determining
> which messages to index" (never saw that message before...), hanging there a
> few minutes, and finally saying "connection to server ... timed out". After
> that, Imap account behaved also such a way...
> I also tried with latest Thundrebird 3.0.3: same result...
>
> I have now defined the imap account as the default one, and it's working
> fine even without any mail in the inbox.
> However, for the pop3 account, I still have the same behaviour.  Anyway, I
> have a temporary workaround right now.
> I will try to debug it but it may take some time to jump into the new
> architecture (I hacked james 3 years ago, but now we have some new great
> stuff  such as jpa, activemq, jackrabbit,...).
>
> Regarding the OOM, I saw some days ago the JAMES-981 regarding the
> ConsumerTemplate.
> However, the problem was still present even after you commited JAMES-981
> into trunk, so I don't think the problem was coming from that.
> I tried to analyse the 2GB heap dump with eclipse memory analyser, but it
> failed (too much swapping, my RAM is only 1GB).
> Currently, the process memory with the new trunk version I deployed today
> seems stable.
> I will keep posted if I still have the issue, or if finally, the memory
> remains stable.
>
> Tks a lot and keep up the excellent work,
>
> Eric
>
>
>
> On 01/-10/-28163 08:59 PM, Norman Maurer wrote:
>>
>> Hi Eric,
>>
>> thx for the feedback . Does this happens with pop3 or imap ? Or with
>> both? What client you use?
>>
>> About the OOM Exception, chances are good that this is fixed now. I
>> did something bad with ConsumerTemplate in RemoteDelivery nailet,
>> which could lead to such problems.
>>
>> Bye
>> Norman
>>
>> 2010/3/27, Eric Charles<er...@u-mangate.com>:
>>
>>>
>>> Great Norman,
>>>
>>> I just upgraded to the current trunk to benefit from :
>>> - JAMES-983: common POP3/IMAP MailRepository.
>>> - JAMES-984: activemq 5.3.1 hoping it will resolve some OutOfMemory
>>> exceptions I had (*)
>>>
>>> I deployed and now (configured with enableVirtualHosting=true and
>>> JDBCDomainList), I've got the following:
>>> - When my mailbox contains at least one mail, No problem: I can read it
>>> without any problem.
>>> - When my mailbox is empty, my mail client simply waits and finally give
>>> me a timeout (closing my client and launching it again with mails in the
>>> inbox, everything is fine again).
>>>
>>> Can anybody else reproduce it?
>>> Is there additional specific configuration I have to apply ?
>>>
>>> Tks a lot,
>>>
>>> Eric
>>>
>>>
>>> (*) Just for information, about the OutOfMemory I had with activemq
>>> 3.5.0:
>>> - Testing different configurations from
>>> http://activemq.apache.org/javalangoutofmemory.html didn't help.
>>> - Stressing a local deployment with apache-sever-postage, server was
>>> holding the pressure during hours, however, memory was slightly but
>>> constantly growing.
>>> - I have a heap dump to be analyzed (still todo)
>>> - Reading 6 memory leak bugs resolved in activemq 3.5.1.
>>>
>>> (https://issues.apache.org/activemq/secure/ReleaseNote.jspa?projectId=10520&styleName=Html&version=12183),
>>> I decided to try to migrate to activemq 5.3.1, and by chance, Norman
>>> checked it in two days ago. I still have to wait a few days to see if
>>> the OutOfMemory problem is resolved.
>>>
>>>
>>>
>>> On 12/23/-28158 08:59 PM, Norman Maurer wrote:
>>>
>>>>
>>>> Ok it seems like this works for everyone so far.. I will commit it
>>>> this weekend ..
>>>>
>>>> Thanks again for all the feedback / questions.
>>>>
>>>> Bye,
>>>> Norman
>>>>
>>>>
>>>> 2010/3/26 Stefano Bagnara<ap...@bago.org>:
>>>>
>>>>
>>>>>
>>>>> 2010/3/24 Norman Maurer<no...@apache.org>:
>>>>>
>>>>>
>>>>>>
>>>>>> Hi all,
>>>>>>
>>>>>> I want to propose some really heavy change in current JAMES trunk, and
>>>>>> so next version. As all of you knows we are supporting IMAP in current
>>>>>> development version, which ships with its own mail store backend
>>>>>> called MailboxManager / Mailbox. For POP3 we use MailRepository as
>>>>>> backend.
>>>>>> I think this is a no go for a number of reasons, but the major one is
>>>>>> that we should be able to switch between IMAP and POP3 without the
>>>>>> need to migrate mails. So I rewrote the POP3Server to re-use the
>>>>>> MailboxManager / Mailbox stuff which is used by IMAP.
>>>>>>
>>>>>>
>>>>>
>>>>> I think this is a good think. I also hope MailboxManager/Mailbox API
>>>>> can be improved and simplified, but using a single API is the only way
>>>>> to go. Once we use only one we'll better understand how to improve it.
>>>>>
>>>>>
>>>>>
>>>>>>
>>>>>> So if a user login via POP3 he will just see the folder called INBOX
>>>>>> and nothing else. With IMAP he will see all folders. Thats exactly
>>>>>> what dovecot and courier does ( both heavy used unix imap/pop3
>>>>>> servers).
>>>>>>
>>>>>>
>>>>>
>>>>> A good extension would be to have a "login pattern" to read custom
>>>>> folders..
>>>>> e.g: I login as "username#FOLDER" with username password and this way
>>>>> I get access to FOLDER instead of INBOX.
>>>>> The same could be applied to the delete behaviour (something like the
>>>>> "recent:" prefix hack in gmail).
>>>>>
>>>>>
>>>>>
>>>>>>
>>>>>> Another advance is that we elimate one more dependency on storing
>>>>>> mails via javamail, which is not the way to go for the future ...
>>>>>> On the downside we will break backward-compatibility with every James
>>>>>> release we did before. So we will need to write a "migration" tool,
>>>>>> but this should not be to hard.
>>>>>>
>>>>>>
>>>>>
>>>>> IMO at this point we should plainly ignore backward compatibility.
>>>>> AFTER we'll have a working release we'll define a migration path (with
>>>>> the help of users wanting to upgrade).
>>>>>
>>>>>
>>>>>
>>>>>>
>>>>>> Because the change is so heavy, I dedicited to attach it to JIRA  for
>>>>>> review and not commit it directly.
>>>>>>
>>>>>> You can find it here:
>>>>>> https://issues.apache.org/jira/browse/JAMES-983
>>>>>>
>>>>>> So what do you think ?
>>>>>>
>>>>>>
>>>>>
>>>>> +1
>>>>>
>>>>> Stefano
>>>>>
>>>>> ---------------------------------------------------------------------
>>>>> To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
>>>>> For additional commands, e-mail: server-dev-help@james.apache.org
>>>>>
>>>>>
>>>>>
>>>>>
>>>>
>>>> ---------------------------------------------------------------------
>>>> To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
>>>> For additional commands, e-mail: server-dev-help@james.apache.org
>>>>
>>>>
>>>>
>>>>
>>>>
>>>
>>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
>> For additional commands, e-mail: server-dev-help@james.apache.org
>>
>>
>>
>
>

---------------------------------------------------------------------
To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
For additional commands, e-mail: server-dev-help@james.apache.org


Re: Re: Re: [PROPOSAL] Replace MailRepository with Mailbox / MailboxManager for POP3Server ...

Posted by Eric Charles <er...@u-mangate.com>.
Hi Norman,

Many tks for your quick answer.

I had defined in my Thunderbird 3.0.3 client (on linux) the pop3 account 
as the default one.
When launching thunderbird, the connection was succefully done "Host 
contacted, sending login information", saying after 1 second 
"Determining which messages to index" (never saw that message 
before...), hanging there a few minutes, and finally saying "connection 
to server ... timed out". After that, Imap account behaved also such a 
way...
I also tried with latest Thundrebird 3.0.3: same result...

I have now defined the imap account as the default one, and it's working 
fine even without any mail in the inbox.
However, for the pop3 account, I still have the same behaviour.  Anyway, 
I have a temporary workaround right now.
I will try to debug it but it may take some time to jump into the new 
architecture (I hacked james 3 years ago, but now we have some new great 
stuff  such as jpa, activemq, jackrabbit,...).

Regarding the OOM, I saw some days ago the JAMES-981 regarding the 
ConsumerTemplate.
However, the problem was still present even after you commited JAMES-981 
into trunk, so I don't think the problem was coming from that.
I tried to analyse the 2GB heap dump with eclipse memory analyser, but 
it failed (too much swapping, my RAM is only 1GB).
Currently, the process memory with the new trunk version I deployed 
today seems stable.
I will keep posted if I still have the issue, or if finally, the memory 
remains stable.

Tks a lot and keep up the excellent work,

Eric



On 01/-10/-28163 08:59 PM, Norman Maurer wrote:
> Hi Eric,
>
> thx for the feedback . Does this happens with pop3 or imap ? Or with
> both? What client you use?
>
> About the OOM Exception, chances are good that this is fixed now. I
> did something bad with ConsumerTemplate in RemoteDelivery nailet,
> which could lead to such problems.
>
> Bye
> Norman
>
> 2010/3/27, Eric Charles<er...@u-mangate.com>:
>    
>> Great Norman,
>>
>> I just upgraded to the current trunk to benefit from :
>> - JAMES-983: common POP3/IMAP MailRepository.
>> - JAMES-984: activemq 5.3.1 hoping it will resolve some OutOfMemory
>> exceptions I had (*)
>>
>> I deployed and now (configured with enableVirtualHosting=true and
>> JDBCDomainList), I've got the following:
>> - When my mailbox contains at least one mail, No problem: I can read it
>> without any problem.
>> - When my mailbox is empty, my mail client simply waits and finally give
>> me a timeout (closing my client and launching it again with mails in the
>> inbox, everything is fine again).
>>
>> Can anybody else reproduce it?
>> Is there additional specific configuration I have to apply ?
>>
>> Tks a lot,
>>
>> Eric
>>
>>
>> (*) Just for information, about the OutOfMemory I had with activemq 3.5.0:
>> - Testing different configurations from
>> http://activemq.apache.org/javalangoutofmemory.html didn't help.
>> - Stressing a local deployment with apache-sever-postage, server was
>> holding the pressure during hours, however, memory was slightly but
>> constantly growing.
>> - I have a heap dump to be analyzed (still todo)
>> - Reading 6 memory leak bugs resolved in activemq 3.5.1.
>> (https://issues.apache.org/activemq/secure/ReleaseNote.jspa?projectId=10520&styleName=Html&version=12183),
>> I decided to try to migrate to activemq 5.3.1, and by chance, Norman
>> checked it in two days ago. I still have to wait a few days to see if
>> the OutOfMemory problem is resolved.
>>
>>
>>
>> On 12/23/-28158 08:59 PM, Norman Maurer wrote:
>>      
>>> Ok it seems like this works for everyone so far.. I will commit it
>>> this weekend ..
>>>
>>> Thanks again for all the feedback / questions.
>>>
>>> Bye,
>>> Norman
>>>
>>>
>>> 2010/3/26 Stefano Bagnara<ap...@bago.org>:
>>>
>>>        
>>>> 2010/3/24 Norman Maurer<no...@apache.org>:
>>>>
>>>>          
>>>>> Hi all,
>>>>>
>>>>> I want to propose some really heavy change in current JAMES trunk, and
>>>>> so next version. As all of you knows we are supporting IMAP in current
>>>>> development version, which ships with its own mail store backend
>>>>> called MailboxManager / Mailbox. For POP3 we use MailRepository as
>>>>> backend.
>>>>> I think this is a no go for a number of reasons, but the major one is
>>>>> that we should be able to switch between IMAP and POP3 without the
>>>>> need to migrate mails. So I rewrote the POP3Server to re-use the
>>>>> MailboxManager / Mailbox stuff which is used by IMAP.
>>>>>
>>>>>            
>>>> I think this is a good think. I also hope MailboxManager/Mailbox API
>>>> can be improved and simplified, but using a single API is the only way
>>>> to go. Once we use only one we'll better understand how to improve it.
>>>>
>>>>
>>>>          
>>>>> So if a user login via POP3 he will just see the folder called INBOX
>>>>> and nothing else. With IMAP he will see all folders. Thats exactly
>>>>> what dovecot and courier does ( both heavy used unix imap/pop3
>>>>> servers).
>>>>>
>>>>>            
>>>> A good extension would be to have a "login pattern" to read custom
>>>> folders..
>>>> e.g: I login as "username#FOLDER" with username password and this way
>>>> I get access to FOLDER instead of INBOX.
>>>> The same could be applied to the delete behaviour (something like the
>>>> "recent:" prefix hack in gmail).
>>>>
>>>>
>>>>          
>>>>> Another advance is that we elimate one more dependency on storing
>>>>> mails via javamail, which is not the way to go for the future ...
>>>>> On the downside we will break backward-compatibility with every James
>>>>> release we did before. So we will need to write a "migration" tool,
>>>>> but this should not be to hard.
>>>>>
>>>>>            
>>>> IMO at this point we should plainly ignore backward compatibility.
>>>> AFTER we'll have a working release we'll define a migration path (with
>>>> the help of users wanting to upgrade).
>>>>
>>>>
>>>>          
>>>>> Because the change is so heavy, I dedicited to attach it to JIRA  for
>>>>> review and not commit it directly.
>>>>>
>>>>> You can find it here:
>>>>> https://issues.apache.org/jira/browse/JAMES-983
>>>>>
>>>>> So what do you think ?
>>>>>
>>>>>            
>>>> +1
>>>>
>>>> Stefano
>>>>
>>>> ---------------------------------------------------------------------
>>>> To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
>>>> For additional commands, e-mail: server-dev-help@james.apache.org
>>>>
>>>>
>>>>
>>>>          
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
>>> For additional commands, e-mail: server-dev-help@james.apache.org
>>>
>>>
>>>
>>>
>>>        
>>
>>      
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
> For additional commands, e-mail: server-dev-help@james.apache.org
>
>
>    


---------------------------------------------------------------------
To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
For additional commands, e-mail: server-dev-help@james.apache.org