You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@ponymail.apache.org by GitBox <gi...@apache.org> on 2021/09/26 11:40:21 UTC

[GitHub] [incubator-ponymail-foal] sebbASF opened a new issue #94: Does not handle mailboxes with many large messages

sebbASF opened a new issue #94:
URL: https://github.com/apache/incubator-ponymail-foal/issues/94


   There seems to be a memory issue with large messages, especially if a mailbox has lots of them.
   
   It looks like the server returns the full contents of all the messages, even though the client can only display a few of them, and may not ever display them all.
   
   This impacts the server, client and network.
   
   Seems to me the server should only return what the client can reasonably display.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@ponymail.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-ponymail-foal] sebbASF commented on issue #94: Does not handle mailboxes with many large messages

Posted by GitBox <gi...@apache.org>.
sebbASF commented on issue #94:
URL: https://github.com/apache/incubator-ponymail-foal/issues/94#issuecomment-994137415


   mbox.lua is no longer limited in the number of emails it can handle.
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@ponymail.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-ponymail-foal] Humbedooh commented on issue #94: Does not handle mailboxes with many large messages

Posted by GitBox <gi...@apache.org>.
Humbedooh commented on issue #94:
URL: https://github.com/apache/incubator-ponymail-foal/issues/94#issuecomment-945153143


   I've modified the archiver and migrator, and made a small converter for existing databases for this, https://gist.github.com/Humbedooh/e29b2132efa96d0b3b9fcd7d581c5767
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@ponymail.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-ponymail-foal] Humbedooh commented on issue #94: Does not handle mailboxes with many large messages

Posted by GitBox <gi...@apache.org>.
Humbedooh commented on issue #94:
URL: https://github.com/apache/incubator-ponymail-foal/issues/94#issuecomment-945152350


   I think the best approach here, which I'm working on right now, is to store an additional body field that is pre-shortened, and only grab that in the ES query, not the full body (which is not needed). That should speed up things considerably.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@ponymail.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-ponymail-foal] sebbASF commented on issue #94: Does not handle mailboxes with many large messages

Posted by GitBox <gi...@apache.org>.
sebbASF commented on issue #94:
URL: https://github.com/apache/incubator-ponymail-foal/issues/94#issuecomment-945192667


   Can we not use scripting to return a shortened version of the body? 
   That would allow the size to be easily adjusted if necessary, as well as reducing duplication
   
   Or even define a short_body runtime variable?
   
   This trade space for CPU so would work better where only a few results are returned at a time.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@ponymail.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-ponymail-foal] sebbASF commented on issue #94: Does not handle mailboxes with many large messages

Posted by GitBox <gi...@apache.org>.
sebbASF commented on issue #94:
URL: https://github.com/apache/incubator-ponymail-foal/issues/94#issuecomment-945084829


   The endpoint is stats.lua. 
   
   Try https://lists-test.apache.org/list?devnull@infra.apache.org:2019-3
   This takes ages to load and display.
   
   Even the following, which has 848 messages, is slow to display:
   https://lists-test.apache.org/list?devnull@infra.apache.org:2019-6
   
   Compare this with the following, which has 881 messages:
   https://lists-test.apache.org/list?issues@infra.apache.org:2021-5


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@ponymail.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-ponymail-foal] sebbASF commented on issue #94: Does not handle mailboxes with many large messages

Posted by GitBox <gi...@apache.org>.
sebbASF commented on issue #94:
URL: https://github.com/apache/incubator-ponymail-foal/issues/94#issuecomment-945189400


   That helps, at the cost of extra space needed for the database.
   
   However it does not solve the problem.
   The GUI can only display a limited number of emails, yet the server returns all that match. Most are never going to be displayed.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@ponymail.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-ponymail-foal] Humbedooh commented on issue #94: Does not handle mailboxes with many large messages

Posted by GitBox <gi...@apache.org>.
Humbedooh commented on issue #94:
URL: https://github.com/apache/incubator-ponymail-foal/issues/94#issuecomment-945024562


   I'm struggling to parse this ticket.
   Which end-point is having difficulties here, and what is the corresponding point in the UI?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@ponymail.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org