You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by GitBox <gi...@apache.org> on 2020/04/16 05:16:29 UTC
[GitHub] [incubator-doris] acelyc111 opened a new issue #3328: Use LSAN to
fix some memory leaks
acelyc111 opened a new issue #3328: Use LSAN to fix some memory leaks
URL: https://github.com/apache/incubator-doris/issues/3328
**Describe the bug**
In our production environment, we found BE physical memory consumed continuously and lead to OOM several days later.
We doubt there are some memory leak in BE, we could use [LSAN](http://doris.apache.org/documentation/cn/developer-guide/debug-tool.html#lsan) to detect memory leak of unit tests at first.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] XShun commented on issue #3328: Use LSAN to fix
some memory leaks
Posted by GitBox <gi...@apache.org>.
XShun commented on issue #3328: Use LSAN to fix some memory leaks
URL: https://github.com/apache/incubator-doris/issues/3328#issuecomment-614496430
Good job!
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] kangkaisen commented on issue #3328: Use LSAN to
fix some memory leaks
Posted by GitBox <gi...@apache.org>.
kangkaisen commented on issue #3328: Use LSAN to fix some memory leaks
URL: https://github.com/apache/incubator-doris/issues/3328#issuecomment-614659497
> we expect CI could run both in LSAN mode to detect memory leak problems as early as possible.
Good suggestion !
I think we should do this work. @imay @morningman
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] acelyc111 commented on issue #3328: Use LSAN to
fix some memory leaks
Posted by GitBox <gi...@apache.org>.
acelyc111 commented on issue #3328: Use LSAN to fix some memory leaks
URL: https://github.com/apache/incubator-doris/issues/3328#issuecomment-614494730
After this issue has been resolved, we expect CI could run both in LSAN mode to detect memory leak problems as early as possible.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] morningman commented on issue #3328: Use LSAN to
fix some memory leaks
Posted by GitBox <gi...@apache.org>.
morningman commented on issue #3328: Use LSAN to fix some memory leaks
URL: https://github.com/apache/incubator-doris/issues/3328#issuecomment-614998929
> After this issue has been resolved, we expect CI could run both in LSAN mode to detect memory leak problems as early as possible.
Currently, we don't have enough resource to run CI with LSAN mode, it will takes a very long time. So you have to run LSAN in your local environment before upgrading.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] acelyc111 commented on issue #3328: Use LSAN to fix some memory leaks
Posted by GitBox <gi...@apache.org>.
acelyc111 commented on issue #3328:
URL: https://github.com/apache/incubator-doris/issues/3328#issuecomment-617517103
I restart 2 BE servers the last Friday, one keep the old version, the other optimize memory usage, by https://github.com/apache/incubator-doris/pull/3316 and https://github.com/apache/incubator-doris/pull/3326, after 4 days observation, I found the physical memory usage gap between the two BE became about 14 GB, include https://github.com/apache/incubator-doris/pull/3316 which reduce about 6.6 GB (by rowset id count 415,756,350 * per rowset id memory reduce size 17 Bytes), that is to say https://github.com/apache/incubator-doris/pull/3326 can reduce about 7.4 GB.
106.bj: the old version
102.bj: optimize version
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org