You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by GitBox <gi...@apache.org> on 2020/11/26 08:42:16 UTC
[GitHub] [incubator-doris] PeterGZW opened a new issue #4962: stream load 用json导入时发生内存泄漏
PeterGZW opened a new issue #4962:
URL: https://github.com/apache/incubator-doris/issues/4962
服务器配置 1fe3be ， 8核16G ，内存都是默认参数
1.每次查询mysql 1w条记录 转成json文件
2.通过curl 导入进doris。平均doris耗时1s消费一批json。 （单个json文件大小在20-40M。）
3.稳定跑1h左右，3台内存有一台会达到90%以上，然后突然无响应。过一段时间后进程被系统kill，发生了OOM。
版本doris 0.13.11-release
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] stdpain commented on issue #4962: stream load 用json导入时发生内存泄漏
Posted by GitBox <gi...@apache.org>.
stdpain commented on issue #4962:
URL: https://github.com/apache/incubator-doris/issues/4962#issuecomment-743701249
issues #5069
pull request #5073
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] Dam1029 commented on issue #4962: stream load 用json导入时发生内存泄漏
Posted by GitBox <gi...@apache.org>.
Dam1029 commented on issue #4962:
URL: https://github.com/apache/incubator-doris/issues/4962#issuecomment-741660249
顶一下，这边也遇到了类似的问题，我们使用flink封装了stream load，并将json文件实时发送到doris后，be的内存值doris_be_memory_allocated_bytes一直上涨到OOM，即便任务停止，内存监控值也下不来(没有释放)，重启才能恢复
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org