You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kudu.apache.org by "Li Zhiming (Jira)" <ji...@apache.org> on 2021/03/01 08:21:00 UTC

[jira] [Created] (KUDU-3253) Log block manager may consume a huge amount of memory

Li Zhiming created KUDU-3253:
--------------------------------

             Summary: Log block manager may consume a huge amount of memory
                 Key: KUDU-3253
                 URL: https://issues.apache.org/jira/browse/KUDU-3253
             Project: Kudu
          Issue Type: Bug
          Components: fs
            Reporter: Li Zhiming
         Attachments: process.svg

LBM kept low live ratio containers' metadata for compation and punching hole in memory. The amount may grow too large,makes the time wasted on handling page fault.

 

I0224 08:29:40.393473 54898 log_block_manager.cc:2975] Compacted 2333 metadata files (279182030063 metadata bytes)
I0224 10:34:03.299155 73062 log_block_manager.cc:2975] Compacted 2337 metadata files (280053530024 metadata bytes)
I0224 10:47:21.935983 12825 fs_manager.cc:433] Time spent opening block manager: real 62879.018s user 1111.182s sys 1195.374s



--
This message was sent by Atlassian Jira
(v8.3.4#803005)