You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "Farnight (Jira)" <ji...@apache.org> on 2020/07/25 02:50:00 UTC

[jira] [Created] (FLINK-18712) Flink RocksDB statebackend memory leak issue

Farnight created FLINK-18712:
--------------------------------

             Summary: Flink RocksDB statebackend memory leak issue 
                 Key: FLINK-18712
                 URL: https://issues.apache.org/jira/browse/FLINK-18712
             Project: Flink
          Issue Type: Bug
          Components: Runtime / State Backends
    Affects Versions: 1.10.0
            Reporter: Farnight


When using RocksDB as our statebackend, we found it will lead to memory leak when restarting job (manually or in recovery case).

 

How to reproduce:
 # increase RocksDB blockcache size(e.g. 1G), it is easier to monitor and reproduce.
 # start a job using RocksDB statebackend.
 # when the RocksDB blockcache reachs maximum size, restart the job. and monitor the memory usage (k8s pod working set) of the TM.
 # go through step 2-3 few more times. and memory will keep raising.

 

Any solution or suggestion for this? Thanks!



--
This message was sent by Atlassian Jira
(v8.3.4#803005)