You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flink.apache.org by 曾祥才 <xc...@qq.com> on 2021/01/27 08:23:59 UTC

rocksdb block cache usage

hi, all
&nbsp; &nbsp;I've enable state.backend.rocksdb.metrics.block-pinned-usage metric ,&nbsp;
&nbsp;and the flink_taskmanager_job_task_operator_window_contents_rocksdb_block_cache_pinned_usage metric exposed.&nbsp;
&nbsp;I'm confused&nbsp; that the total memory used for block cache pinned is sum of flink_taskmanager_job_task_operator_window_contents_rocksdb_block_cache_pinned_usage or just
&nbsp;flink_taskmanager_job_task_operator_window_contents_rocksdb_block_cache_pinned_usage (for block cache usage the metric seems per slot)?&nbsp;







&nbsp;

Re: rocksdb block cache usage

Posted by Yun Tang <my...@live.com>.
Hi,

If you have enabled managed memory, and since all rocksDB instances share the same block cache within one slot, all flink_taskmanager_job_task_operator_window_contents_rocksdb_block_cache_pinned_usage in the same slot would report the same value.


Best
Yun Tang
________________________________
From: Chesnay Schepler <ch...@apache.org>
Sent: Wednesday, January 27, 2021 20:59
To: 曾祥才 <xc...@qq.com>; User-Flink <us...@flink.apache.org>
Subject: Re: rocksdb block cache usage

I don't quite understand the question; all 3 metrics you listed are the same one?

On 1/27/2021 9:23 AM, 曾祥才 wrote:
hi, all
   I've enable state.backend.rocksdb.metrics.block-pinned-usage metric ,
 and the flink_taskmanager_job_task_operator_window_contents_rocksdb_block_cache_pinned_usage metric exposed.
 I'm confused  that the total memory used for block cache pinned is sum of flink_taskmanager_job_task_operator_window_contents_rocksdb_block_cache_pinned_usage or just
 flink_taskmanager_job_task_operator_window_contents_rocksdb_block_cache_pinned_usage (for block cache usage the metric seems per slot)?





Re: rocksdb block cache usage

Posted by Chesnay Schepler <ch...@apache.org>.
I don't quite understand the question; all 3 metrics you listed are the 
same one?

On 1/27/2021 9:23 AM, 曾祥才 wrote:
> hi, all
>    I've enable state.backend.rocksdb.metrics.block-pinned-usage metric ,
>  and the 
> flink_taskmanager_job_task_operator_window_contents_rocksdb_block_cache_pinned_usage 
> metric exposed.
>  I'm confused  that the total memory used for block cache pinned is 
> sum of 
> flink_taskmanager_job_task_operator_window_contents_rocksdb_block_cache_pinned_usage 
> or just
>  flink_taskmanager_job_task_operator_window_contents_rocksdb_block_cache_pinned_usage 
> (for block cache usage the metric seems per slot)?
>
>