You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flink.apache.org by 曾祥才 <xc...@qq.com> on 2021/01/27 08:23:59 UTC
rocksdb block cache usage
hi, all
I've enable state.backend.rocksdb.metrics.block-pinned-usage metric ,
and the flink_taskmanager_job_task_operator_window_contents_rocksdb_block_cache_pinned_usage metric exposed.
I'm confused that the total memory used for block cache pinned is sum of flink_taskmanager_job_task_operator_window_contents_rocksdb_block_cache_pinned_usage or just
flink_taskmanager_job_task_operator_window_contents_rocksdb_block_cache_pinned_usage (for block cache usage the metric seems per slot)?
Re: rocksdb block cache usage
Posted by Yun Tang <my...@live.com>.
Hi,
If you have enabled managed memory, and since all rocksDB instances share the same block cache within one slot, all flink_taskmanager_job_task_operator_window_contents_rocksdb_block_cache_pinned_usage in the same slot would report the same value.
Best
Yun Tang
________________________________
From: Chesnay Schepler <ch...@apache.org>
Sent: Wednesday, January 27, 2021 20:59
To: 曾祥才 <xc...@qq.com>; User-Flink <us...@flink.apache.org>
Subject: Re: rocksdb block cache usage
I don't quite understand the question; all 3 metrics you listed are the same one?
On 1/27/2021 9:23 AM, 曾祥才 wrote:
hi, all
I've enable state.backend.rocksdb.metrics.block-pinned-usage metric ,
and the flink_taskmanager_job_task_operator_window_contents_rocksdb_block_cache_pinned_usage metric exposed.
I'm confused that the total memory used for block cache pinned is sum of flink_taskmanager_job_task_operator_window_contents_rocksdb_block_cache_pinned_usage or just
flink_taskmanager_job_task_operator_window_contents_rocksdb_block_cache_pinned_usage (for block cache usage the metric seems per slot)?
Re: rocksdb block cache usage
Posted by Chesnay Schepler <ch...@apache.org>.
I don't quite understand the question; all 3 metrics you listed are the
same one?
On 1/27/2021 9:23 AM, 曾祥才 wrote:
> hi, all
> I've enable state.backend.rocksdb.metrics.block-pinned-usage metric ,
> and the
> flink_taskmanager_job_task_operator_window_contents_rocksdb_block_cache_pinned_usage
> metric exposed.
> I'm confused that the total memory used for block cache pinned is
> sum of
> flink_taskmanager_job_task_operator_window_contents_rocksdb_block_cache_pinned_usage
> or just
> flink_taskmanager_job_task_operator_window_contents_rocksdb_block_cache_pinned_usage
> (for block cache usage the metric seems per slot)?
>
>