You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Anish Shrigondekar (Jira)" <ji...@apache.org> on 2023/03/14 21:37:00 UTC

[jira] [Commented] (SPARK-42792) Add support to track FLUSH_WRITE_BYTES for RocksDB state store for streaming

    [ https://issues.apache.org/jira/browse/SPARK-42792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17700387#comment-17700387 ] 

Anish Shrigondekar commented on SPARK-42792:
--------------------------------------------

Will send the PR soon - cc - [~kabhwan] 

> Add support to track FLUSH_WRITE_BYTES for RocksDB state store for streaming
> ----------------------------------------------------------------------------
>
>                 Key: SPARK-42792
>                 URL: https://issues.apache.org/jira/browse/SPARK-42792
>             Project: Spark
>          Issue Type: Task
>          Components: Structured Streaming
>    Affects Versions: 3.4.0
>            Reporter: Anish Shrigondekar
>            Priority: Major
>
> Add support to track FLUSH_WRITE_BYTES for RocksDB state store for streaming
>  
> Its useful to get this metric for bytes written during flush from RocksDB as part of the DB custom metrics. We propose to add this to the existing metrics that are collected. There is no additional overhead since we are just querying the internal ticker guage, similar to other metrics.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org