[jira] [Resolved] (SPARK-42792) Add support to track FLUSH_WRITE_BYTES for RocksDB state store for streaming

["Jungtaek Lim (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SPARK-42792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jungtaek Lim resolved SPARK-42792.
----------------------------------
    Fix Version/s: 3.5.0
       Resolution: Fixed

Issue resolved by pull request 40427
[https://github.com/apache/spark/pull/40427]

> Add support to track FLUSH_WRITE_BYTES for RocksDB state store for streaming
> ----------------------------------------------------------------------------
>
>                 Key: SPARK-42792
>                 URL: https://issues.apache.org/jira/browse/SPARK-42792
>             Project: Spark
>          Issue Type: Task
>          Components: Structured Streaming
>    Affects Versions: 3.4.0
>            Reporter: Anish Shrigondekar
>            Assignee: Anish Shrigondekar
>            Priority: Major
>             Fix For: 3.5.0
>
>
> Add support to track FLUSH_WRITE_BYTES for RocksDB state store for streaming
>  
> Its useful to get this metric for bytes written during flush from RocksDB as part of the DB custom metrics. We propose to add this to the existing metrics that are collected. There is no additional overhead since we are just querying the internal ticker guage, similar to other metrics.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org