[jira] [Created] (SPARK-42792) Add support to track FLUSH_WRITE_BYTES for RocksDB state store for streaming

["Anish Shrigondekar (Jira)" <ji...@apache.org>]

Anish Shrigondekar created SPARK-42792:
------------------------------------------

             Summary: Add support to track FLUSH_WRITE_BYTES for RocksDB state store for streaming
                 Key: SPARK-42792
                 URL: https://issues.apache.org/jira/browse/SPARK-42792
             Project: Spark
          Issue Type: Task
          Components: Structured Streaming
    Affects Versions: 3.4.0
            Reporter: Anish Shrigondekar


Add support to track FLUSH_WRITE_BYTES for RocksDB state store for streaming

 

Its useful to get this metric for bytes written during flush from RocksDB as part of the DB custom metrics. We propose to add this to the existing metrics that are collected. There is no additional overhead since we are just querying the internal ticker guage, similar to other metrics.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org