You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2025/08/27 17:06:00 UTC

[jira] [Updated] (SPARK-53398) Ensure that RocksDBMemoryManager metrics reporting doesn't throw a NullPointerException

     [ https://issues.apache.org/jira/browse/SPARK-53398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

ASF GitHub Bot updated SPARK-53398:
-----------------------------------
    Labels: pull-request-available  (was: )

> Ensure that RocksDBMemoryManager metrics reporting doesn't throw a NullPointerException
> ---------------------------------------------------------------------------------------
>
>                 Key: SPARK-53398
>                 URL: https://issues.apache.org/jira/browse/SPARK-53398
>             Project: Spark
>          Issue Type: Improvement
>          Components: Structured Streaming
>    Affects Versions: 4.1.0
>            Reporter: Eric Marnadi
>            Priority: Major
>              Labels: pull-request-available
>
> If the RocksDB instance is unregistered from the memory manager via maintenance, then metrics are called on the same instance, then we will throw an NPE, which will fail the query, from the RocksDBMemoryManager metrics reporting path. We can handle this by appending a UUID to the uniqueId we pass to RocksDB and using getOrDefault in the Memory Manager.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org