[jira] [Resolved] (SPARK-52989) Add explicit close API to RocksDB State store iterator and fix current usage

["Jungtaek Lim (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SPARK-52989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jungtaek Lim resolved SPARK-52989.
----------------------------------
    Fix Version/s: 4.1.0
         Assignee: Dylan Wong
       Resolution: Fixed

Issue resolved via https://github.com/apache/spark/pull/51701

> Add explicit close API to RocksDB State store iterator and fix current usage
> ----------------------------------------------------------------------------
>
>                 Key: SPARK-52989
>                 URL: https://issues.apache.org/jira/browse/SPARK-52989
>             Project: Spark
>          Issue Type: Task
>          Components: Structured Streaming
>    Affects Versions: 4.1.0
>            Reporter: Dylan Wong
>            Assignee: Dylan Wong
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 4.1.0
>
>
> The iterator returned from RocksDB method does not expose close method (requires change of method signature - current it's {{{}Iterator{}}}) hence either caller has to ensure the iterator to be fully consumed or wait until end of task when task completion listener closes it. We need to add ability for the caller to close the iterator when the iterator is no longer needed.
>  
> Also fix current usage of the iterator, to explicitly close when it is no longer needed.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org