You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2026/02/15 19:26:01 UTC
[jira] [Closed] (SPARK-45419) Avoid reusing rocksdb sst files in a dfferent rocksdb instance by removing file version map entry of larger versions
[ https://issues.apache.org/jira/browse/SPARK-45419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Dongjoon Hyun closed SPARK-45419.
---------------------------------
> Avoid reusing rocksdb sst files in a dfferent rocksdb instance by removing file version map entry of larger versions
> --------------------------------------------------------------------------------------------------------------------
>
> Key: SPARK-45419
> URL: https://issues.apache.org/jira/browse/SPARK-45419
> Project: Spark
> Issue Type: Improvement
> Components: Structured Streaming
> Affects Versions: 3.5.0
> Reporter: Chaoqin Li
> Assignee: Chaoqin Li
> Priority: Major
> Labels: pull-request-available
> Fix For: 3.5.1, 4.0.0
>
>
> When loading a rocksdb instance, remove file version map entry of larger versions to avoid rocksdb sst file unique id mismatch exception. The SST files in larger versions can't be reused even if they have the same size and name because they belong to another rocksdb instance.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org