You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2023/10/05 00:41:00 UTC

[jira] [Updated] (SPARK-45419) Avoid reusing rocksdb sst files in a dfferent rocksdb instance by removing file version map entry of larger versions

     [ https://issues.apache.org/jira/browse/SPARK-45419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

ASF GitHub Bot updated SPARK-45419:
-----------------------------------
    Labels: pull-request-available  (was: )

> Avoid reusing rocksdb sst files in a dfferent rocksdb instance by removing file version map entry of larger versions
> --------------------------------------------------------------------------------------------------------------------
>
>                 Key: SPARK-45419
>                 URL: https://issues.apache.org/jira/browse/SPARK-45419
>             Project: Spark
>          Issue Type: Improvement
>          Components: Structured Streaming
>    Affects Versions: 3.5.0
>            Reporter: Chaoqin Li
>            Priority: Major
>              Labels: pull-request-available
>
> When loading a rocksdb instance, remove file version map entry of larger versions to avoid rocksdb sst file unique id mismatch exception. The SST files in larger versions can't be reused even if they have the same size and name because they belong to another rocksdb instance.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org