You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@flink.apache.org by "Till Rohrmann (Jira)" <ji...@apache.org> on 2021/12/28 14:27:00 UTC

[jira] [Created] (FLINK-25468) Local recovery fails if local state storage and RocksDB working directory are not on the same volume

Till Rohrmann created FLINK-25468:
-------------------------------------

             Summary: Local recovery fails if local state storage and RocksDB working directory are not on the same volume
                 Key: FLINK-25468
                 URL: https://issues.apache.org/jira/browse/FLINK-25468
             Project: Flink
          Issue Type: Bug
          Components: Runtime / State Backends
    Affects Versions: 1.14.2, 1.13.5, 1.15.0
            Reporter: Till Rohrmann
            Assignee: Till Rohrmann
             Fix For: 1.15.0, 1.13.6, 1.14.3


Local recovery with RocksDB fails if the state storage directory is not on the same volume as RocksDB's working directory. The reason is that the {{RocksDBHandle}} only tries to hard link the RocksDB files when calling {{restoreInstanceDirectoryFromPath}}. If hard linking is not supported, then the operation fails.

In order to harden this behaviour, I suggest to fall back to copying the files over if hard linking fails.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)