You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flink.apache.org by "Dawid Wysakowicz (Jira)" <ji...@apache.org> on 2022/02/03 16:15:00 UTC

[jira] [Created] (FLINK-25952) Savepoint on S3 are not relocatable even if entropy injection is not enabled

Dawid Wysakowicz created FLINK-25952:
----------------------------------------

             Summary: Savepoint on S3 are not relocatable even if entropy injection is not enabled
                 Key: FLINK-25952
                 URL: https://issues.apache.org/jira/browse/FLINK-25952
             Project: Flink
          Issue Type: Bug
          Components: FileSystems, Runtime / Checkpointing
    Affects Versions: 1.14.3, 1.13.5, 1.15.0
            Reporter: Dawid Wysakowicz
            Assignee: Dawid Wysakowicz
             Fix For: 1.15.0, 1.14.4, 1.13.7


We have a limitation that if we create savepoints with an injected entropy, they are not relocatable (https://nightlies.apache.org/flink/flink-docs-master/docs/ops/state/savepoints/#triggering-savepoints).

However the check if we use the entropy is flawed. In {{FsCheckpointStreamFactory}} we check only if the used filesystem extends from {{EntropyInjectingFileSystem}}. {{FlinkS3FileSystem}} does, but it still may have the entropy disabled. {{FlinkS3FileSystem#getEntropyInjectionKey}} may still return {{null}}. We should check for that in {{org.apache.flink.core.fs.EntropyInjector#isEntropyInjecting}}



--
This message was sent by Atlassian Jira
(v8.20.1#820001)