You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flink.apache.org by "Roman Khachatryan (Jira)" <ji...@apache.org> on 2021/12/11 22:04:00 UTC

[jira] [Created] (FLINK-25260) Recovery fails when using changelog+s3+presto

Roman Khachatryan created FLINK-25260:
-----------------------------------------

             Summary: Recovery fails when using changelog+s3+presto
                 Key: FLINK-25260
                 URL: https://issues.apache.org/jira/browse/FLINK-25260
             Project: Flink
          Issue Type: Bug
          Components: Connectors / FileSystem, Runtime / State Backends
            Reporter: Roman Khachatryan


Recovery succeeds if using local FS or hadoop S3 plugin, but fails with Presto:
{code}
Caused by: java.lang.IllegalStateException
    at org.apache.flink.util.Preconditions.checkState(Preconditions.java:177)
    at org.apache.flink.changelog.fs.StateChangeFormat$1.readChange(StateChangeFormat.java:138)
    at org.apache.flink.changelog.fs.StateChangeFormat$1.next(StateChangeFormat.java:129)
    at org.apache.flink.changelog.fs.StateChangeFormat$1.next(StateChangeFormat.java:98)
    at org.apache.flink.runtime.state.changelog.StateChangelogHandleStreamHandleReader$1.next(StateChangelogHandleStreamHandleReader.java:76)
    at org.apache.flink.runtime.state.changelog.StateChangelogHandleStreamHandleReader$1.next(StateChangelogHandleStreamHandleReader.java:61)
    at org.apache.flink.state.changelog.restore.ChangelogBackendRestoreOperation.readBackendHandle(ChangelogBackendRestoreOperation.java:94)
    at org.apache.flink.state.changelog.restore.ChangelogBackendRestoreOperation.restore(ChangelogBackendRestoreOperation.java:74)
    at org.apache.flink.state.changelog.ChangelogStateBackend.restore(ChangelogStateBackend.java:221)
    at org.apache.flink.state.changelog.ChangelogStateBackend.createKeyedStateBackend(ChangelogStateBackend.java:145)
    at org.apache.flink.streaming.api.operators.StreamTaskStateInitializerImpl.lambda$keyedStatedBackend$1(StreamTaskStateInitializerImpl.java:329)
    at org.apache.flink.streaming.api.operators.BackendRestorerProcedure.attemptCreateAndRestore(BackendRestorerProcedure.java:168)
    at org.apache.flink.streaming.api.operators.BackendRestorerProcedure.createAndRestore(BackendRestorerProcedure.java:135)
    ... 13 more
{code}


This is likely caused by some intermediate buffers



--
This message was sent by Atlassian Jira
(v8.20.1#820001)