You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Martijn Visser (Jira)" <ji...@apache.org> on 2023/12/18 13:07:00 UTC
[jira] [Reopened] (FLINK-33793) java.lang.NoSuchMethodError when checkpointing in Google Cloud Storage
[ https://issues.apache.org/jira/browse/FLINK-33793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Martijn Visser reopened FLINK-33793:
------------------------------------
Assignee: Martijn Visser
> java.lang.NoSuchMethodError when checkpointing in Google Cloud Storage
> ----------------------------------------------------------------------
>
> Key: FLINK-33793
> URL: https://issues.apache.org/jira/browse/FLINK-33793
> Project: Flink
> Issue Type: Bug
> Components: Runtime / Checkpointing
> Affects Versions: 1.18.0
> Environment: Flink 1.18
> Reporter: ChangZhuo Chen (陳昌倬)
> Assignee: Martijn Visser
> Priority: Critical
>
> We have the following exception when checkpointing in Flink 1.18 + Google Cloud Storage. The same code works well in Flink 1.17:
>
> {{2023-12-11 07:45:28,861 ERROR org.apache.flink.util.FatalExitExceptionHandler [] - FATAL: Thread 'jobmanager-io-thread-5' produced an uncaught exception. Stopping the process...}}
> {{java.lang.NoSuchMethodError: 'com.google.common.collect.ImmutableMap com.google.common.collect.ImmutableMap$Builder.buildOrThrow()'}}
> {{ at com.google.cloud.storage.UnifiedOpts$Opts.getRpcOptions(UnifiedOpts.java:2096) ~[?:?]}}
> {{ at com.google.cloud.storage.StorageImpl.writer(StorageImpl.java:624) ~[?:?]}}
> {{ at com.google.cloud.storage.StorageImpl.writer(StorageImpl.java:90) ~[?:?]}}
> {{ at org.apache.flink.fs.gs.storage.GSBlobStorageImpl.writeBlob(GSBlobStorageImpl.java:64) ~[?:?]}}
> {{ at org.apache.flink.fs.gs.writer.GSRecoverableFsDataOutputStream.createWriteChannel(GSRecoverableFsDataOutputStream.java:229) ~[?:?]}}
> {{ at org.apache.flink.fs.gs.writer.GSRecoverableFsDataOutputStream.write(GSRecoverableFsDataOutputStream.java:152) ~[?:?]}}
> {{ at org.apache.flink.fs.gs.writer.GSRecoverableFsDataOutputStream.write(GSRecoverableFsDataOutputStream.java:135) ~[?:?]}}
> {{ at org.apache.flink.fs.gs.writer.GSRecoverableFsDataOutputStream.write(GSRecoverableFsDataOutputStream.java:128) ~[?:?]}}
> {{ at org.apache.flink.runtime.state.filesystem.FsCheckpointMetadataOutputStream.write(FsCheckpointMetadataOutputStream.java:73) ~[flink-dist-1.18.0.jar:1.18.0]}}
> {{ at java.io.DataOutputStream.writeInt(Unknown Source) ~[?:?]}}
> {{ at org.apache.flink.runtime.checkpoint.Checkpoints.storeCheckpointMetadata(Checkpoints.java:98) ~[flink-dist-1.18.0.jar:1.18.0]}}
> {{ at org.apache.flink.runtime.checkpoint.Checkpoints.storeCheckpointMetadata(Checkpoints.java:88) ~[flink-dist-1.18.0.jar:1.18.0]}}
> {{ at org.apache.flink.runtime.checkpoint.Checkpoints.storeCheckpointMetadata(Checkpoints.java:83) ~[flink-dist-1.18.0.jar:1.18.0]}}
> {{ at org.apache.flink.runtime.checkpoint.PendingCheckpoint.finalizeCheckpoint(PendingCheckpoint.java:335) ~[flink-dist-1.18.0.jar:1.18.0]}}
> {{ at org.apache.flink.runtime.checkpoint.CheckpointCoordinator.finalizeCheckpoint(CheckpointCoordinator.java:1404) ~[flink-dist-1.18.0.jar:1.18.0]}}
> {{ at org.apache.flink.runtime.checkpoint.CheckpointCoordinator.completePendingCheckpoint(CheckpointCoordinator.java:1303) ~[flink-dist-1.18.0.jar:1.18.0]}}
> {{ at org.apache.flink.runtime.checkpoint.CheckpointCoordinator.receiveAcknowledgeMessage(CheckpointCoordinator.java:1195) ~[flink-dist-1.18.0.jar:1.18.0]}}
> {{ at org.apache.flink.runtime.scheduler.ExecutionGraphHandler.lambda$acknowledgeCheckpoint$1(ExecutionGraphHandler.java:89) ~[flink-dist-1.18.0.jar:1.18.0]}}
> {{ at org.apache.flink.runtime.scheduler.ExecutionGraphHandler.lambda$processCheckpointCoordinatorMessage$3(ExecutionGraphHandler.java:119) ~[flink-dist-1.18.0.jar:1.18.0]}}
> {{ at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[?:?]}}
> {{ at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[?:?]}}
> {{ at java.lang.Thread.run(Unknown Source) [?:?]}}
>
> The issue has been reported in GitHub [https://github.com/apache/flink/pull/22281#issuecomment-1728553794.] However, it is still not fixed yet in 1.18.0.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)