You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flink.apache.org by "Chesnay Schepler (Jira)" <ji...@apache.org> on 2021/09/09 07:26:00 UTC
[jira] [Created] (FLINK-24226) Improve error message when trying
Presto S3 FS with recoverable writer
Chesnay Schepler created FLINK-24226:
----------------------------------------
Summary: Improve error message when trying Presto S3 FS with recoverable writer
Key: FLINK-24226
URL: https://issues.apache.org/jira/browse/FLINK-24226
Project: Flink
Issue Type: Technical Debt
Components: FileSystems
Reporter: Chesnay Schepler
Fix For: 1.15.0
When you use the Presto S3 FileSystem with recoverable writers you get this exception:
{code}
java.lang.UnsupportedOperationException: This s3 file system implementation does not support recoverable writers.
at org.apache.flink.fs.s3.common.FlinkS3FileSystem.createRecoverableWriter(FlinkS3FileSystem.java:136)
at org.apache.flink.core.fs.PluginFileSystemFactory$ClassLoaderFixingFileSystem.createRecoverableWriter(PluginFileSystemFactory.java:134)
at org.apache.flink.core.fs.SafetyNetWrapperFileSystem.createRecoverableWriter(SafetyNetWrapperFileSystem.java:69)
at org.apache.flink.streaming.api.functions.sink.filesystem.StreamingFileSink$RowFormatBuilder.createBuckets(StreamingFileSink.java:260)
at org.apache.flink.streaming.api.functions.sink.filesystem.StreamingFileSink.initializeState(StreamingFileSink.java:396)
{code}
While this is technically _correct_ it's not really helpful to a user. It does not propose a course of action (e.g., "Use the Hadoop S3 FileSystem instead"), which is particularly important because this limitation isn't documented.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)