You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flink.apache.org by "Chesnay Schepler (Jira)" <ji...@apache.org> on 2021/09/09 07:26:00 UTC

[jira] [Created] (FLINK-24226) Improve error message when trying Presto S3 FS with recoverable writer

Chesnay Schepler created FLINK-24226:
----------------------------------------

             Summary: Improve error message when trying Presto S3 FS with recoverable writer
                 Key: FLINK-24226
                 URL: https://issues.apache.org/jira/browse/FLINK-24226
             Project: Flink
          Issue Type: Technical Debt
          Components: FileSystems
            Reporter: Chesnay Schepler
             Fix For: 1.15.0


When you use the Presto S3 FileSystem with recoverable writers you get this exception:

{code}
java.lang.UnsupportedOperationException: This s3 file system implementation does not support recoverable writers.
    at org.apache.flink.fs.s3.common.FlinkS3FileSystem.createRecoverableWriter(FlinkS3FileSystem.java:136)
    at org.apache.flink.core.fs.PluginFileSystemFactory$ClassLoaderFixingFileSystem.createRecoverableWriter(PluginFileSystemFactory.java:134)
    at org.apache.flink.core.fs.SafetyNetWrapperFileSystem.createRecoverableWriter(SafetyNetWrapperFileSystem.java:69)
    at org.apache.flink.streaming.api.functions.sink.filesystem.StreamingFileSink$RowFormatBuilder.createBuckets(StreamingFileSink.java:260)
    at org.apache.flink.streaming.api.functions.sink.filesystem.StreamingFileSink.initializeState(StreamingFileSink.java:396)
{code}

While this is technically _correct_ it's not really helpful to a user. It does not propose a course of action (e.g., "Use the Hadoop S3 FileSystem instead"), which is particularly important because this limitation isn't documented.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)