You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Yun Gao (Jira)" <ji...@apache.org> on 2022/04/13 06:28:05 UTC

[jira] [Updated] (FLINK-24226) Improve error message when trying Presto S3 FS with recoverable writer

     [ https://issues.apache.org/jira/browse/FLINK-24226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Yun Gao updated FLINK-24226:
----------------------------
    Fix Version/s: 1.16.0

> Improve error message when trying Presto S3 FS with recoverable writer
> ----------------------------------------------------------------------
>
>                 Key: FLINK-24226
>                 URL: https://issues.apache.org/jira/browse/FLINK-24226
>             Project: Flink
>          Issue Type: Technical Debt
>          Components: FileSystems
>            Reporter: Chesnay Schepler
>            Priority: Major
>             Fix For: 1.15.0, 1.16.0
>
>
> When you use the Presto S3 FileSystem with recoverable writers you get this exception:
> {code}
> java.lang.UnsupportedOperationException: This s3 file system implementation does not support recoverable writers.
>     at org.apache.flink.fs.s3.common.FlinkS3FileSystem.createRecoverableWriter(FlinkS3FileSystem.java:136)
>     at org.apache.flink.core.fs.PluginFileSystemFactory$ClassLoaderFixingFileSystem.createRecoverableWriter(PluginFileSystemFactory.java:134)
>     at org.apache.flink.core.fs.SafetyNetWrapperFileSystem.createRecoverableWriter(SafetyNetWrapperFileSystem.java:69)
>     at org.apache.flink.streaming.api.functions.sink.filesystem.StreamingFileSink$RowFormatBuilder.createBuckets(StreamingFileSink.java:260)
>     at org.apache.flink.streaming.api.functions.sink.filesystem.StreamingFileSink.initializeState(StreamingFileSink.java:396)
> {code}
> While this is technically _correct_ it's not really helpful to a user. It does not propose a course of action (e.g., "Use the Hadoop S3 FileSystem instead"), which is particularly important because this limitation isn't documented.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)