You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flink.apache.org by "Sylvia Lin (Jira)" <ji...@apache.org> on 2023/02/16 02:09:00 UTC

[jira] [Created] (FLINK-31095) FileSink doesn't work with s3a on EKS

Sylvia Lin created FLINK-31095:
----------------------------------

             Summary: FileSink doesn't work with s3a on EKS
                 Key: FLINK-31095
                 URL: https://issues.apache.org/jira/browse/FLINK-31095
             Project: Flink
          Issue Type: Bug
          Components: Connectors / FileSystem
    Affects Versions: 1.16.1
            Reporter: Sylvia Lin


FileSink gives below exception on AWS EKS cluster:
{code:java}
Caused by: java.lang.UnsupportedOperationException: This s3 file system implementation does not support recoverable writers.
	at org.apache.flink.fs.s3.common.FlinkS3FileSystem.createRecoverableWriter(FlinkS3FileSystem.java:136) ~[?:?]
	at org.apache.flink.core.fs.PluginFileSystemFactory$ClassLoaderFixingFileSystem.createRecoverableWriter(PluginFileSystemFactory.java:134) ~[flink-dist-1.16.1.jar:1.16.1]
	at org.apache.flink.connector.file.sink.FileSink$RowFormatBuilder.createBucketWriter(FileSink.java:475) ~[flink-connector-files-1.16.1.jar:1.16.1]
	at org.apache.flink.connector.file.sink.FileSink$RowFormatBuilder.getCommittableSerializer(FileSink.java:466) ~[flink-connector-files-1.16.1.jar:1.16.1]
	at org.apache.flink.connector.file.sink.FileSink.getCommittableSerializer(FileSink.java:175) ~[flink-connector-files-1.16.1.jar:1.16.1]{code}
[https://github.com/apache/flink/blob/278dc7b793303d228f7816585054629708983af6/flink-filesystems/flink-s3-fs-base/src/main/java/org/apache/flink/fs/s3/common/FlinkS3FileSystem.java#LL136C16-L136C16]

And this may be related to https://issues.apache.org/jira/browse/FLINK-23487?page=com.atlassian.jira.plugin.system.issuetabpanels%3Aall-tabpanel 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)