You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Kostas Kloudas (Jira)" <ji...@apache.org> on 2020/04/24 12:49:00 UTC
[jira] [Commented] (FLINK-17364) Support StreamingFileSink in
PrestoS3FileSystem
[ https://issues.apache.org/jira/browse/FLINK-17364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17091533#comment-17091533 ]
Kostas Kloudas commented on FLINK-17364:
----------------------------------------
Hi [~qqibrow]! Thanks for opening this. Are you planning to contribute this feature?
For some background, the reason we did not add support for the Presto S3 Fs implementation is that Presto does not give access to the underlying S3Client. Essentially, what needs to be implemented is a Presto-compatible {{S3AccessHelper}}.
> Support StreamingFileSink in PrestoS3FileSystem
> -----------------------------------------------
>
> Key: FLINK-17364
> URL: https://issues.apache.org/jira/browse/FLINK-17364
> Project: Flink
> Issue Type: Improvement
> Components: Connectors / FileSystem
> Affects Versions: 1.10.0
> Reporter: Lu Niu
> Priority: Major
>
> For S3, currently the StreamingFileSink supports only the Hadoop-based FileSystem implementation, not the implementation based on Presto At the same time, presto is the recommended file system for checkpointing. implementing StreamingFileSink in PrestoS3FileSystem helps filling the gap, enables user to use PrestoS3FileSystem in all access to S3.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)