You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "Stephan Ewen (Jira)" <ji...@apache.org> on 2020/02/17 11:06:00 UTC

[jira] [Commented] (FLINK-16015) Refine fallback filesystems to only handle specific filesystems

    [ https://issues.apache.org/jira/browse/FLINK-16015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17038249#comment-17038249 ] 

Stephan Ewen commented on FLINK-16015:
--------------------------------------

How about we filter the protocols where we have specific implementations and point to those?

Specific features, like recoverable writers, are implicitly white-listed because only some implementations override the base method (which throws UnsupportedOperationException).

> Refine fallback filesystems to only handle specific filesystems
> ---------------------------------------------------------------
>
>                 Key: FLINK-16015
>                 URL: https://issues.apache.org/jira/browse/FLINK-16015
>             Project: Flink
>          Issue Type: Improvement
>          Components: FileSystems
>    Affects Versions: 1.10.1, 1.11.0
>            Reporter: Arvid Heise
>            Priority: Major
>
> Currently, if no s3 plugin is included, hadoop is used as a fallback, which introduces a wide variety of problems. We should probably only white list specific protocols that work well (e.g. hdfs).



--
This message was sent by Atlassian Jira
(v8.3.4#803005)