You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Fabian Hueske (JIRA)" <ji...@apache.org> on 2015/10/09 16:05:28 UTC

[jira] [Comment Edited] (FLINK-2842) S3FileSystem is broken

    [ https://issues.apache.org/jira/browse/FLINK-2842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14950435#comment-14950435 ] 

Fabian Hueske edited comment on FLINK-2842 at 10/9/15 2:05 PM:
---------------------------------------------------------------

Doesn't it work out of the box if I remove the Flink {{S3FileSystem}} from the list of known FS in {{FileSystem.java}}?

Isn't it working for Tachyon exactly the same way?


was (Author: fhueske):
Doesn't it work out of the box if I remove the Flink {{S3FileSystem}} from the list of known FS in {{FileSystem.java}}?

> S3FileSystem is broken
> ----------------------
>
>                 Key: FLINK-2842
>                 URL: https://issues.apache.org/jira/browse/FLINK-2842
>             Project: Flink
>          Issue Type: Bug
>    Affects Versions: 0.9, 0.10
>            Reporter: Fabian Hueske
>            Assignee: Fabian Hueske
>            Priority: Critical
>             Fix For: 0.10
>
>
> Flink has a file system implementation for S3 which is broken. Therefore, Flink cannot out-of-the-box read data from S3.
> Since Flink can use all Hadoop FileSystems, I propose to completely remove Flink's S3FileSystem and rely on Hadoop's implementation.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)