You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Steven Zhen Wu (JIRA)" <ji...@apache.org> on 2019/01/16 18:52:00 UTC

[jira] [Commented] (FLINK-11195) Extend AbstractS3FileSystemFactory.createHadoopFileSystem to accept URI and Hadoop Configuration

    [ https://issues.apache.org/jira/browse/FLINK-11195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16744346#comment-16744346 ] 

Steven Zhen Wu commented on FLINK-11195:
----------------------------------------

[~StephanEwen] can you take a look at this Jira and PR from [~markcho]?

> Extend AbstractS3FileSystemFactory.createHadoopFileSystem to accept URI and Hadoop Configuration
> ------------------------------------------------------------------------------------------------
>
>                 Key: FLINK-11195
>                 URL: https://issues.apache.org/jira/browse/FLINK-11195
>             Project: Flink
>          Issue Type: Improvement
>          Components: FileSystem
>    Affects Versions: 1.7.0
>            Reporter: Mark Cho
>            Priority: Major
>              Labels: pull-request-available
>          Time Spent: 10m
>  Remaining Estimate: 0h
>
> Currently, `createHadoopFileSystem` method does not take any parameters.
> In order to delegate FileSystem creation to Hadoop FileSystem.get method, we need to pass URI and Hadoop Configuration to this abstract method.
> We use a custom version of PrestoS3FileSystem by plugging our FileSystemFactory similar to `flink-filesystems/flink-s3-fs-presto` project. However, we would like to delegate our FS creation to Hadoop.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)