You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@flink.apache.org by "Mark Cho (JIRA)" <ji...@apache.org> on 2018/12/18 19:51:00 UTC

[jira] [Created] (FLINK-11195) Extend AbstractS3FileSystemFactory.createHadoopFileSystem to accept URI and Hadoop Configuration

Mark Cho created FLINK-11195:
--------------------------------

             Summary: Extend AbstractS3FileSystemFactory.createHadoopFileSystem to accept URI and Hadoop Configuration
                 Key: FLINK-11195
                 URL: https://issues.apache.org/jira/browse/FLINK-11195
             Project: Flink
          Issue Type: Improvement
          Components: FileSystem
    Affects Versions: 1.7.0
            Reporter: Mark Cho


Currently, `createHadoopFileSystem` method does not take any parameters.

In order to delegate FileSystem creation to Hadoop FileSystem.get method, we need to pass URI and Hadoop Configuration to this abstract method.

We use a custom version of PrestoS3FileSystem by plugging our FileSystemFactory similar to `flink-filesystems/flink-s3-fs-presto` project. However, we would like to delegate our FS creation to Hadoop.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)