You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Steven Zhen Wu (JIRA)" <ji...@apache.org> on 2019/01/16 18:52:00 UTC
[jira] [Commented] (FLINK-11195) Extend
AbstractS3FileSystemFactory.createHadoopFileSystem to accept URI and Hadoop
Configuration
[ https://issues.apache.org/jira/browse/FLINK-11195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16744346#comment-16744346 ]
Steven Zhen Wu commented on FLINK-11195:
----------------------------------------
[~StephanEwen] can you take a look at this Jira and PR from [~markcho]?
> Extend AbstractS3FileSystemFactory.createHadoopFileSystem to accept URI and Hadoop Configuration
> ------------------------------------------------------------------------------------------------
>
> Key: FLINK-11195
> URL: https://issues.apache.org/jira/browse/FLINK-11195
> Project: Flink
> Issue Type: Improvement
> Components: FileSystem
> Affects Versions: 1.7.0
> Reporter: Mark Cho
> Priority: Major
> Labels: pull-request-available
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Currently, `createHadoopFileSystem` method does not take any parameters.
> In order to delegate FileSystem creation to Hadoop FileSystem.get method, we need to pass URI and Hadoop Configuration to this abstract method.
> We use a custom version of PrestoS3FileSystem by plugging our FileSystemFactory similar to `flink-filesystems/flink-s3-fs-presto` project. However, we would like to delegate our FS creation to Hadoop.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)