[jira] [Created] (FLINK-9525) Missing META-INF/services/*FileSystemFactory in flink-hadoop-fs module

["Hai Zhou (JIRA)" <ji...@apache.org>]

Hai Zhou created FLINK-9525:
-------------------------------

             Summary: Missing META-INF/services/*FileSystemFactory in flink-hadoop-fs module
                 Key: FLINK-9525
                 URL: https://issues.apache.org/jira/browse/FLINK-9525
             Project: Flink
          Issue Type: Bug
          Components: FileSystem
    Affects Versions: 1.5.0, 1.4.0
            Reporter: Hai Zhou
            Assignee: Hai Zhou
             Fix For: 1.5.1
         Attachments: WX20180605-142414@2x.png

if flink job dependencies includes `hadoop-common` and `hadoop-hdfs`, throw runtime error.
like this case: [https://stackoverflow.com/questions/47890596/java-util-serviceconfigurationerror-org-apache-hadoop-fs-filesystem-provider-o].

the root cause: 
see  {{org.apache.flink.core.fs.FileSystem}}
This class will load all available file system factories via {{ServiceLoader.load(FileSystemFactory.class)}}. 
Because  {{META-INF / services / org.apache.flink.core.fs.FileSystemFactory}} file in the classpath does not have an `org.apache.flink.runtime.fs.hdfs.HadoopFsFactory`, 
so just only loaded one available {{LocalFileSystemFactory}} .

more error messages see this screenshot.









--
This message was sent by Atlassian JIRA
(v7.6.3#76005)