You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "张超明 (Jira)" <ji...@apache.org> on 2021/02/05 09:58:00 UTC

[jira] [Created] (HUDI-1585) Reduce the coupling of hadoop.

张超明 created HUDI-1585:
-------------------------

             Summary: Reduce the coupling of hadoop.
                 Key: HUDI-1585
                 URL: https://issues.apache.org/jira/browse/HUDI-1585
             Project: Apache Hudi
          Issue Type: Improvement
          Components: Common Core, Flink Integration
            Reporter: 张超明


In my oppions, the hadoop configuration totally read from the actual environment. For example, the {{fs.hdfs.impl}} may be {{org.apache.hadoop.fs.viewfs.ViewFileSyste}} but not {{org.apache.hadoop.hdfs.DistributedFileSystem}}. Now, the implemtation was forced to be set with {{org.apache.hadoop.hdfs.DistributedFileSystem}}, which is not a graceful solution.
Also, the hadoop dependency scope level should be 'test'.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)