You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Moses (Jira)" <ji...@apache.org> on 2021/11/12 03:17:00 UTC

[jira] [Closed] (HUDI-1585) Reduce the coupling of hadoop.

     [ https://issues.apache.org/jira/browse/HUDI-1585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Moses closed HUDI-1585.
-----------------------
    Resolution: Fixed

> Reduce the coupling of hadoop.
> ------------------------------
>
>                 Key: HUDI-1585
>                 URL: https://issues.apache.org/jira/browse/HUDI-1585
>             Project: Apache Hudi
>          Issue Type: Improvement
>          Components: Common Core, Flink Integration
>            Reporter: Moses
>            Priority: Major
>
> In my oppions, the hadoop configuration totally read from the actual environment. For example, the {{fs.hdfs.impl}} may be {{org.apache.hadoop.fs.viewfs.ViewFileSyste}} but not {{org.apache.hadoop.hdfs.DistributedFileSystem}}. Now, the implemtation was forced to be set with {{org.apache.hadoop.hdfs.DistributedFileSystem}}, which is not a graceful solution.
> Also, the hadoop dependency scope level should be 'test'.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)