You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Gary Li (Jira)" <ji...@apache.org> on 2021/03/23 14:26:00 UTC
[jira] [Closed] (HUDI-1586) Reduce the coupling of hadoop.
[ https://issues.apache.org/jira/browse/HUDI-1586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Gary Li closed HUDI-1586.
-------------------------
> Reduce the coupling of hadoop.
> ------------------------------
>
> Key: HUDI-1586
> URL: https://issues.apache.org/jira/browse/HUDI-1586
> Project: Apache Hudi
> Issue Type: Improvement
> Components: Common Core, Flink Integration
> Reporter: 张超明
> Assignee: 张超明
> Priority: Major
> Labels: pull-request-available
> Fix For: 0.8.0
>
>
> In my oppions, the hadoop configuration totally read from the actual environment. For example, the {{fs.hdfs.impl}} may be {{org.apache.hadoop.fs.viewfs.ViewFileSyste}} but not {{org.apache.hadoop.hdfs.DistributedFileSystem}}. Now, the implemtation was forced to be set with {{org.apache.hadoop.hdfs.DistributedFileSystem}}, which is not a graceful solution.
> Also, the hadoop dependency scope level should be 'provided'.
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)