You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "张超明 (Jira)" <ji...@apache.org> on 2021/02/05 10:52:00 UTC
[jira] [Updated] (HUDI-1586) Reduce the coupling of hadoop.
[ https://issues.apache.org/jira/browse/HUDI-1586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
张超明 updated HUDI-1586:
----------------------
Description:
In my oppions, the hadoop configuration totally read from the actual environment. For example, the {{fs.hdfs.impl}} may be {{org.apache.hadoop.fs.viewfs.ViewFileSyste}} but not {{org.apache.hadoop.hdfs.DistributedFileSystem}}. Now, the implemtation was forced to be set with {{org.apache.hadoop.hdfs.DistributedFileSystem}}, which is not a graceful solution.
Also, the hadoop dependency scope level should be 'test'.
was:
In my oppions, the hadoop configuration totally read from the actual environment. For example, the {{fs.hdfs.impl}} may be {{org.apache.hadoop.fs.viewfs.ViewFileSyste}} but not {{org.apache.hadoop.hdfs.DistributedFileSystem}}. Now, the implemtation was forced to be set with {{org.apache.hadoop.hdfs.DistributedFileSystem}}, which is not a graceful solution.
Also, the hadoop dependency scope level should be 'test'.
> Reduce the coupling of hadoop.
> ------------------------------
>
> Key: HUDI-1586
> URL: https://issues.apache.org/jira/browse/HUDI-1586
> Project: Apache Hudi
> Issue Type: Improvement
> Components: Common Core, Flink Integration
> Reporter: 张超明
> Priority: Major
>
> In my oppions, the hadoop configuration totally read from the actual environment. For example, the {{fs.hdfs.impl}} may be {{org.apache.hadoop.fs.viewfs.ViewFileSyste}} but not {{org.apache.hadoop.hdfs.DistributedFileSystem}}. Now, the implemtation was forced to be set with {{org.apache.hadoop.hdfs.DistributedFileSystem}}, which is not a graceful solution.
> Also, the hadoop dependency scope level should be 'test'.
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)