You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Gary Li (Jira)" <ji...@apache.org> on 2021/02/21 03:58:00 UTC

[jira] [Commented] (HUDI-1586) Reduce the coupling of hadoop.

    [ https://issues.apache.org/jira/browse/HUDI-1586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17287845#comment-17287845 ] 

Gary Li commented on HUDI-1586:
-------------------------------

[~ZhangChaoming] thanks for your contribution, please feel free to email the mailing list to get the contributor access, then you can assign ticket to yourself. resolving this ticket for now.

> Reduce the coupling of hadoop.
> ------------------------------
>
>                 Key: HUDI-1586
>                 URL: https://issues.apache.org/jira/browse/HUDI-1586
>             Project: Apache Hudi
>          Issue Type: Improvement
>          Components: Common Core, Flink Integration
>            Reporter: 张超明
>            Priority: Major
>              Labels: pull-request-available
>
> In my oppions, the hadoop configuration totally read from the actual environment. For example, the {{fs.hdfs.impl}} may be {{org.apache.hadoop.fs.viewfs.ViewFileSyste}} but not {{org.apache.hadoop.hdfs.DistributedFileSystem}}. Now, the implemtation was forced to be set with {{org.apache.hadoop.hdfs.DistributedFileSystem}}, which is not a graceful solution.
> Also, the hadoop dependency scope level should be 'provided'.
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)