You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kylin.apache.org by "Shengjun Zheng (Jira)" <ji...@apache.org> on 2021/08/10 08:41:00 UTC
[jira] [Commented] (KYLIN-5059) Fix error when using different HDFS
cluster in cube building
[ https://issues.apache.org/jira/browse/KYLIN-5059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17396543#comment-17396543 ]
Shengjun Zheng commented on KYLIN-5059:
---------------------------------------
When using different HDFS cluster in cube building jobs, It's not advised to get FileSystem using:
{code:java}
new FileSystem(new Configuration()){code}
It's better to use
{code:java}
path.getFileSystem(new Configuration()){code}
The FileSystem you get by first approach can only operate on namespace configured by "fs.defaultFS" in core-site.xml, which may not be the Filesystem you want for specific Path.
> Fix error when using different HDFS cluster in cube building
> ------------------------------------------------------------
>
> Key: KYLIN-5059
> URL: https://issues.apache.org/jira/browse/KYLIN-5059
> Project: Kylin
> Issue Type: New Feature
> Reporter: Shengjun Zheng
> Assignee: Shengjun Zheng
> Priority: Major
> Fix For: v4.1.0
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)