[jira] [Commented] (TEZ-1538) Tez Local Mode fails if "fs.defaultFS" is not set to be "file:///' in core-site.xml

["Siddharth Seth (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/TEZ-1538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14120555#comment-14120555 ] 

Siddharth Seth commented on TEZ-1538:
-------------------------------------

[~airbots] - is this related to TEZ-1348 ?

If I understand this correctly, setting fs.defaultFS in tez-site does not have affect ?

Also, what fails in local mode ? the individual Inputs / Outputs need to have this config set - and this change will not impact them.



> Tez Local Mode fails if "fs.defaultFS" is not set to be "file:///' in core-site.xml 
> ------------------------------------------------------------------------------------
>
>                 Key: TEZ-1538
>                 URL: https://issues.apache.org/jira/browse/TEZ-1538
>             Project: Apache Tez
>          Issue Type: Sub-task
>    Affects Versions: 0.5.0
>            Reporter: Chen He
>         Attachments: TEZ-1538.patch
>
>
> When users submit their DAG, TezClient will create a submission context. It
> also create a tez-conf.pb file in staging directory. Once DAGAppMaster starts,
> it reads user's configuration from tez-conf.pb file. However, tez-conf.pb file
> is created by TezClientUtils.createFinalTezConfForApp() which will filter
> configurations that are not starting with "tez.". 
> Then "fs.defaultFS" will be filtered even user sets it in tez-site.xml and user source code. And DAGAppMaster can not pick this configuration from tez-conf.pb file. Then it always contacts localhost:8020 and fails.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)