You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "stefanlee (JIRA)" <ji...@apache.org> on 2017/05/03 09:00:13 UTC
[jira] [Comment Edited] (YARN-3269)
Yarn.nodemanager.remote-app-log-dir could not be configured to fully
qualified path
[ https://issues.apache.org/jira/browse/YARN-3269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15994501#comment-15994501 ]
stefanlee edited comment on YARN-3269 at 5/3/17 8:59 AM:
---------------------------------------------------------
thanks for this jira, but when we do not config *yarn.nodemanager.remote-app-log-dir*, it will be */tmp/logs* and NM or mr historyserver will check */tmp/logs* 's scheme when write log to HDFS or read log from HDFS,then they will throw exception of {{No AbstractFileSystem for scheme: null}} in class *AbstractFileSystem.java* ,so i suggest that when *yarn.nodemanager.remote-app-log-dir* is default value(scheme is null ), we still use *FileContext.getFileContext(conf)* in *AggregatedLogFormat.java*, else we can use *FileContext.getFileContext(remoteAppLogFile.toUri(), conf)* , am i wrong with this question? my hadoop version is 2.4.0 [~xgong] [~zhz]
was (Author: imstefanlee):
thanks for this jira, but when we do not config *yarn.nodemanager.remote-app-log-dir*, it will be */tmp/logs* and NM or mr historyserver will check */tmp/logs* 's scheme when write log to HDFS or read log from HDFS,then they will throw exception of {{No AbstractFileSystem for scheme: null}} in class *AbstractFileSystem.java* ,so i suggest that when *yarn.nodemanager.remote-app-log-dir* is default value(scheme is null ), we still use *FileContext.getFileContext(conf)* in *AggregatedLogFormat.java*, else we can use *FileContext.getFileContext(remoteAppLogFile.toUri(), conf)* , am i wrong with this question? [~xgong] [~zhz]
> Yarn.nodemanager.remote-app-log-dir could not be configured to fully qualified path
> -----------------------------------------------------------------------------------
>
> Key: YARN-3269
> URL: https://issues.apache.org/jira/browse/YARN-3269
> Project: Hadoop YARN
> Issue Type: Bug
> Reporter: Xuan Gong
> Assignee: Xuan Gong
> Fix For: 2.8.0, 2.7.4, 3.0.0-alpha1
>
> Attachments: YARN-3269.1.patch, YARN-3269.2.patch
>
>
> Log aggregation currently is always relative to the default file system, not an arbitrary file system identified by URI. So we can't put an arbitrary fully-qualified URI into yarn.nodemanager.remote-app-log-dir.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org