You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-dev@hadoop.apache.org by "Xianyin Xin (JIRA)" <ji...@apache.org> on 2016/06/30 12:52:10 UTC
[jira] [Created] (YARN-5302) Yarn Application log Aggreagation
fails due to NM can not get correct HDFS delegation token II
Xianyin Xin created YARN-5302:
---------------------------------
Summary: Yarn Application log Aggreagation fails due to NM can not get correct HDFS delegation token II
Key: YARN-5302
URL: https://issues.apache.org/jira/browse/YARN-5302
Project: Hadoop YARN
Issue Type: Bug
Components: yarn
Reporter: Xianyin Xin
Different with YARN-5089, this happens at NM side. When NM recovers, credentials are read from NMStateStore. When initialize app aggregators, exception happens because of the overdue tokens.
{code:title=LogAggregationService.java}
protected void initAppAggregator(final ApplicationId appId, String user,
Credentials credentials, ContainerLogsRetentionPolicy logRetentionPolicy,
Map<ApplicationAccessType, String> appAcls,
LogAggregationContext logAggregationContext) {
// Get user's FileSystem credentials
final UserGroupInformation userUgi =
UserGroupInformation.createRemoteUser(user);
if (credentials != null) {
userUgi.addCredentials(credentials);
}
...
try {
// Create the app dir
createAppDir(user, appId, userUgi);
} catch (Exception e) {
appLogAggregator.disableLogAggregation();
if (!(e instanceof YarnRuntimeException)) {
appDirException = new YarnRuntimeException(e);
} else {
appDirException = (YarnRuntimeException)e;
}
appLogAggregators.remove(appId);
closeFileSystems(userUgi);
throw appDirException;
}
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org