You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@ambari.apache.org by "Siddharth Wagle (JIRA)" <ji...@apache.org> on 2014/11/01 01:50:34 UTC

[jira] [Updated] (AMBARI-8089) 'Refresh Yarn capacity scheduler' action failed on secured HDP-2.2

     [ https://issues.apache.org/jira/browse/AMBARI-8089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Siddharth Wagle updated AMBARI-8089:
------------------------------------
    Attachment: AMBARI-8089.patch

> 'Refresh Yarn capacity scheduler' action failed on secured HDP-2.2
> ------------------------------------------------------------------
>
>                 Key: AMBARI-8089
>                 URL: https://issues.apache.org/jira/browse/AMBARI-8089
>             Project: Ambari
>          Issue Type: Bug
>          Components: ambari-server
>    Affects Versions: 1.7.0
>            Reporter: Siddharth Wagle
>            Assignee: Siddharth Wagle
>             Fix For: 1.7.0
>
>         Attachments: AMBARI-8089.patch
>
>
> On a secure cluster, run Refresh Yarn capacity scheduler service action.
> {code}
> 014-10-31 16:15:39,161 - Directory['/var/run/hadoop-yarn/yarn'] {'owner': 'yarn', 'group': 'hadoop', 'recursive': True}
> 2014-10-31 16:15:39,171 - Directory['/grid/0/log/hadoop/yarn'] {'owner': 'yarn', 'group': 'hadoop', 'recursive': True}
> 2014-10-31 16:15:39,171 - Directory['/var/run/hadoop-mapreduce/mapred'] {'owner': 'mapred', 'group': 'hadoop', 'recursive': True}
> 2014-10-31 16:15:39,172 - Directory['/var/log/hadoop-mapreduce/mapred'] {'owner': 'mapred', 'group': 'hadoop', 'recursive': True}
> 2014-10-31 16:15:39,173 - Directory['/grid/0/log/hadoop'] {'owner': 'yarn', 'ignore_failures': True, 'recursive': True}
> 2014-10-31 16:15:39,173 - Changing owner for /grid/0/log/hadoop from 0 to yarn
> 2014-10-31 16:15:39,173 - XmlConfig['core-site.xml'] {'group': 'hadoop', 'conf_dir': '/etc/hadoop/conf', 'mode': 0644, 'configuration_attributes': ..., 'owner': 'hdfs', 'configurations': ...}
> 2014-10-31 16:15:39,218 - Generating config: /etc/hadoop/conf/core-site.xml
> 2014-10-31 16:15:39,219 - File['/etc/hadoop/conf/core-site.xml'] {'owner': 'hdfs', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': 0644, 'encoding': 'UTF-8'}
> 2014-10-31 16:15:39,228 - Writing File['/etc/hadoop/conf/core-site.xml'] because contents don't match
> 2014-10-31 16:15:39,229 - XmlConfig['mapred-site.xml'] {'group': 'hadoop', 'conf_dir': '/etc/hadoop/conf', 'mode': 0644, 'configuration_attributes': ..., 'owner': 'yarn', 'configurations': ...}
> 2014-10-31 16:15:39,274 - Generating config: /etc/hadoop/conf/mapred-site.xml
> 2014-10-31 16:15:39,275 - File['/etc/hadoop/conf/mapred-site.xml'] {'owner': 'yarn', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': 0644, 'encoding': 'UTF-8'}
> 2014-10-31 16:15:39,282 - Writing File['/etc/hadoop/conf/mapred-site.xml'] because contents don't match
> 2014-10-31 16:15:39,283 - Changing owner for /etc/hadoop/conf/mapred-site.xml from 2526 to yarn
> 2014-10-31 16:15:39,283 - XmlConfig['yarn-site.xml'] {'group': 'hadoop', 'conf_dir': '/etc/hadoop/conf', 'mode': 0644, 'configuration_attributes': ..., 'owner': 'yarn', 'configurations': ...}
> 2014-10-31 16:15:39,320 - Generating config: /etc/hadoop/conf/yarn-site.xml
> 2014-10-31 16:15:39,326 - File['/etc/hadoop/conf/yarn-site.xml'] {'owner': 'yarn', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': 0644, 'encoding': 'UTF-8'}
> 2014-10-31 16:15:39,329 - Writing File['/etc/hadoop/conf/yarn-site.xml'] because contents don't match
> 2014-10-31 16:15:39,330 - XmlConfig['capacity-scheduler.xml'] {'group': 'hadoop', 'conf_dir': '/etc/hadoop/conf', 'mode': 0644, 'configuration_attributes': ..., 'owner': 'yarn', 'configurations': ...}
> 2014-10-31 16:15:39,369 - Generating config: /etc/hadoop/conf/capacity-scheduler.xml
> 2014-10-31 16:15:39,370 - File['/etc/hadoop/conf/capacity-scheduler.xml'] {'owner': 'yarn', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': 0644, 'encoding': 'UTF-8'}
> 2014-10-31 16:15:39,380 - Writing File['/etc/hadoop/conf/capacity-scheduler.xml'] because contents don't match
> 2014-10-31 16:15:39,381 - Changing owner for /etc/hadoop/conf/capacity-scheduler.xml from 2525 to yarn
> 2014-10-31 16:15:39,381 - File['/grid/0/log/hadoop/yarn/hadoop-mapreduce.jobsummary.log'] {'owner': 'yarn', 'group': 'hadoop'}
> 2014-10-31 16:15:39,382 - File['/etc/hadoop/conf/yarn.exclude'] {'owner': 'yarn', 'group': 'hadoop'}
> 2014-10-31 16:15:39,396 - File['/etc/security/limits.d/yarn.conf'] {'content': Template('yarn.conf.j2'), 'mode': 0644}
> 2014-10-31 16:15:39,411 - File['/etc/security/limits.d/mapreduce.conf'] {'content': Template('mapreduce.conf.j2'), 'mode': 0644}
> 2014-10-31 16:15:39,425 - File['/etc/hadoop/conf/yarn-env.sh'] {'content': InlineTemplate(...), 'owner': 'yarn', 'group': 'hadoop', 'mode': 0755}
> 2014-10-31 16:15:39,427 - File['/usr/hdp/current/hadoop-yarn-client/bin/container-executor'] {'group': 'hadoop', 'mode': 06050}
> 2014-10-31 16:15:39,448 - File['/etc/hadoop/conf/container-executor.cfg'] {'content': Template('container-executor.cfg.j2'), 'group': 'hadoop', 'mode': 0644}
> 2014-10-31 16:15:39,461 - File['/etc/hadoop/conf/mapred-env.sh'] {'content': InlineTemplate(...), 'owner': 'root'}
> 2014-10-31 16:15:39,486 - File['/usr/hdp/current/hadoop-client/sbin/task-controller'] {'owner': 'root', 'group': 'hadoop', 'mode': 06050}
> 2014-10-31 16:15:39,504 - File['/etc/hadoop/conf/taskcontroller.cfg'] {'content': Template('taskcontroller.cfg.j2'), 'owner': 'root', 'group': 'hadoop', 'mode': 0644}
> 2014-10-31 16:15:39,520 - XmlConfig['mapred-site.xml'] {'owner': 'mapred', 'group': 'hadoop', 'conf_dir': '/etc/hadoop/conf', 'configuration_attributes': ..., 'configurations': ...}
> 2014-10-31 16:15:39,554 - Generating config: /etc/hadoop/conf/mapred-site.xml
> 2014-10-31 16:15:39,555 - File['/etc/hadoop/conf/mapred-site.xml'] {'owner': 'mapred', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': None, 'encoding': 'UTF-8'}
> 2014-10-31 16:15:39,557 - Changing owner for /etc/hadoop/conf/mapred-site.xml from 2528 to mapred
> 2014-10-31 16:15:39,557 - XmlConfig['capacity-scheduler.xml'] {'owner': 'hdfs', 'group': 'hadoop', 'conf_dir': '/etc/hadoop/conf', 'configuration_attributes': ..., 'configurations': ...}
> 2014-10-31 16:15:39,594 - Generating config: /etc/hadoop/conf/capacity-scheduler.xml
> 2014-10-31 16:15:39,595 - File['/etc/hadoop/conf/capacity-scheduler.xml'] {'owner': 'hdfs', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': None, 'encoding': 'UTF-8'}
> 2014-10-31 16:15:39,596 - Changing owner for /etc/hadoop/conf/capacity-scheduler.xml from 2528 to hdfs
> 2014-10-31 16:15:39,600 - Execute['export HADOOP_LIBEXEC_DIR=/usr/hdp/current/hadoop-client/libexec && /usr/hdp/current/hadoop-yarn-client/bin/yarn rmadmin -refreshQueues'] {'user': 'yarn'}
> 2014-10-31 16:15:46,621 - Error while executing command 'refreshqueues':
> Traceback (most recent call last):
>   File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 122, in execute
>     method(env)
>   File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/services/YARN/package/scripts/resourcemanager.py", line 72, in refreshqueues
>     action='refreshQueues'
>   File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/services/YARN/package/scripts/service.py", line 74, in service
>     user=usr,
>   File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 148, in __init__
>     self.env.run()
>   File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 149, in run
>     self.run_action(resource, action)
>   File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 115, in run_action
>     provider_action()
>   File "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py", line 241, in action_run
>     raise ex
> Fail: Execution of 'export HADOOP_LIBEXEC_DIR=/usr/hdp/current/hadoop-client/libexec && /usr/hdp/current/hadoop-yarn-client/bin/yarn rmadmin -refreshQueues' returned 255. 14/10/31 16:15:44 INFO client.RMProxy: Connecting to ResourceManager at ip-172-31-37-201.ec2.internal/172.31.37.201:8141
> 14/10/31 16:15:46 WARN ipc.Client: Exception encountered while connecting to the server : javax.security.sasl.SaslException: GSS initiate failed [Caused by GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos tgt)]
> refreshQueues: Failed on local exception: java.io.IOException: javax.security.sasl.SaslException: GSS initiate failed [Caused by GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos tgt)]; Host Details : local host is: "ip-172-31-37-201/172.31.37.201"; destination host is: "ip-172-31-37-201.ec2.internal":8141;
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)