You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@ambari.apache.org by Andrew Onischuk <ao...@hortonworks.com> on 2014/05/19 12:19:02 UTC
Review Request 21627: ATS start failed with custom usernames
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/21627/
-----------------------------------------------------------
Review request for Ambari and Vitalyi Brodetskyi.
Bugs: AMBARI-5804
https://issues.apache.org/jira/browse/AMBARI-5804
Repository: ambari
Description
-------
**STR:**
1\. Install, setup and start Ambari server by default.
2\. On "Customize Services" page enter custom names for all users with
confirmation on popup modal window about depending properties.
3\. Deploy cluster.
**Excepted result:**
deploy finished successfully without any warnings.
**Actual result:**
deploy failed due to ATS start failure. Console output:
stderr:
2014-05-16 12:48:46,413 - Error while executing command 'start':
Traceback (most recent call last):
File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 105, in execute
method(env)
File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/services/YARN/package/scripts/application_timeline_server.py", line 43, in start
service('historyserver', action='start')
File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/services/YARN/package/scripts/service.py", line 52, in service
initial_wait=5
File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 148, in __init__
self.env.run()
File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 149, in run
self.run_action(resource, action)
File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 115, in run_action
provider_action()
File "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py", line 239, in action_run
raise ex
Fail: Execution of 'ls /var/run/hadoop-yarn/custom-yarn/yarn-custom-yarn-historyserver.pid >/dev/null 2>&1 && ps `cat /var/run/hadoop-yarn/custom-yarn/yarn-custom-yarn-historyserver.pid` >/dev/null 2>&1' returned 1.
stdout:
2014-05-16 12:48:39,733 - Execute['/bin/echo 0 > /selinux/enforce'] {'only_if': 'test -f /selinux/enforce'}
2014-05-16 12:48:39,756 - Skipping Execute['/bin/echo 0 > /selinux/enforce'] due to only_if
2014-05-16 12:48:39,758 - Execute['mkdir -p /usr/lib/hadoop/lib/native/Linux-i386-32; ln -sf /usr/lib/libsnappy.so /usr/lib/hadoop/lib/native/Linux-i386-32/libsnappy.so'] {}
2014-05-16 12:48:39,780 - Execute['mkdir -p /usr/lib/hadoop/lib/native/Linux-amd64-64; ln -sf /usr/lib64/libsnappy.so /usr/lib/hadoop/lib/native/Linux-amd64-64/libsnappy.so'] {}
2014-05-16 12:48:39,796 - Directory['/etc/hadoop/conf'] {'owner': 'root', 'group': 'root', 'recursive': True}
2014-05-16 12:48:39,797 - Directory['/grid/0/log/hadoop'] {'owner': 'root', 'group': 'root', 'recursive': True}
2014-05-16 12:48:39,797 - Directory['/var/run/hadoop'] {'owner': 'root', 'group': 'root', 'recursive': True}
2014-05-16 12:48:39,798 - Directory['/tmp'] {'owner': 'custom-hdfs', 'recursive': True}
2014-05-16 12:48:39,817 - File['/etc/hadoop/conf/hadoop-env.sh'] {'content': Template('hadoop-env.sh.j2'), 'owner': 'custom-hdfs'}
2014-05-16 12:48:39,820 - File['/etc/hadoop/conf/commons-logging.properties'] {'content': Template('commons-logging.properties.j2'), 'owner': 'custom-hdfs'}
2014-05-16 12:48:39,823 - File['/etc/hadoop/conf/health_check'] {'content': Template('health_check-v2.j2'), 'owner': 'custom-hdfs'}
2014-05-16 12:48:39,823 - File['/etc/hadoop/conf/log4j.properties'] {'content': '...', 'owner': 'custom-hdfs', 'group': 'custom-hadoop', 'mode': 0644}
2014-05-16 12:48:39,831 - File['/etc/hadoop/conf/hadoop-metrics2.properties'] {'content': Template('hadoop-metrics2.properties.j2'), 'owner': 'custom-hdfs'}
2014-05-16 12:48:39,832 - XmlConfig['core-site.xml'] {'owner': 'custom-hdfs', 'group': 'custom-hadoop', 'conf_dir': '/etc/hadoop/conf', 'configurations': ...}
2014-05-16 12:48:39,840 - Generating config: /etc/hadoop/conf/core-site.xml
2014-05-16 12:48:39,841 - File['/etc/hadoop/conf/core-site.xml'] {'owner': 'custom-hdfs', 'content': InlineTemplate(...), 'group': 'custom-hadoop', 'mode': None}
2014-05-16 12:48:39,843 - Writing File['/etc/hadoop/conf/core-site.xml'] because contents don't match
2014-05-16 12:48:39,844 - File['/etc/hadoop/conf/task-log4j.properties'] {'content': StaticFile('task-log4j.properties'), 'mode': 0755}
2014-05-16 12:48:39,844 - File['/etc/hadoop/conf/configuration.xsl'] {'owner': 'custom-hdfs', 'group': 'custom-hadoop'}
2014-05-16 12:48:39,848 - File['/etc/snmp/snmpd.conf'] {'content': Template('snmpd.conf.j2')}
2014-05-16 12:48:39,849 - Execute['service snmpd start'] {}
2014-05-16 12:48:39,886 - Execute['chkconfig snmpd on'] {}
2014-05-16 12:48:40,118 - Directory['/var/run/hadoop-yarn/custom-yarn'] {'owner': 'custom-yarn', 'group': 'custom-hadoop', 'recursive': True}
2014-05-16 12:48:40,120 - Directory['/grid/0/log/hadoop/custom-yarn'] {'owner': 'custom-yarn', 'group': 'custom-hadoop', 'recursive': True}
2014-05-16 12:48:40,121 - Directory['/var/run/hadoop-mapreduce/custom-mr'] {'owner': 'custom-mr', 'group': 'custom-hadoop', 'recursive': True}
2014-05-16 12:48:40,121 - Directory['/var/log/hadoop-mapreduce/custom-mr'] {'owner': 'custom-mr', 'group': 'custom-hadoop', 'recursive': True}
2014-05-16 12:48:40,122 - Directory['/hadoop/yarn/local'] {'owner': 'custom-yarn', 'ignore_failures': True, 'recursive': True}
2014-05-16 12:48:40,122 - Directory['/hadoop/yarn/log'] {'owner': 'custom-yarn', 'ignore_failures': True, 'recursive': True}
2014-05-16 12:48:40,122 - Directory['/grid/0/log/hadoop'] {'owner': 'custom-yarn', 'ignore_failures': True, 'recursive': True}
2014-05-16 12:48:40,123 - Changing owner for /grid/0/log/hadoop from 0 to custom-yarn
2014-05-16 12:48:40,123 - XmlConfig['core-site.xml'] {'owner': 'custom-hdfs', 'group': 'custom-hadoop', 'mode': 0644, 'conf_dir': '/etc/hadoop/conf', 'configurations': ...}
2014-05-16 12:48:40,137 - Generating config: /etc/hadoop/conf/core-site.xml
2014-05-16 12:48:40,137 - File['/etc/hadoop/conf/core-site.xml'] {'owner': 'custom-hdfs', 'content': InlineTemplate(...), 'group': 'custom-hadoop', 'mode': 0644}
2014-05-16 12:48:40,138 - Writing File['/etc/hadoop/conf/core-site.xml'] because contents don't match
2014-05-16 12:48:40,139 - XmlConfig['mapred-site.xml'] {'owner': 'custom-yarn', 'group': 'custom-hadoop', 'mode': 0644, 'conf_dir': '/etc/hadoop/conf', 'configurations': ...}
2014-05-16 12:48:40,146 - Generating config: /etc/hadoop/conf/mapred-site.xml
2014-05-16 12:48:40,146 - File['/etc/hadoop/conf/mapred-site.xml'] {'owner': 'custom-yarn', 'content': InlineTemplate(...), 'group': 'custom-hadoop', 'mode': 0644}
2014-05-16 12:48:40,148 - Writing File['/etc/hadoop/conf/mapred-site.xml'] because contents don't match
2014-05-16 12:48:40,148 - Changing owner for /etc/hadoop/conf/mapred-site.xml from 1010 to custom-yarn
2014-05-16 12:48:40,148 - XmlConfig['yarn-site.xml'] {'owner': 'custom-yarn', 'group': 'custom-hadoop', 'mode': 0644, 'conf_dir': '/etc/hadoop/conf', 'configurations': ...}
2014-05-16 12:48:40,155 - Generating config: /etc/hadoop/conf/yarn-site.xml
2014-05-16 12:48:40,155 - File['/etc/hadoop/conf/yarn-site.xml'] {'owner': 'custom-yarn', 'content': InlineTemplate(...), 'group': 'custom-hadoop', 'mode': 0644}
2014-05-16 12:48:40,157 - Writing File['/etc/hadoop/conf/yarn-site.xml'] because contents don't match
2014-05-16 12:48:40,157 - XmlConfig['capacity-scheduler.xml'] {'owner': 'custom-yarn', 'group': 'custom-hadoop', 'mode': 0644, 'conf_dir': '/etc/hadoop/conf', 'configurations': ...}
2014-05-16 12:48:40,165 - Generating config: /etc/hadoop/conf/capacity-scheduler.xml
2014-05-16 12:48:40,165 - File['/etc/hadoop/conf/capacity-scheduler.xml'] {'owner': 'custom-yarn', 'content': InlineTemplate(...), 'group': 'custom-hadoop', 'mode': 0644}
2014-05-16 12:48:40,166 - Writing File['/etc/hadoop/conf/capacity-scheduler.xml'] because contents don't match
2014-05-16 12:48:40,167 - Changing owner for /etc/hadoop/conf/capacity-scheduler.xml from 1009 to custom-yarn
2014-05-16 12:48:40,167 - File['/etc/hadoop/conf/yarn.exclude'] {'owner': 'custom-yarn', 'group': 'custom-hadoop'}
2014-05-16 12:48:40,173 - File['/etc/security/limits.d/yarn.conf'] {'content': Template('yarn.conf.j2'), 'mode': 0644}
2014-05-16 12:48:40,178 - File['/etc/security/limits.d/mapreduce.conf'] {'content': Template('mapreduce.conf.j2'), 'mode': 0644}
2014-05-16 12:48:40,187 - File['/etc/hadoop/conf/yarn-env.sh'] {'content': Template('yarn-env.sh.j2'), 'owner': 'custom-yarn', 'group': 'custom-hadoop', 'mode': 0755}
2014-05-16 12:48:40,190 - File['/etc/hadoop/conf/mapred-env.sh'] {'content': Template('mapred-env.sh.j2'), 'owner': 'custom-hdfs'}
2014-05-16 12:48:40,194 - File['/etc/hadoop/conf/taskcontroller.cfg'] {'content': Template('taskcontroller.cfg.j2'), 'owner': 'custom-hdfs'}
2014-05-16 12:48:40,195 - XmlConfig['mapred-site.xml'] {'owner': 'custom-mr', 'group': 'custom-hadoop', 'conf_dir': '/etc/hadoop/conf', 'configurations': ...}
2014-05-16 12:48:40,202 - Generating config: /etc/hadoop/conf/mapred-site.xml
2014-05-16 12:48:40,203 - File['/etc/hadoop/conf/mapred-site.xml'] {'owner': 'custom-mr', 'content': InlineTemplate(...), 'group': 'custom-hadoop', 'mode': None}
2014-05-16 12:48:40,204 - Changing owner for /etc/hadoop/conf/mapred-site.xml from 1007 to custom-mr
2014-05-16 12:48:40,204 - XmlConfig['capacity-scheduler.xml'] {'owner': 'custom-hdfs', 'group': 'custom-hadoop', 'conf_dir': '/etc/hadoop/conf', 'configurations': ...}
2014-05-16 12:48:40,211 - Generating config: /etc/hadoop/conf/capacity-scheduler.xml
2014-05-16 12:48:40,212 - File['/etc/hadoop/conf/capacity-scheduler.xml'] {'owner': 'custom-hdfs', 'content': InlineTemplate(...), 'group': 'custom-hadoop', 'mode': None}
2014-05-16 12:48:40,213 - Changing owner for /etc/hadoop/conf/capacity-scheduler.xml from 1007 to custom-hdfs
2014-05-16 12:48:40,213 - File['/etc/hadoop/conf/ssl-client.xml.example'] {'owner': 'custom-mr', 'group': 'custom-hadoop'}
2014-05-16 12:48:40,213 - File['/etc/hadoop/conf/ssl-server.xml.example'] {'owner': 'custom-mr', 'group': 'custom-hadoop'}
2014-05-16 12:48:40,215 - Execute['export HADOOP_LIBEXEC_DIR=/usr/lib/hadoop/libexec && /usr/lib/hadoop-yarn/sbin/yarn-daemon.sh --config /etc/hadoop/conf start historyserver'] {'not_if': 'ls /var/run/hadoop-yarn/custom-yarn/yarn-custom-yarn-historyserver.pid >/dev/null 2>&1 && ps `cat /var/run/hadoop-yarn/custom-yarn/yarn-custom-yarn-historyserver.pid` >/dev/null 2>&1', 'user': 'custom-yarn'}
2014-05-16 12:48:41,336 - Execute['ls /var/run/hadoop-yarn/custom-yarn/yarn-custom-yarn-historyserver.pid >/dev/null 2>&1 && ps `cat /var/run/hadoop-yarn/custom-yarn/yarn-custom-yarn-historyserver.pid` >/dev/null 2>&1'] {'initial_wait': 5, 'not_if': 'ls /var/run/hadoop-yarn/custom-yarn/yarn-custom-yarn-historyserver.pid >/dev/null 2>&1 && ps `cat /var/run/hadoop-yarn/custom-yarn/yarn-custom-yarn-historyserver.pid` >/dev/null 2>&1', 'user': 'custom-yarn'}
2014-05-16 12:48:46,413 - Error while executing command 'start':
Traceback (most recent call last):
File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 105, in execute
method(env)
File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/services/YARN/package/scripts/application_timeline_server.py", line 43, in start
service('historyserver', action='start')
File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/services/YARN/package/scripts/service.py", line 52, in service
initial_wait=5
File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 148, in __init__
self.env.run()
File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 149, in run
self.run_action(resource, action)
File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 115, in run_action
provider_action()
File "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py", line 239, in action_run
raise ex
Fail: Execution of 'ls /var/run/hadoop-yarn/custom-yarn/yarn-custom-yarn-historyserver.pid >/dev/null 2>&1 && ps `cat /var/run/hadoop-yarn/custom-yarn/yarn-custom-yarn-historyserver.pid` >/dev/null 2>&1' returned 1.
Diffs
-----
ambari-server/src/main/resources/stacks/HDP/2.0.6/services/YARN/package/scripts/application_timeline_server.py 0719da8
ambari-server/src/main/resources/stacks/HDP/2.0.6/services/YARN/package/scripts/params.py c34a536
ambari-server/src/main/resources/stacks/HDP/2.0.6/services/YARN/package/scripts/yarn.py a09a6d6
ambari-server/src/test/python/stacks/2.0.6/configs/default.json 3f5220e
ambari-server/src/test/python/stacks/2.0.6/configs/secured.json 12de853
ambari-server/src/test/python/stacks/2.1/YARN/test_apptimelineserver.py fc0559d
ambari-server/src/test/python/stacks/2.1/configs/default.json fdac02a
ambari-server/src/test/python/stacks/2.1/configs/secured.json 8e76ef5
Diff: https://reviews.apache.org/r/21627/diff/
Testing
-------
mvn clean test
Thanks,
Andrew Onischuk
Re: Review Request 21627: ATS start failed with custom usernames
Posted by Vitalyi Brodetskyi <vb...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/21627/#review43379
-----------------------------------------------------------
Ship it!
Ship It!
- Vitalyi Brodetskyi
On May 19, 2014, 10:18 a.m., Andrew Onischuk wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/21627/
> -----------------------------------------------------------
>
> (Updated May 19, 2014, 10:18 a.m.)
>
>
> Review request for Ambari and Vitalyi Brodetskyi.
>
>
> Bugs: AMBARI-5804
> https://issues.apache.org/jira/browse/AMBARI-5804
>
>
> Repository: ambari
>
>
> Description
> -------
>
> **STR:**
> 1\. Install, setup and start Ambari server by default.
> 2\. On "Customize Services" page enter custom names for all users with
> confirmation on popup modal window about depending properties.
> 3\. Deploy cluster.
>
> **Excepted result:**
> deploy finished successfully without any warnings.
>
> **Actual result:**
> deploy failed due to ATS start failure. Console output:
>
>
>
> stderr:
> 2014-05-16 12:48:46,413 - Error while executing command 'start':
> Traceback (most recent call last):
> File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 105, in execute
> method(env)
> File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/services/YARN/package/scripts/application_timeline_server.py", line 43, in start
> service('historyserver', action='start')
> File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/services/YARN/package/scripts/service.py", line 52, in service
> initial_wait=5
> File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 148, in __init__
> self.env.run()
> File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 149, in run
> self.run_action(resource, action)
> File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 115, in run_action
> provider_action()
> File "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py", line 239, in action_run
> raise ex
> Fail: Execution of 'ls /var/run/hadoop-yarn/custom-yarn/yarn-custom-yarn-historyserver.pid >/dev/null 2>&1 && ps `cat /var/run/hadoop-yarn/custom-yarn/yarn-custom-yarn-historyserver.pid` >/dev/null 2>&1' returned 1.
> stdout:
> 2014-05-16 12:48:39,733 - Execute['/bin/echo 0 > /selinux/enforce'] {'only_if': 'test -f /selinux/enforce'}
> 2014-05-16 12:48:39,756 - Skipping Execute['/bin/echo 0 > /selinux/enforce'] due to only_if
> 2014-05-16 12:48:39,758 - Execute['mkdir -p /usr/lib/hadoop/lib/native/Linux-i386-32; ln -sf /usr/lib/libsnappy.so /usr/lib/hadoop/lib/native/Linux-i386-32/libsnappy.so'] {}
> 2014-05-16 12:48:39,780 - Execute['mkdir -p /usr/lib/hadoop/lib/native/Linux-amd64-64; ln -sf /usr/lib64/libsnappy.so /usr/lib/hadoop/lib/native/Linux-amd64-64/libsnappy.so'] {}
> 2014-05-16 12:48:39,796 - Directory['/etc/hadoop/conf'] {'owner': 'root', 'group': 'root', 'recursive': True}
> 2014-05-16 12:48:39,797 - Directory['/grid/0/log/hadoop'] {'owner': 'root', 'group': 'root', 'recursive': True}
> 2014-05-16 12:48:39,797 - Directory['/var/run/hadoop'] {'owner': 'root', 'group': 'root', 'recursive': True}
> 2014-05-16 12:48:39,798 - Directory['/tmp'] {'owner': 'custom-hdfs', 'recursive': True}
> 2014-05-16 12:48:39,817 - File['/etc/hadoop/conf/hadoop-env.sh'] {'content': Template('hadoop-env.sh.j2'), 'owner': 'custom-hdfs'}
> 2014-05-16 12:48:39,820 - File['/etc/hadoop/conf/commons-logging.properties'] {'content': Template('commons-logging.properties.j2'), 'owner': 'custom-hdfs'}
> 2014-05-16 12:48:39,823 - File['/etc/hadoop/conf/health_check'] {'content': Template('health_check-v2.j2'), 'owner': 'custom-hdfs'}
> 2014-05-16 12:48:39,823 - File['/etc/hadoop/conf/log4j.properties'] {'content': '...', 'owner': 'custom-hdfs', 'group': 'custom-hadoop', 'mode': 0644}
> 2014-05-16 12:48:39,831 - File['/etc/hadoop/conf/hadoop-metrics2.properties'] {'content': Template('hadoop-metrics2.properties.j2'), 'owner': 'custom-hdfs'}
> 2014-05-16 12:48:39,832 - XmlConfig['core-site.xml'] {'owner': 'custom-hdfs', 'group': 'custom-hadoop', 'conf_dir': '/etc/hadoop/conf', 'configurations': ...}
> 2014-05-16 12:48:39,840 - Generating config: /etc/hadoop/conf/core-site.xml
> 2014-05-16 12:48:39,841 - File['/etc/hadoop/conf/core-site.xml'] {'owner': 'custom-hdfs', 'content': InlineTemplate(...), 'group': 'custom-hadoop', 'mode': None}
> 2014-05-16 12:48:39,843 - Writing File['/etc/hadoop/conf/core-site.xml'] because contents don't match
> 2014-05-16 12:48:39,844 - File['/etc/hadoop/conf/task-log4j.properties'] {'content': StaticFile('task-log4j.properties'), 'mode': 0755}
> 2014-05-16 12:48:39,844 - File['/etc/hadoop/conf/configuration.xsl'] {'owner': 'custom-hdfs', 'group': 'custom-hadoop'}
> 2014-05-16 12:48:39,848 - File['/etc/snmp/snmpd.conf'] {'content': Template('snmpd.conf.j2')}
> 2014-05-16 12:48:39,849 - Execute['service snmpd start'] {}
> 2014-05-16 12:48:39,886 - Execute['chkconfig snmpd on'] {}
> 2014-05-16 12:48:40,118 - Directory['/var/run/hadoop-yarn/custom-yarn'] {'owner': 'custom-yarn', 'group': 'custom-hadoop', 'recursive': True}
> 2014-05-16 12:48:40,120 - Directory['/grid/0/log/hadoop/custom-yarn'] {'owner': 'custom-yarn', 'group': 'custom-hadoop', 'recursive': True}
> 2014-05-16 12:48:40,121 - Directory['/var/run/hadoop-mapreduce/custom-mr'] {'owner': 'custom-mr', 'group': 'custom-hadoop', 'recursive': True}
> 2014-05-16 12:48:40,121 - Directory['/var/log/hadoop-mapreduce/custom-mr'] {'owner': 'custom-mr', 'group': 'custom-hadoop', 'recursive': True}
> 2014-05-16 12:48:40,122 - Directory['/hadoop/yarn/local'] {'owner': 'custom-yarn', 'ignore_failures': True, 'recursive': True}
> 2014-05-16 12:48:40,122 - Directory['/hadoop/yarn/log'] {'owner': 'custom-yarn', 'ignore_failures': True, 'recursive': True}
> 2014-05-16 12:48:40,122 - Directory['/grid/0/log/hadoop'] {'owner': 'custom-yarn', 'ignore_failures': True, 'recursive': True}
> 2014-05-16 12:48:40,123 - Changing owner for /grid/0/log/hadoop from 0 to custom-yarn
> 2014-05-16 12:48:40,123 - XmlConfig['core-site.xml'] {'owner': 'custom-hdfs', 'group': 'custom-hadoop', 'mode': 0644, 'conf_dir': '/etc/hadoop/conf', 'configurations': ...}
> 2014-05-16 12:48:40,137 - Generating config: /etc/hadoop/conf/core-site.xml
> 2014-05-16 12:48:40,137 - File['/etc/hadoop/conf/core-site.xml'] {'owner': 'custom-hdfs', 'content': InlineTemplate(...), 'group': 'custom-hadoop', 'mode': 0644}
> 2014-05-16 12:48:40,138 - Writing File['/etc/hadoop/conf/core-site.xml'] because contents don't match
> 2014-05-16 12:48:40,139 - XmlConfig['mapred-site.xml'] {'owner': 'custom-yarn', 'group': 'custom-hadoop', 'mode': 0644, 'conf_dir': '/etc/hadoop/conf', 'configurations': ...}
> 2014-05-16 12:48:40,146 - Generating config: /etc/hadoop/conf/mapred-site.xml
> 2014-05-16 12:48:40,146 - File['/etc/hadoop/conf/mapred-site.xml'] {'owner': 'custom-yarn', 'content': InlineTemplate(...), 'group': 'custom-hadoop', 'mode': 0644}
> 2014-05-16 12:48:40,148 - Writing File['/etc/hadoop/conf/mapred-site.xml'] because contents don't match
> 2014-05-16 12:48:40,148 - Changing owner for /etc/hadoop/conf/mapred-site.xml from 1010 to custom-yarn
> 2014-05-16 12:48:40,148 - XmlConfig['yarn-site.xml'] {'owner': 'custom-yarn', 'group': 'custom-hadoop', 'mode': 0644, 'conf_dir': '/etc/hadoop/conf', 'configurations': ...}
> 2014-05-16 12:48:40,155 - Generating config: /etc/hadoop/conf/yarn-site.xml
> 2014-05-16 12:48:40,155 - File['/etc/hadoop/conf/yarn-site.xml'] {'owner': 'custom-yarn', 'content': InlineTemplate(...), 'group': 'custom-hadoop', 'mode': 0644}
> 2014-05-16 12:48:40,157 - Writing File['/etc/hadoop/conf/yarn-site.xml'] because contents don't match
> 2014-05-16 12:48:40,157 - XmlConfig['capacity-scheduler.xml'] {'owner': 'custom-yarn', 'group': 'custom-hadoop', 'mode': 0644, 'conf_dir': '/etc/hadoop/conf', 'configurations': ...}
> 2014-05-16 12:48:40,165 - Generating config: /etc/hadoop/conf/capacity-scheduler.xml
> 2014-05-16 12:48:40,165 - File['/etc/hadoop/conf/capacity-scheduler.xml'] {'owner': 'custom-yarn', 'content': InlineTemplate(...), 'group': 'custom-hadoop', 'mode': 0644}
> 2014-05-16 12:48:40,166 - Writing File['/etc/hadoop/conf/capacity-scheduler.xml'] because contents don't match
> 2014-05-16 12:48:40,167 - Changing owner for /etc/hadoop/conf/capacity-scheduler.xml from 1009 to custom-yarn
> 2014-05-16 12:48:40,167 - File['/etc/hadoop/conf/yarn.exclude'] {'owner': 'custom-yarn', 'group': 'custom-hadoop'}
> 2014-05-16 12:48:40,173 - File['/etc/security/limits.d/yarn.conf'] {'content': Template('yarn.conf.j2'), 'mode': 0644}
> 2014-05-16 12:48:40,178 - File['/etc/security/limits.d/mapreduce.conf'] {'content': Template('mapreduce.conf.j2'), 'mode': 0644}
> 2014-05-16 12:48:40,187 - File['/etc/hadoop/conf/yarn-env.sh'] {'content': Template('yarn-env.sh.j2'), 'owner': 'custom-yarn', 'group': 'custom-hadoop', 'mode': 0755}
> 2014-05-16 12:48:40,190 - File['/etc/hadoop/conf/mapred-env.sh'] {'content': Template('mapred-env.sh.j2'), 'owner': 'custom-hdfs'}
> 2014-05-16 12:48:40,194 - File['/etc/hadoop/conf/taskcontroller.cfg'] {'content': Template('taskcontroller.cfg.j2'), 'owner': 'custom-hdfs'}
> 2014-05-16 12:48:40,195 - XmlConfig['mapred-site.xml'] {'owner': 'custom-mr', 'group': 'custom-hadoop', 'conf_dir': '/etc/hadoop/conf', 'configurations': ...}
> 2014-05-16 12:48:40,202 - Generating config: /etc/hadoop/conf/mapred-site.xml
> 2014-05-16 12:48:40,203 - File['/etc/hadoop/conf/mapred-site.xml'] {'owner': 'custom-mr', 'content': InlineTemplate(...), 'group': 'custom-hadoop', 'mode': None}
> 2014-05-16 12:48:40,204 - Changing owner for /etc/hadoop/conf/mapred-site.xml from 1007 to custom-mr
> 2014-05-16 12:48:40,204 - XmlConfig['capacity-scheduler.xml'] {'owner': 'custom-hdfs', 'group': 'custom-hadoop', 'conf_dir': '/etc/hadoop/conf', 'configurations': ...}
> 2014-05-16 12:48:40,211 - Generating config: /etc/hadoop/conf/capacity-scheduler.xml
> 2014-05-16 12:48:40,212 - File['/etc/hadoop/conf/capacity-scheduler.xml'] {'owner': 'custom-hdfs', 'content': InlineTemplate(...), 'group': 'custom-hadoop', 'mode': None}
> 2014-05-16 12:48:40,213 - Changing owner for /etc/hadoop/conf/capacity-scheduler.xml from 1007 to custom-hdfs
> 2014-05-16 12:48:40,213 - File['/etc/hadoop/conf/ssl-client.xml.example'] {'owner': 'custom-mr', 'group': 'custom-hadoop'}
> 2014-05-16 12:48:40,213 - File['/etc/hadoop/conf/ssl-server.xml.example'] {'owner': 'custom-mr', 'group': 'custom-hadoop'}
> 2014-05-16 12:48:40,215 - Execute['export HADOOP_LIBEXEC_DIR=/usr/lib/hadoop/libexec && /usr/lib/hadoop-yarn/sbin/yarn-daemon.sh --config /etc/hadoop/conf start historyserver'] {'not_if': 'ls /var/run/hadoop-yarn/custom-yarn/yarn-custom-yarn-historyserver.pid >/dev/null 2>&1 && ps `cat /var/run/hadoop-yarn/custom-yarn/yarn-custom-yarn-historyserver.pid` >/dev/null 2>&1', 'user': 'custom-yarn'}
> 2014-05-16 12:48:41,336 - Execute['ls /var/run/hadoop-yarn/custom-yarn/yarn-custom-yarn-historyserver.pid >/dev/null 2>&1 && ps `cat /var/run/hadoop-yarn/custom-yarn/yarn-custom-yarn-historyserver.pid` >/dev/null 2>&1'] {'initial_wait': 5, 'not_if': 'ls /var/run/hadoop-yarn/custom-yarn/yarn-custom-yarn-historyserver.pid >/dev/null 2>&1 && ps `cat /var/run/hadoop-yarn/custom-yarn/yarn-custom-yarn-historyserver.pid` >/dev/null 2>&1', 'user': 'custom-yarn'}
> 2014-05-16 12:48:46,413 - Error while executing command 'start':
> Traceback (most recent call last):
> File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 105, in execute
> method(env)
> File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/services/YARN/package/scripts/application_timeline_server.py", line 43, in start
> service('historyserver', action='start')
> File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/services/YARN/package/scripts/service.py", line 52, in service
> initial_wait=5
> File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 148, in __init__
> self.env.run()
> File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 149, in run
> self.run_action(resource, action)
> File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 115, in run_action
> provider_action()
> File "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py", line 239, in action_run
> raise ex
> Fail: Execution of 'ls /var/run/hadoop-yarn/custom-yarn/yarn-custom-yarn-historyserver.pid >/dev/null 2>&1 && ps `cat /var/run/hadoop-yarn/custom-yarn/yarn-custom-yarn-historyserver.pid` >/dev/null 2>&1' returned 1.
>
>
>
> Diffs
> -----
>
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/YARN/package/scripts/application_timeline_server.py 0719da8
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/YARN/package/scripts/params.py c34a536
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/YARN/package/scripts/yarn.py a09a6d6
> ambari-server/src/test/python/stacks/2.0.6/configs/default.json 3f5220e
> ambari-server/src/test/python/stacks/2.0.6/configs/secured.json 12de853
> ambari-server/src/test/python/stacks/2.1/YARN/test_apptimelineserver.py fc0559d
> ambari-server/src/test/python/stacks/2.1/configs/default.json fdac02a
> ambari-server/src/test/python/stacks/2.1/configs/secured.json 8e76ef5
>
> Diff: https://reviews.apache.org/r/21627/diff/
>
>
> Testing
> -------
>
> mvn clean test
>
>
> Thanks,
>
> Andrew Onischuk
>
>