You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@ambari.apache.org by Vitalyi Brodetskyi <vb...@hortonworks.com> on 2015/04/20 14:53:38 UTC
Review Request 33355: Tez Service check fails after enabling HA
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/33355/
-----------------------------------------------------------
Review request for Ambari and Andrew Onischuk.
Bugs: AMBARI-10596
https://issues.apache.org/jira/browse/AMBARI-10596
Repository: ambari
Description
-------
on the cluster (with HDFS,MApred, Yarn, Tez, ZK, AmbariMetrics), after enabling NNHa and RMHA start services failed at Check Tez with the below error. This is unsecure cluster.
{code}
2015-04-17 19:10:15,029 - Error while executing command 'service_check':
Traceback (most recent call last):
File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 214, in execute
method(env)
File "/var/lib/ambari-agent/cache/common-services/TEZ/0.4.0.2.1/package/scripts/service_check.py", line 67, in service_check
bin_dir = params.hadoop_bin_dir
File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 148, in __init__
self.env.run()
File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 152, in run
self.run_action(resource, action)
File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 118, in run_action
provider_action()
File "/usr/lib/python2.6/site-packages/resource_management/libraries/providers/execute_hadoop.py", line 55, in action_run
environment = self.resource.environment,
File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 148, in __init__
self.env.run()
File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 152, in run
self.run_action(resource, action)
File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 118, in run_action
provider_action()
File "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py", line 274, in action_run
raise ex
Fail: Execution of 'hadoop --config /etc/hadoop/conf fs -mkdir /tmp/tezsmokeinput' returned 1. mkdir: `/tmp/tezsmokeinput': No such file or directory
{code}
Diffs
-----
ambari-server/src/main/resources/common-services/TEZ/0.4.0.2.1/package/scripts/service_check.py 35ae5b6
ambari-server/src/test/python/stacks/2.1/TEZ/test_service_check.py cf240b0
Diff: https://reviews.apache.org/r/33355/diff/
Testing
-------
mvn clean test
Thanks,
Vitalyi Brodetskyi
Re: Review Request 33355: Tez Service check fails after enabling HA
Posted by Andrew Onischuk <ao...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/33355/#review80704
-----------------------------------------------------------
Can we just do this:
create_input_dir_cmd = format("fs -mkdir /tmp/tezsmokeinput")
->
create_input_dir_cmd = format("fs -mkdir -p /tmp/tezsmokeinput")
This will save us some time on deploy (on loaded cluster it's about 1-2mins)
- Andrew Onischuk
On April 20, 2015, 12:53 p.m., Vitalyi Brodetskyi wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/33355/
> -----------------------------------------------------------
>
> (Updated April 20, 2015, 12:53 p.m.)
>
>
> Review request for Ambari and Andrew Onischuk.
>
>
> Bugs: AMBARI-10596
> https://issues.apache.org/jira/browse/AMBARI-10596
>
>
> Repository: ambari
>
>
> Description
> -------
>
> on the cluster (with HDFS,MApred, Yarn, Tez, ZK, AmbariMetrics), after enabling NNHa and RMHA start services failed at Check Tez with the below error. This is unsecure cluster.
> {code}
> 2015-04-17 19:10:15,029 - Error while executing command 'service_check':
> Traceback (most recent call last):
> File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 214, in execute
> method(env)
> File "/var/lib/ambari-agent/cache/common-services/TEZ/0.4.0.2.1/package/scripts/service_check.py", line 67, in service_check
> bin_dir = params.hadoop_bin_dir
> File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 148, in __init__
> self.env.run()
> File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 152, in run
> self.run_action(resource, action)
> File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 118, in run_action
> provider_action()
> File "/usr/lib/python2.6/site-packages/resource_management/libraries/providers/execute_hadoop.py", line 55, in action_run
> environment = self.resource.environment,
> File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 148, in __init__
> self.env.run()
> File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 152, in run
> self.run_action(resource, action)
> File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 118, in run_action
> provider_action()
> File "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py", line 274, in action_run
> raise ex
> Fail: Execution of 'hadoop --config /etc/hadoop/conf fs -mkdir /tmp/tezsmokeinput' returned 1. mkdir: `/tmp/tezsmokeinput': No such file or directory
> {code}
>
>
> Diffs
> -----
>
> ambari-server/src/main/resources/common-services/TEZ/0.4.0.2.1/package/scripts/service_check.py 35ae5b6
> ambari-server/src/test/python/stacks/2.1/TEZ/test_service_check.py cf240b0
>
> Diff: https://reviews.apache.org/r/33355/diff/
>
>
> Testing
> -------
>
> mvn clean test
>
>
> Thanks,
>
> Vitalyi Brodetskyi
>
>
Re: Review Request 33355: Tez Service check fails after enabling HA
Posted by Andrew Onischuk <ao...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/33355/#review80705
-----------------------------------------------------------
Ship it!
Ship It!
- Andrew Onischuk
On April 20, 2015, 12:53 p.m., Vitalyi Brodetskyi wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/33355/
> -----------------------------------------------------------
>
> (Updated April 20, 2015, 12:53 p.m.)
>
>
> Review request for Ambari and Andrew Onischuk.
>
>
> Bugs: AMBARI-10596
> https://issues.apache.org/jira/browse/AMBARI-10596
>
>
> Repository: ambari
>
>
> Description
> -------
>
> on the cluster (with HDFS,MApred, Yarn, Tez, ZK, AmbariMetrics), after enabling NNHa and RMHA start services failed at Check Tez with the below error. This is unsecure cluster.
> {code}
> 2015-04-17 19:10:15,029 - Error while executing command 'service_check':
> Traceback (most recent call last):
> File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 214, in execute
> method(env)
> File "/var/lib/ambari-agent/cache/common-services/TEZ/0.4.0.2.1/package/scripts/service_check.py", line 67, in service_check
> bin_dir = params.hadoop_bin_dir
> File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 148, in __init__
> self.env.run()
> File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 152, in run
> self.run_action(resource, action)
> File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 118, in run_action
> provider_action()
> File "/usr/lib/python2.6/site-packages/resource_management/libraries/providers/execute_hadoop.py", line 55, in action_run
> environment = self.resource.environment,
> File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 148, in __init__
> self.env.run()
> File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 152, in run
> self.run_action(resource, action)
> File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 118, in run_action
> provider_action()
> File "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py", line 274, in action_run
> raise ex
> Fail: Execution of 'hadoop --config /etc/hadoop/conf fs -mkdir /tmp/tezsmokeinput' returned 1. mkdir: `/tmp/tezsmokeinput': No such file or directory
> {code}
>
>
> Diffs
> -----
>
> ambari-server/src/main/resources/common-services/TEZ/0.4.0.2.1/package/scripts/service_check.py 35ae5b6
> ambari-server/src/test/python/stacks/2.1/TEZ/test_service_check.py cf240b0
>
> Diff: https://reviews.apache.org/r/33355/diff/
>
>
> Testing
> -------
>
> mvn clean test
>
>
> Thanks,
>
> Vitalyi Brodetskyi
>
>