You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@ambari.apache.org by Andrew Onischuk <ao...@hortonworks.com> on 2014/10/31 17:27:07 UTC
Review Request 27428: Unable to start services after 1.6.1 -> 1.7.0
upgrade
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/27428/
-----------------------------------------------------------
Review request for Ambari and Dmytro Sen.
Bugs: AMBARI-8071
https://issues.apache.org/jira/browse/AMBARI-8071
Repository: ambari
Description
-------
1) Installed 1.6.1
2) modified configs (like nn, dn heapsizes, rm heapsize, tez memory setting,
etc)
3) all saves and restarts fine
4) stop all services, performed upgrade to 1.7.0
5) All services show restart required.
6) I attempt to start all and fails. HDFS, Mapreduce, tez and yarn clients
installs all fail with the error below.
If I attempt to refresh configs or restart just tez, it fails with "Host Role
in invalid state".
tderr: /var/lib/ambari-agent/data/errors-52.txt
Traceback (most recent call last):
File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-ANY/scripts/hook.py", line 34, in <module>
BeforeAnyHook().execute()
File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 122, in execute
method(env)
File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-ANY/scripts/hook.py", line 26, in hook
import params
File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-ANY/scripts/params.py", line 69, in <module>
namenode_opt_permsize = format_jvm_option("/configurations/hadoop-env/namenode_opt_permsize","128m")
File "/usr/lib/python2.6/site-packages/resource_management/libraries/functions/format_jvm_option.py", line 31, in format_jvm_option
if not "m" in curr_dict:
TypeError: argument of type 'int' is not iterable
Error: Error: Unable to run the custom hook script ['/usr/bin/python2.6', '/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-ANY/scripts/hook.py', 'ANY', '/var/lib/ambari-agent/data/command-52.json', '/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-ANY', '/var/lib/ambari-agent/data/structured-out-52.json', 'INFO', '/var/lib/ambari-agent/data/tmp']
stdout: /var/lib/ambari-agent/data/output-52.txt
Error: Error: Unable to run the custom hook script ['/usr/bin/python2.6', '/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-ANY/scripts/hook.py', 'ANY', '/var/lib/ambari-agent/data/command-52.json', '/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-ANY', '/var/lib/ambari-agent/data/structured-out-52.json', 'INFO', '/var/lib/ambari-agent/data/tmp']
If I attempt to just try to start namenode component specifically, this is
what I get:
Traceback (most recent call last):
File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-START/scripts/hook.py", line 37, in <module>
BeforeStartHook().execute()
File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 122, in execute
method(env)
File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-START/scripts/hook.py", line 27, in hook
import params
File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-START/scripts/params.py", line 136, in <module>
namenode_opt_permsize = format_jvm_option("/configurations/hadoop-env/namenode_opt_permsize","128m")
File "/usr/lib/python2.6/site-packages/resource_management/libraries/functions/format_jvm_option.py", line 31, in format_jvm_option
if not "m" in curr_dict:
TypeError: argument of type 'int' is not iterable
Diffs
-----
ambari-common/src/main/python/resource_management/libraries/functions/format_jvm_option.py 7182fb9
Diff: https://reviews.apache.org/r/27428/diff/
Testing
-------
mvn clean test
Thanks,
Andrew Onischuk
Re: Review Request 27428: Unable to start services after 1.6.1 ->
1.7.0 upgrade
Posted by Alejandro Fernandez <af...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/27428/#review59404
-----------------------------------------------------------
ambari-common/src/main/python/resource_management/libraries/functions/format_jvm_option.py
<https://reviews.apache.org/r/27428/#comment100670>
This can just be an else.
- Alejandro Fernandez
On Oct. 31, 2014, 4:27 p.m., Andrew Onischuk wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/27428/
> -----------------------------------------------------------
>
> (Updated Oct. 31, 2014, 4:27 p.m.)
>
>
> Review request for Ambari, Dmitro Lisnichenko and Dmytro Sen.
>
>
> Bugs: AMBARI-8071
> https://issues.apache.org/jira/browse/AMBARI-8071
>
>
> Repository: ambari
>
>
> Description
> -------
>
> 1) Installed 1.6.1
> 2) modified configs (like nn, dn heapsizes, rm heapsize, tez memory setting,
> etc)
> 3) all saves and restarts fine
> 4) stop all services, performed upgrade to 1.7.0
> 5) All services show restart required.
> 6) I attempt to start all and fails. HDFS, Mapreduce, tez and yarn clients
> installs all fail with the error below.
>
> If I attempt to refresh configs or restart just tez, it fails with "Host Role
> in invalid state".
>
>
>
>
> tderr: /var/lib/ambari-agent/data/errors-52.txt
>
> Traceback (most recent call last):
> File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-ANY/scripts/hook.py", line 34, in <module>
> BeforeAnyHook().execute()
> File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 122, in execute
> method(env)
> File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-ANY/scripts/hook.py", line 26, in hook
> import params
> File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-ANY/scripts/params.py", line 69, in <module>
> namenode_opt_permsize = format_jvm_option("/configurations/hadoop-env/namenode_opt_permsize","128m")
> File "/usr/lib/python2.6/site-packages/resource_management/libraries/functions/format_jvm_option.py", line 31, in format_jvm_option
> if not "m" in curr_dict:
> TypeError: argument of type 'int' is not iterable
> Error: Error: Unable to run the custom hook script ['/usr/bin/python2.6', '/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-ANY/scripts/hook.py', 'ANY', '/var/lib/ambari-agent/data/command-52.json', '/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-ANY', '/var/lib/ambari-agent/data/structured-out-52.json', 'INFO', '/var/lib/ambari-agent/data/tmp']
>
> stdout: /var/lib/ambari-agent/data/output-52.txt
>
> Error: Error: Unable to run the custom hook script ['/usr/bin/python2.6', '/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-ANY/scripts/hook.py', 'ANY', '/var/lib/ambari-agent/data/command-52.json', '/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-ANY', '/var/lib/ambari-agent/data/structured-out-52.json', 'INFO', '/var/lib/ambari-agent/data/tmp']
>
>
> If I attempt to just try to start namenode component specifically, this is
> what I get:
>
>
>
>
> Traceback (most recent call last):
> File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-START/scripts/hook.py", line 37, in <module>
> BeforeStartHook().execute()
> File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 122, in execute
> method(env)
> File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-START/scripts/hook.py", line 27, in hook
> import params
> File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-START/scripts/params.py", line 136, in <module>
> namenode_opt_permsize = format_jvm_option("/configurations/hadoop-env/namenode_opt_permsize","128m")
> File "/usr/lib/python2.6/site-packages/resource_management/libraries/functions/format_jvm_option.py", line 31, in format_jvm_option
> if not "m" in curr_dict:
> TypeError: argument of type 'int' is not iterable
>
>
>
> Diffs
> -----
>
> ambari-common/src/main/python/resource_management/libraries/functions/format_jvm_option.py 7182fb9
>
> Diff: https://reviews.apache.org/r/27428/diff/
>
>
> Testing
> -------
>
> mvn clean test
>
>
> Thanks,
>
> Andrew Onischuk
>
>
Re: Review Request 27428: Unable to start services after 1.6.1 ->
1.7.0 upgrade
Posted by Andrew Onischuk <ao...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/27428/#review121235
-----------------------------------------------------------
This has been a while since this is opened, unfortunately the person which asked to commit this is no longer active. I'm going to close this now.
- Andrew Onischuk
On Oct. 31, 2014, 4:27 p.m., Andrew Onischuk wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/27428/
> -----------------------------------------------------------
>
> (Updated Oct. 31, 2014, 4:27 p.m.)
>
>
> Review request for Ambari, Dmitro Lisnichenko and Dmytro Sen.
>
>
> Bugs: AMBARI-8071
> https://issues.apache.org/jira/browse/AMBARI-8071
>
>
> Repository: ambari
>
>
> Description
> -------
>
> 1) Installed 1.6.1
> 2) modified configs (like nn, dn heapsizes, rm heapsize, tez memory setting,
> etc)
> 3) all saves and restarts fine
> 4) stop all services, performed upgrade to 1.7.0
> 5) All services show restart required.
> 6) I attempt to start all and fails. HDFS, Mapreduce, tez and yarn clients
> installs all fail with the error below.
>
> If I attempt to refresh configs or restart just tez, it fails with "Host Role
> in invalid state".
>
>
>
>
> tderr: /var/lib/ambari-agent/data/errors-52.txt
>
> Traceback (most recent call last):
> File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-ANY/scripts/hook.py", line 34, in <module>
> BeforeAnyHook().execute()
> File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 122, in execute
> method(env)
> File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-ANY/scripts/hook.py", line 26, in hook
> import params
> File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-ANY/scripts/params.py", line 69, in <module>
> namenode_opt_permsize = format_jvm_option("/configurations/hadoop-env/namenode_opt_permsize","128m")
> File "/usr/lib/python2.6/site-packages/resource_management/libraries/functions/format_jvm_option.py", line 31, in format_jvm_option
> if not "m" in curr_dict:
> TypeError: argument of type 'int' is not iterable
> Error: Error: Unable to run the custom hook script ['/usr/bin/python2.6', '/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-ANY/scripts/hook.py', 'ANY', '/var/lib/ambari-agent/data/command-52.json', '/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-ANY', '/var/lib/ambari-agent/data/structured-out-52.json', 'INFO', '/var/lib/ambari-agent/data/tmp']
>
> stdout: /var/lib/ambari-agent/data/output-52.txt
>
> Error: Error: Unable to run the custom hook script ['/usr/bin/python2.6', '/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-ANY/scripts/hook.py', 'ANY', '/var/lib/ambari-agent/data/command-52.json', '/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-ANY', '/var/lib/ambari-agent/data/structured-out-52.json', 'INFO', '/var/lib/ambari-agent/data/tmp']
>
>
> If I attempt to just try to start namenode component specifically, this is
> what I get:
>
>
>
>
> Traceback (most recent call last):
> File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-START/scripts/hook.py", line 37, in <module>
> BeforeStartHook().execute()
> File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 122, in execute
> method(env)
> File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-START/scripts/hook.py", line 27, in hook
> import params
> File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-START/scripts/params.py", line 136, in <module>
> namenode_opt_permsize = format_jvm_option("/configurations/hadoop-env/namenode_opt_permsize","128m")
> File "/usr/lib/python2.6/site-packages/resource_management/libraries/functions/format_jvm_option.py", line 31, in format_jvm_option
> if not "m" in curr_dict:
> TypeError: argument of type 'int' is not iterable
>
>
>
> Diffs
> -----
>
> ambari-common/src/main/python/resource_management/libraries/functions/format_jvm_option.py 7182fb9
>
> Diff: https://reviews.apache.org/r/27428/diff/
>
>
> Testing
> -------
>
> mvn clean test
>
>
> Thanks,
>
> Andrew Onischuk
>
>
Re: Review Request 27428: Unable to start services after 1.6.1 ->
1.7.0 upgrade
Posted by Dmitro Lisnichenko <dl...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/27428/#review59357
-----------------------------------------------------------
Ship it!
Ship It!
- Dmitro Lisnichenko
On Oct. 31, 2014, 4:27 p.m., Andrew Onischuk wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/27428/
> -----------------------------------------------------------
>
> (Updated Oct. 31, 2014, 4:27 p.m.)
>
>
> Review request for Ambari, Dmitro Lisnichenko and Dmytro Sen.
>
>
> Bugs: AMBARI-8071
> https://issues.apache.org/jira/browse/AMBARI-8071
>
>
> Repository: ambari
>
>
> Description
> -------
>
> 1) Installed 1.6.1
> 2) modified configs (like nn, dn heapsizes, rm heapsize, tez memory setting,
> etc)
> 3) all saves and restarts fine
> 4) stop all services, performed upgrade to 1.7.0
> 5) All services show restart required.
> 6) I attempt to start all and fails. HDFS, Mapreduce, tez and yarn clients
> installs all fail with the error below.
>
> If I attempt to refresh configs or restart just tez, it fails with "Host Role
> in invalid state".
>
>
>
>
> tderr: /var/lib/ambari-agent/data/errors-52.txt
>
> Traceback (most recent call last):
> File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-ANY/scripts/hook.py", line 34, in <module>
> BeforeAnyHook().execute()
> File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 122, in execute
> method(env)
> File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-ANY/scripts/hook.py", line 26, in hook
> import params
> File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-ANY/scripts/params.py", line 69, in <module>
> namenode_opt_permsize = format_jvm_option("/configurations/hadoop-env/namenode_opt_permsize","128m")
> File "/usr/lib/python2.6/site-packages/resource_management/libraries/functions/format_jvm_option.py", line 31, in format_jvm_option
> if not "m" in curr_dict:
> TypeError: argument of type 'int' is not iterable
> Error: Error: Unable to run the custom hook script ['/usr/bin/python2.6', '/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-ANY/scripts/hook.py', 'ANY', '/var/lib/ambari-agent/data/command-52.json', '/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-ANY', '/var/lib/ambari-agent/data/structured-out-52.json', 'INFO', '/var/lib/ambari-agent/data/tmp']
>
> stdout: /var/lib/ambari-agent/data/output-52.txt
>
> Error: Error: Unable to run the custom hook script ['/usr/bin/python2.6', '/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-ANY/scripts/hook.py', 'ANY', '/var/lib/ambari-agent/data/command-52.json', '/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-ANY', '/var/lib/ambari-agent/data/structured-out-52.json', 'INFO', '/var/lib/ambari-agent/data/tmp']
>
>
> If I attempt to just try to start namenode component specifically, this is
> what I get:
>
>
>
>
> Traceback (most recent call last):
> File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-START/scripts/hook.py", line 37, in <module>
> BeforeStartHook().execute()
> File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 122, in execute
> method(env)
> File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-START/scripts/hook.py", line 27, in hook
> import params
> File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-START/scripts/params.py", line 136, in <module>
> namenode_opt_permsize = format_jvm_option("/configurations/hadoop-env/namenode_opt_permsize","128m")
> File "/usr/lib/python2.6/site-packages/resource_management/libraries/functions/format_jvm_option.py", line 31, in format_jvm_option
> if not "m" in curr_dict:
> TypeError: argument of type 'int' is not iterable
>
>
>
> Diffs
> -----
>
> ambari-common/src/main/python/resource_management/libraries/functions/format_jvm_option.py 7182fb9
>
> Diff: https://reviews.apache.org/r/27428/diff/
>
>
> Testing
> -------
>
> mvn clean test
>
>
> Thanks,
>
> Andrew Onischuk
>
>
Re: Review Request 27428: Unable to start services after 1.6.1 ->
1.7.0 upgrade
Posted by Andrew Onischuk <ao...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/27428/
-----------------------------------------------------------
(Updated Oct. 31, 2014, 4:27 p.m.)
Review request for Ambari, Dmitro Lisnichenko and Dmytro Sen.
Bugs: AMBARI-8071
https://issues.apache.org/jira/browse/AMBARI-8071
Repository: ambari
Description
-------
1) Installed 1.6.1
2) modified configs (like nn, dn heapsizes, rm heapsize, tez memory setting,
etc)
3) all saves and restarts fine
4) stop all services, performed upgrade to 1.7.0
5) All services show restart required.
6) I attempt to start all and fails. HDFS, Mapreduce, tez and yarn clients
installs all fail with the error below.
If I attempt to refresh configs or restart just tez, it fails with "Host Role
in invalid state".
tderr: /var/lib/ambari-agent/data/errors-52.txt
Traceback (most recent call last):
File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-ANY/scripts/hook.py", line 34, in <module>
BeforeAnyHook().execute()
File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 122, in execute
method(env)
File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-ANY/scripts/hook.py", line 26, in hook
import params
File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-ANY/scripts/params.py", line 69, in <module>
namenode_opt_permsize = format_jvm_option("/configurations/hadoop-env/namenode_opt_permsize","128m")
File "/usr/lib/python2.6/site-packages/resource_management/libraries/functions/format_jvm_option.py", line 31, in format_jvm_option
if not "m" in curr_dict:
TypeError: argument of type 'int' is not iterable
Error: Error: Unable to run the custom hook script ['/usr/bin/python2.6', '/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-ANY/scripts/hook.py', 'ANY', '/var/lib/ambari-agent/data/command-52.json', '/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-ANY', '/var/lib/ambari-agent/data/structured-out-52.json', 'INFO', '/var/lib/ambari-agent/data/tmp']
stdout: /var/lib/ambari-agent/data/output-52.txt
Error: Error: Unable to run the custom hook script ['/usr/bin/python2.6', '/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-ANY/scripts/hook.py', 'ANY', '/var/lib/ambari-agent/data/command-52.json', '/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-ANY', '/var/lib/ambari-agent/data/structured-out-52.json', 'INFO', '/var/lib/ambari-agent/data/tmp']
If I attempt to just try to start namenode component specifically, this is
what I get:
Traceback (most recent call last):
File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-START/scripts/hook.py", line 37, in <module>
BeforeStartHook().execute()
File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 122, in execute
method(env)
File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-START/scripts/hook.py", line 27, in hook
import params
File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-START/scripts/params.py", line 136, in <module>
namenode_opt_permsize = format_jvm_option("/configurations/hadoop-env/namenode_opt_permsize","128m")
File "/usr/lib/python2.6/site-packages/resource_management/libraries/functions/format_jvm_option.py", line 31, in format_jvm_option
if not "m" in curr_dict:
TypeError: argument of type 'int' is not iterable
Diffs
-----
ambari-common/src/main/python/resource_management/libraries/functions/format_jvm_option.py 7182fb9
Diff: https://reviews.apache.org/r/27428/diff/
Testing
-------
mvn clean test
Thanks,
Andrew Onischuk