You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@ambari.apache.org by Andrew Onischuk <ao...@hortonworks.com> on 2017/07/20 10:20:59 UTC
Review Request 60994: Client component restart fails after Ambari
upgrade while running custom hook script on Suse 11
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/60994/
-----------------------------------------------------------
Review request for Ambari and Vitalyi Brodetskyi.
Bugs: AMBARI-21531
https://issues.apache.org/jira/browse/AMBARI-21531
Repository: ambari
Description
-------
Seen in two cluster with Suse 11 SP4 OS
**STR**
1. Deployed cluster with Ambari version: 2.4.2.0-136 and HDP version: 2.5.3.0-37 (secure cluster, wire encryption enabled one cluster, disabled on second cluster)
2. Upgrade Ambari to 2.5.2.0-147 (hash: be22223a875972224d7eb420c783a9f2cbdc7157)
3. Regenerate keytabs post upgrade and then try to restart all services
**Result:**
Observed errors at start of Falcon, HBase, Atlas clients:
Traceback (most recent call last):
File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-ANY/scripts/hook.py", line 35, in <module>
BeforeAnyHook().execute()
File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 329, in execute
method(env)
File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-ANY/scripts/hook.py", line 29, in hook
setup_users()
File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-ANY/scripts/shared_initialization.py", line 51, in setup_users
groups = params.user_to_groups_dict[user],
File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 155, in __init__
self.env.run()
File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 160, in run
self.run_action(resource, action)
File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 124, in run_action
provider_action()
File "/usr/lib/python2.6/site-packages/resource_management/core/providers/accounts.py", line 82, in action_create
shell.checked_call(command, sudo=True)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 72, in inner
result = function(command, **kwargs)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 102, in checked_call
tries=tries, try_sleep=try_sleep, timeout_kill_strategy=timeout_kill_strategy)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 150, in _call_wrapper
result = _call(command, **kwargs_copy)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 303, in _call
raise ExecutionFailed(err_msg, code, out, err)
resource_management.core.exceptions.ExecutionFailed: Execution of 'usermod -u 1002 -G hadoop,hadoop -g hadoop hive' returned 11. usermod: `hadoop' is primary group name.
usermod: `hadoop' is primary group name.
usermod: UID 1002 is not unique.
Error: Error: Unable to run the custom hook script ['/usr/bin/python', '/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-ANY/scripts/hook.py', 'ANY', '/var/lib/ambari-agent/data/command-864.json', '/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-ANY', '/var/lib/ambari-agent/data/structured-out-864.json', 'INFO', '/var/lib/ambari-agent/tmp', 'PROTOCOL_TLSv1', '']Error: Error: Unable to run the custom hook script ['/usr/bin/python', '/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-START/scripts/hook.py', 'START', '/var/lib/ambari-agent/data/command-864.json', '/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-START', '/var/lib/ambari-agent/data/structured-out-864.json', 'INFO', '/var/lib/ambari-agent/tmp', 'PROTOCOL_TLSv1', '']
Suspect something to do with TLS v1 protocol on Suse 11.4
Cluster: <https://172.22.85.148:8443> (alive for 48h)
Diffs
-----
ambari-agent/src/test/python/resource_management/TestUserResource.py 97d992e
ambari-common/src/main/python/resource_management/core/base.py 1500e1f
ambari-common/src/main/python/resource_management/core/providers/accounts.py c4f2496
ambari-common/src/main/python/resource_management/core/resources/accounts.py 4ee2c57
ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-ANY/scripts/shared_initialization.py 886bc45
ambari-server/src/test/python/stacks/2.0.6/hooks/before-ANY/test_before_any.py 1d2351f
Diff: https://reviews.apache.org/r/60994/diff/1/
Testing
-------
mvn clean test
Thanks,
Andrew Onischuk
Re: Review Request 60994: Client component restart fails after Ambari
upgrade while running custom hook script on Suse 11
Posted by Vitalyi Brodetskyi <vb...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/60994/#review181033
-----------------------------------------------------------
Ship it!
Ship It!
- Vitalyi Brodetskyi
On Липень 20, 2017, 10:20 до полудня, Andrew Onischuk wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/60994/
> -----------------------------------------------------------
>
> (Updated Липень 20, 2017, 10:20 до полудня)
>
>
> Review request for Ambari and Vitalyi Brodetskyi.
>
>
> Bugs: AMBARI-21531
> https://issues.apache.org/jira/browse/AMBARI-21531
>
>
> Repository: ambari
>
>
> Description
> -------
>
> Seen in two cluster with Suse 11 SP4 OS
>
> **STR**
>
> 1. Deployed cluster with Ambari version: 2.4.2.0-136 and HDP version: 2.5.3.0-37 (secure cluster, wire encryption enabled one cluster, disabled on second cluster)
> 2. Upgrade Ambari to 2.5.2.0-147 (hash: be22223a875972224d7eb420c783a9f2cbdc7157)
> 3. Regenerate keytabs post upgrade and then try to restart all services
>
> **Result:**
> Observed errors at start of Falcon, HBase, Atlas clients:
>
>
>
>
> Traceback (most recent call last):
> File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-ANY/scripts/hook.py", line 35, in <module>
> BeforeAnyHook().execute()
> File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 329, in execute
> method(env)
> File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-ANY/scripts/hook.py", line 29, in hook
> setup_users()
> File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-ANY/scripts/shared_initialization.py", line 51, in setup_users
> groups = params.user_to_groups_dict[user],
> File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 155, in __init__
> self.env.run()
> File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 160, in run
> self.run_action(resource, action)
> File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 124, in run_action
> provider_action()
> File "/usr/lib/python2.6/site-packages/resource_management/core/providers/accounts.py", line 82, in action_create
> shell.checked_call(command, sudo=True)
> File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 72, in inner
> result = function(command, **kwargs)
> File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 102, in checked_call
> tries=tries, try_sleep=try_sleep, timeout_kill_strategy=timeout_kill_strategy)
> File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 150, in _call_wrapper
> result = _call(command, **kwargs_copy)
> File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 303, in _call
> raise ExecutionFailed(err_msg, code, out, err)
> resource_management.core.exceptions.ExecutionFailed: Execution of 'usermod -u 1002 -G hadoop,hadoop -g hadoop hive' returned 11. usermod: `hadoop' is primary group name.
> usermod: `hadoop' is primary group name.
> usermod: UID 1002 is not unique.
> Error: Error: Unable to run the custom hook script ['/usr/bin/python', '/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-ANY/scripts/hook.py', 'ANY', '/var/lib/ambari-agent/data/command-864.json', '/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-ANY', '/var/lib/ambari-agent/data/structured-out-864.json', 'INFO', '/var/lib/ambari-agent/tmp', 'PROTOCOL_TLSv1', '']Error: Error: Unable to run the custom hook script ['/usr/bin/python', '/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-START/scripts/hook.py', 'START', '/var/lib/ambari-agent/data/command-864.json', '/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-START', '/var/lib/ambari-agent/data/structured-out-864.json', 'INFO', '/var/lib/ambari-agent/tmp', 'PROTOCOL_TLSv1', '']
>
>
> Suspect something to do with TLS v1 protocol on Suse 11.4
>
> Cluster: <https://172.22.85.148:8443> (alive for 48h)
>
>
> Diffs
> -----
>
> ambari-agent/src/test/python/resource_management/TestUserResource.py 97d992e
> ambari-common/src/main/python/resource_management/core/base.py 1500e1f
> ambari-common/src/main/python/resource_management/core/providers/accounts.py c4f2496
> ambari-common/src/main/python/resource_management/core/resources/accounts.py 4ee2c57
> ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-ANY/scripts/shared_initialization.py 886bc45
> ambari-server/src/test/python/stacks/2.0.6/hooks/before-ANY/test_before_any.py 1d2351f
>
>
> Diff: https://reviews.apache.org/r/60994/diff/1/
>
>
> Testing
> -------
>
> mvn clean test
>
>
> Thanks,
>
> Andrew Onischuk
>
>