You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@ambari.apache.org by Robert Levas <rl...@hortonworks.com> on 2015/04/13 16:06:21 UTC
Review Request 33130: Ambari unable to start services using
non-default kinit_path_local
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/33130/
-----------------------------------------------------------
Review request for Ambari, Andrew Onischuk, Jonathan Hurley, and Vitalyi Brodetskyi.
Bugs: AMBARI-10452
https://issues.apache.org/jira/browse/AMBARI-10452
Repository: ambari
Description
-------
PROBLEM: Ambari is unable to start services after running the Enable Security wizard on a cluster that uses a non-standard path to the Kerberos utilities, such as kinit.
STEPS TO REPRODUCE:
1. Start with non-Kerberized cluster (2.2 Sandbox works fine)
2. Move Kerberos utilities from /usr/bin/ to a new location, example: /usr/myorg/bin/
3. Run 'Enable Security' wizard in Ambari, specify new path for kinit, Apply
4. Watch 'Start All Services' step fail
5. Attempt to 'Restart all components with Stale Configs for HDFS,' which fails with the following error:
Fail: Execution of ' -kt /etc/security/keytabs/hdfs.headless.keytab hdfs' returned 127. -bash: -kt: command not found
Due to the error that occurs with trying to manually restart the HDFS service, it seems like kinit_path_local is empty when the path to kinit is modified. It looks like each service uses the function from:
./ambari-common/src/main/python/resource_management/libraries/functions/get_kinit_path.py
But typically only these three hardcoded paths are passed to that function:
/usr/bin, /usr/kerberos/bin, /usr/sbin
The custom path defined in Ambari is never passed to that function, so the result is always empty.
Diffs
-----
ambari-agent/src/main/python/ambari_agent/alerts/web_alert.py ab68560
ambari-common/src/main/python/resource_management/libraries/functions/find_executable.py ad5eb0c
ambari-common/src/main/python/resource_management/libraries/functions/find_path.py 45f2269
ambari-server/src/main/resources/common-services/ACCUMULO/1.6.1.2.2.0/package/scripts/status_params.py 2d7cd61
ambari-server/src/main/resources/common-services/AMBARI_METRICS/0.1.0/package/scripts/params.py f9fb396
ambari-server/src/main/resources/common-services/AMBARI_METRICS/0.1.0/package/scripts/status_params.py 5ce3d4f
ambari-server/src/main/resources/common-services/FALCON/0.5.0.2.1/package/scripts/params_linux.py e986fdd
ambari-server/src/main/resources/common-services/FALCON/0.5.0.2.1/package/scripts/status_params.py bc3d21e
ambari-server/src/main/resources/common-services/HBASE/0.96.0.2.0/package/scripts/params_linux.py 98f0473
ambari-server/src/main/resources/common-services/HBASE/0.96.0.2.0/package/scripts/status_params.py 14a06d3
ambari-server/src/main/resources/common-services/HDFS/2.1.0.2.0/package/scripts/namenode.py 63639c4
ambari-server/src/main/resources/common-services/HDFS/2.1.0.2.0/package/scripts/params.py 37448ba
ambari-server/src/main/resources/common-services/HDFS/2.1.0.2.0/package/scripts/params_linux.py 7611ec1
ambari-server/src/main/resources/common-services/HDFS/2.1.0.2.0/package/scripts/status_params.py 66332bb
ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/alerts/alert_hive_metastore.py 3d1e18e
ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/alerts/alert_hive_thrift_port.py 96d68b3
ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/alerts/alert_webhcat_server.py fb6c4c2
ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/scripts/params.py e4e52b8
ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/scripts/status_params.py 3b75b98
ambari-server/src/main/resources/common-services/KERBEROS/1.10.3-10/package/scripts/kerberos_common.py e3032bd
ambari-server/src/main/resources/common-services/KERBEROS/1.10.3-10/package/scripts/service_check.py 738d511
ambari-server/src/main/resources/common-services/KERBEROS/1.10.3-10/package/scripts/status_params.py 1c73f40
ambari-server/src/main/resources/common-services/KNOX/0.5.0.2.2/package/scripts/params.py 6fc4fb0
ambari-server/src/main/resources/common-services/KNOX/0.5.0.2.2/package/scripts/status_params.py f420ba6
ambari-server/src/main/resources/common-services/MAHOUT/1.0.0.2.3/package/scripts/params.py 874de56
ambari-server/src/main/resources/common-services/OOZIE/4.0.0.2.0/package/alerts/alert_check_oozie_server.py 9e65e6b
ambari-server/src/main/resources/common-services/OOZIE/4.0.0.2.0/package/scripts/params_linux.py c9ae569
ambari-server/src/main/resources/common-services/OOZIE/4.0.0.2.0/package/scripts/status_params.py 5ae57fe
ambari-server/src/main/resources/common-services/PIG/0.12.0.2.0/package/scripts/params_linux.py 2be49fa
ambari-server/src/main/resources/common-services/SLIDER/0.60.0.2.2/package/scripts/params.py c05de5a
ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/params.py 8d2d285
ambari-server/src/main/resources/common-services/SQOOP/1.4.4.2.0/package/scripts/params_linux.py d5278c4
ambari-server/src/main/resources/common-services/STORM/0.9.1.2.1/package/scripts/status_params.py 2c06d16
ambari-server/src/main/resources/common-services/TEZ/0.4.0.2.1/package/scripts/params_linux.py 3245ff0
ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/package/scripts/params.py 871162a
ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/package/scripts/status_params.py 5ed99fd
ambari-server/src/main/resources/common-services/ZOOKEEPER/3.4.5.2.0/package/scripts/params_linux.py ef92b76
ambari-server/src/main/resources/common-services/ZOOKEEPER/3.4.5.2.0/package/scripts/status_params.py 5b2c953
ambari-server/src/main/resources/stacks/BIGTOP/0.8/services/HBASE/package/scripts/params.py 88e02e7
ambari-server/src/main/resources/stacks/BIGTOP/0.8/services/HDFS/package/scripts/params.py 7360835
ambari-server/src/main/resources/stacks/BIGTOP/0.8/services/HIVE/package/files/alert_hive_thrift_port.py 96d68b3
ambari-server/src/main/resources/stacks/BIGTOP/0.8/services/HIVE/package/scripts/params.py 9dd7f89
ambari-server/src/main/resources/stacks/BIGTOP/0.8/services/OOZIE/package/files/alert_check_oozie_server.py 9e2775b
ambari-server/src/main/resources/stacks/BIGTOP/0.8/services/OOZIE/package/scripts/params.py a7236ce
ambari-server/src/main/resources/stacks/BIGTOP/0.8/services/PIG/package/scripts/params.py b2c5441
ambari-server/src/main/resources/stacks/BIGTOP/0.8/services/WEBHCAT/package/files/alert_webhcat_server.py fb6c4c2
ambari-server/src/main/resources/stacks/BIGTOP/0.8/services/YARN/package/scripts/params.py 5a31518
ambari-server/src/main/resources/stacks/BIGTOP/0.8/services/ZOOKEEPER/package/scripts/params.py a0d504b
ambari-server/src/main/resources/stacks/HDP/2.0.6.GlusterFS/services/YARN/package/scripts/params.py 55fda42
ambari-server/src/main/resources/stacks/HDP/2.1.GlusterFS/services/FALCON/package/scripts/params.py 78d22b4
ambari-server/src/main/resources/stacks/HDP/2.1.GlusterFS/services/YARN/package/scripts/params.py 55fda42
ambari-server/src/main/resources/stacks/HDP/2.2.GlusterFS/services/KNOX/package/scripts/params.py b5c61e8
ambari-server/src/main/resources/stacks/HDP/2.2.GlusterFS/services/SLIDER/package/scripts/params.py 9b6731e
ambari-server/src/main/resources/stacks/HDPWIN/2.1/services/YARN/package/scripts/params.py e48655d
ambari-server/src/main/resources/stacks/PHD/3.0.0.0/services/HBASE/package/scripts/params.py f745e39
ambari-server/src/main/resources/stacks/PHD/3.0.0.0/services/HDFS/package/scripts/params.py 91aca2f
ambari-server/src/main/resources/stacks/PHD/3.0.0.0/services/HIVE/package/scripts/params.py fed3287
ambari-server/src/main/resources/stacks/PHD/3.0.0.0/services/NAGIOS/package/scripts/params.py 8bec940
ambari-server/src/main/resources/stacks/PHD/3.0.0.0/services/OOZIE/package/scripts/params.py b46ab73
ambari-server/src/main/resources/stacks/PHD/3.0.0.0/services/PIG/package/scripts/params.py 6284aed
ambari-server/src/main/resources/stacks/PHD/3.0.0.0/services/YARN/package/scripts/params.py 23bbc39
ambari-server/src/main/resources/stacks/PHD/3.0.0.0/services/ZOOKEEPER/package/scripts/params.py fdf7ddc
ambari-server/src/test/resources/TestAmbaryServer.samples/dummy_common_services/HIVE/0.11.0.2.0.5.0/package/scripts/params.py a49e231
ambari-server/src/test/resources/TestAmbaryServer.samples/dummy_stack/HIVE/package/scripts/params.py a49e231
ambari-server/src/test/resources/stacks/HDP/2.0.7/services/HIVE/package/scripts/params.py 7817a4d
Diff: https://reviews.apache.org/r/33130/diff/
Testing
-------
Manually tested to see custom Kerberos executables (kadmin, kinit, klist, etc...) were found in custom path
#Jenkins test results: PENDING
Thanks,
Robert Levas
Re: Review Request 33130: Ambari unable to start services using
non-default kinit_path_local
Posted by Jonathan Hurley <jh...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/33130/#review80016
-----------------------------------------------------------
Ship it!
Ship It!
- Jonathan Hurley
On April 13, 2015, 10:10 a.m., Robert Levas wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/33130/
> -----------------------------------------------------------
>
> (Updated April 13, 2015, 10:10 a.m.)
>
>
> Review request for Ambari, Andrew Onischuk, Jonathan Hurley, and Vitalyi Brodetskyi.
>
>
> Bugs: AMBARI-10452
> https://issues.apache.org/jira/browse/AMBARI-10452
>
>
> Repository: ambari
>
>
> Description
> -------
>
> PROBLEM: Ambari is unable to start services after running the Enable Security wizard on a cluster that uses a non-standard path to the Kerberos utilities, such as kinit.
>
> STEPS TO REPRODUCE:
> 1. Start with non-Kerberized cluster (2.2 Sandbox works fine)
> 2. Move Kerberos utilities from /usr/bin/ to a new location, example: /usr/myorg/bin/
> 3. Run 'Enable Security' wizard in Ambari, specify new path for kinit, Apply
> 4. Watch 'Start All Services' step fail
> 5. Attempt to 'Restart all components with Stale Configs for HDFS,' which fails with the following error:
>
> Fail: Execution of ' -kt /etc/security/keytabs/hdfs.headless.keytab hdfs' returned 127. -bash: -kt: command not found
>
> Due to the error that occurs with trying to manually restart the HDFS service, it seems like kinit_path_local is empty when the path to kinit is modified. It looks like each service uses the function from:
> ./ambari-common/src/main/python/resource_management/libraries/functions/get_kinit_path.py
>
> But typically only these three hardcoded paths are passed to that function:
> /usr/bin, /usr/kerberos/bin, /usr/sbin
>
> The custom path defined in Ambari is never passed to that function, so the result is always empty.
>
>
> Diffs
> -----
>
> ambari-agent/src/main/python/ambari_agent/alerts/web_alert.py ab68560
> ambari-common/src/main/python/resource_management/libraries/functions/find_executable.py ad5eb0c
> ambari-common/src/main/python/resource_management/libraries/functions/find_path.py 45f2269
> ambari-server/src/main/resources/common-services/ACCUMULO/1.6.1.2.2.0/package/scripts/status_params.py 2d7cd61
> ambari-server/src/main/resources/common-services/AMBARI_METRICS/0.1.0/package/scripts/params.py f9fb396
> ambari-server/src/main/resources/common-services/AMBARI_METRICS/0.1.0/package/scripts/status_params.py 5ce3d4f
> ambari-server/src/main/resources/common-services/FALCON/0.5.0.2.1/package/scripts/params_linux.py e986fdd
> ambari-server/src/main/resources/common-services/FALCON/0.5.0.2.1/package/scripts/status_params.py bc3d21e
> ambari-server/src/main/resources/common-services/HBASE/0.96.0.2.0/package/scripts/params_linux.py 98f0473
> ambari-server/src/main/resources/common-services/HBASE/0.96.0.2.0/package/scripts/status_params.py 14a06d3
> ambari-server/src/main/resources/common-services/HDFS/2.1.0.2.0/package/scripts/namenode.py 63639c4
> ambari-server/src/main/resources/common-services/HDFS/2.1.0.2.0/package/scripts/params_linux.py 7611ec1
> ambari-server/src/main/resources/common-services/HDFS/2.1.0.2.0/package/scripts/status_params.py 66332bb
> ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/alerts/alert_hive_metastore.py 3d1e18e
> ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/alerts/alert_hive_thrift_port.py 96d68b3
> ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/alerts/alert_webhcat_server.py fb6c4c2
> ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/scripts/params.py e4e52b8
> ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/scripts/status_params.py 3b75b98
> ambari-server/src/main/resources/common-services/KERBEROS/1.10.3-10/package/scripts/kerberos_common.py e3032bd
> ambari-server/src/main/resources/common-services/KERBEROS/1.10.3-10/package/scripts/service_check.py 738d511
> ambari-server/src/main/resources/common-services/KERBEROS/1.10.3-10/package/scripts/status_params.py 1c73f40
> ambari-server/src/main/resources/common-services/KNOX/0.5.0.2.2/package/scripts/params.py 6fc4fb0
> ambari-server/src/main/resources/common-services/KNOX/0.5.0.2.2/package/scripts/status_params.py f420ba6
> ambari-server/src/main/resources/common-services/MAHOUT/1.0.0.2.3/package/scripts/params.py 874de56
> ambari-server/src/main/resources/common-services/OOZIE/4.0.0.2.0/package/alerts/alert_check_oozie_server.py 9e65e6b
> ambari-server/src/main/resources/common-services/OOZIE/4.0.0.2.0/package/scripts/params_linux.py c9ae569
> ambari-server/src/main/resources/common-services/OOZIE/4.0.0.2.0/package/scripts/status_params.py 5ae57fe
> ambari-server/src/main/resources/common-services/PIG/0.12.0.2.0/package/scripts/params_linux.py 2be49fa
> ambari-server/src/main/resources/common-services/SLIDER/0.60.0.2.2/package/scripts/params.py c05de5a
> ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/params.py 8d2d285
> ambari-server/src/main/resources/common-services/SQOOP/1.4.4.2.0/package/scripts/params_linux.py d5278c4
> ambari-server/src/main/resources/common-services/STORM/0.9.1.2.1/package/scripts/status_params.py 2c06d16
> ambari-server/src/main/resources/common-services/TEZ/0.4.0.2.1/package/scripts/params_linux.py 3245ff0
> ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/package/scripts/params.py 871162a
> ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/package/scripts/status_params.py 5ed99fd
> ambari-server/src/main/resources/common-services/ZOOKEEPER/3.4.5.2.0/package/scripts/params_linux.py ef92b76
> ambari-server/src/main/resources/common-services/ZOOKEEPER/3.4.5.2.0/package/scripts/status_params.py 5b2c953
> ambari-server/src/main/resources/stacks/BIGTOP/0.8/services/HBASE/package/scripts/params.py 88e02e7
> ambari-server/src/main/resources/stacks/BIGTOP/0.8/services/HDFS/package/scripts/params.py 7360835
> ambari-server/src/main/resources/stacks/BIGTOP/0.8/services/HIVE/package/files/alert_hive_thrift_port.py 96d68b3
> ambari-server/src/main/resources/stacks/BIGTOP/0.8/services/HIVE/package/scripts/params.py 9dd7f89
> ambari-server/src/main/resources/stacks/BIGTOP/0.8/services/OOZIE/package/files/alert_check_oozie_server.py 9e2775b
> ambari-server/src/main/resources/stacks/BIGTOP/0.8/services/OOZIE/package/scripts/params.py a7236ce
> ambari-server/src/main/resources/stacks/BIGTOP/0.8/services/PIG/package/scripts/params.py b2c5441
> ambari-server/src/main/resources/stacks/BIGTOP/0.8/services/WEBHCAT/package/files/alert_webhcat_server.py fb6c4c2
> ambari-server/src/main/resources/stacks/BIGTOP/0.8/services/YARN/package/scripts/params.py 5a31518
> ambari-server/src/main/resources/stacks/BIGTOP/0.8/services/ZOOKEEPER/package/scripts/params.py a0d504b
> ambari-server/src/main/resources/stacks/HDP/2.0.6.GlusterFS/services/YARN/package/scripts/params.py 55fda42
> ambari-server/src/main/resources/stacks/HDP/2.1.GlusterFS/services/FALCON/package/scripts/params.py 78d22b4
> ambari-server/src/main/resources/stacks/HDP/2.1.GlusterFS/services/YARN/package/scripts/params.py 55fda42
> ambari-server/src/main/resources/stacks/HDP/2.2.GlusterFS/services/KNOX/package/scripts/params.py b5c61e8
> ambari-server/src/main/resources/stacks/HDP/2.2.GlusterFS/services/SLIDER/package/scripts/params.py 9b6731e
> ambari-server/src/main/resources/stacks/HDPWIN/2.1/services/YARN/package/scripts/params.py e48655d
> ambari-server/src/main/resources/stacks/PHD/3.0.0.0/services/HBASE/package/scripts/params.py f745e39
> ambari-server/src/main/resources/stacks/PHD/3.0.0.0/services/HDFS/package/scripts/params.py 91aca2f
> ambari-server/src/main/resources/stacks/PHD/3.0.0.0/services/HIVE/package/scripts/params.py fed3287
> ambari-server/src/main/resources/stacks/PHD/3.0.0.0/services/NAGIOS/package/scripts/params.py 8bec940
> ambari-server/src/main/resources/stacks/PHD/3.0.0.0/services/OOZIE/package/scripts/params.py b46ab73
> ambari-server/src/main/resources/stacks/PHD/3.0.0.0/services/PIG/package/scripts/params.py 6284aed
> ambari-server/src/main/resources/stacks/PHD/3.0.0.0/services/YARN/package/scripts/params.py 23bbc39
> ambari-server/src/main/resources/stacks/PHD/3.0.0.0/services/ZOOKEEPER/package/scripts/params.py fdf7ddc
> ambari-server/src/test/resources/TestAmbaryServer.samples/dummy_common_services/HIVE/0.11.0.2.0.5.0/package/scripts/params.py a49e231
> ambari-server/src/test/resources/TestAmbaryServer.samples/dummy_stack/HIVE/package/scripts/params.py a49e231
> ambari-server/src/test/resources/stacks/HDP/2.0.7/services/HIVE/package/scripts/params.py 7817a4d
>
> Diff: https://reviews.apache.org/r/33130/diff/
>
>
> Testing
> -------
>
> Manually tested to see custom Kerberos executables (kadmin, kinit, klist, etc...) were found in custom path
>
> #Jenkins test results: PENDING
>
>
> Thanks,
>
> Robert Levas
>
>
Re: Review Request 33130: Ambari unable to start services using
non-default kinit_path_local
Posted by Andrew Onischuk <ao...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/33130/#review79985
-----------------------------------------------------------
Ship it!
Ship It!
- Andrew Onischuk
On April 13, 2015, 2:10 p.m., Robert Levas wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/33130/
> -----------------------------------------------------------
>
> (Updated April 13, 2015, 2:10 p.m.)
>
>
> Review request for Ambari, Andrew Onischuk, Jonathan Hurley, and Vitalyi Brodetskyi.
>
>
> Bugs: AMBARI-10452
> https://issues.apache.org/jira/browse/AMBARI-10452
>
>
> Repository: ambari
>
>
> Description
> -------
>
> PROBLEM: Ambari is unable to start services after running the Enable Security wizard on a cluster that uses a non-standard path to the Kerberos utilities, such as kinit.
>
> STEPS TO REPRODUCE:
> 1. Start with non-Kerberized cluster (2.2 Sandbox works fine)
> 2. Move Kerberos utilities from /usr/bin/ to a new location, example: /usr/myorg/bin/
> 3. Run 'Enable Security' wizard in Ambari, specify new path for kinit, Apply
> 4. Watch 'Start All Services' step fail
> 5. Attempt to 'Restart all components with Stale Configs for HDFS,' which fails with the following error:
>
> Fail: Execution of ' -kt /etc/security/keytabs/hdfs.headless.keytab hdfs' returned 127. -bash: -kt: command not found
>
> Due to the error that occurs with trying to manually restart the HDFS service, it seems like kinit_path_local is empty when the path to kinit is modified. It looks like each service uses the function from:
> ./ambari-common/src/main/python/resource_management/libraries/functions/get_kinit_path.py
>
> But typically only these three hardcoded paths are passed to that function:
> /usr/bin, /usr/kerberos/bin, /usr/sbin
>
> The custom path defined in Ambari is never passed to that function, so the result is always empty.
>
>
> Diffs
> -----
>
> ambari-agent/src/main/python/ambari_agent/alerts/web_alert.py ab68560
> ambari-common/src/main/python/resource_management/libraries/functions/find_executable.py ad5eb0c
> ambari-common/src/main/python/resource_management/libraries/functions/find_path.py 45f2269
> ambari-server/src/main/resources/common-services/ACCUMULO/1.6.1.2.2.0/package/scripts/status_params.py 2d7cd61
> ambari-server/src/main/resources/common-services/AMBARI_METRICS/0.1.0/package/scripts/params.py f9fb396
> ambari-server/src/main/resources/common-services/AMBARI_METRICS/0.1.0/package/scripts/status_params.py 5ce3d4f
> ambari-server/src/main/resources/common-services/FALCON/0.5.0.2.1/package/scripts/params_linux.py e986fdd
> ambari-server/src/main/resources/common-services/FALCON/0.5.0.2.1/package/scripts/status_params.py bc3d21e
> ambari-server/src/main/resources/common-services/HBASE/0.96.0.2.0/package/scripts/params_linux.py 98f0473
> ambari-server/src/main/resources/common-services/HBASE/0.96.0.2.0/package/scripts/status_params.py 14a06d3
> ambari-server/src/main/resources/common-services/HDFS/2.1.0.2.0/package/scripts/namenode.py 63639c4
> ambari-server/src/main/resources/common-services/HDFS/2.1.0.2.0/package/scripts/params_linux.py 7611ec1
> ambari-server/src/main/resources/common-services/HDFS/2.1.0.2.0/package/scripts/status_params.py 66332bb
> ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/alerts/alert_hive_metastore.py 3d1e18e
> ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/alerts/alert_hive_thrift_port.py 96d68b3
> ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/alerts/alert_webhcat_server.py fb6c4c2
> ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/scripts/params.py e4e52b8
> ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/scripts/status_params.py 3b75b98
> ambari-server/src/main/resources/common-services/KERBEROS/1.10.3-10/package/scripts/kerberos_common.py e3032bd
> ambari-server/src/main/resources/common-services/KERBEROS/1.10.3-10/package/scripts/service_check.py 738d511
> ambari-server/src/main/resources/common-services/KERBEROS/1.10.3-10/package/scripts/status_params.py 1c73f40
> ambari-server/src/main/resources/common-services/KNOX/0.5.0.2.2/package/scripts/params.py 6fc4fb0
> ambari-server/src/main/resources/common-services/KNOX/0.5.0.2.2/package/scripts/status_params.py f420ba6
> ambari-server/src/main/resources/common-services/MAHOUT/1.0.0.2.3/package/scripts/params.py 874de56
> ambari-server/src/main/resources/common-services/OOZIE/4.0.0.2.0/package/alerts/alert_check_oozie_server.py 9e65e6b
> ambari-server/src/main/resources/common-services/OOZIE/4.0.0.2.0/package/scripts/params_linux.py c9ae569
> ambari-server/src/main/resources/common-services/OOZIE/4.0.0.2.0/package/scripts/status_params.py 5ae57fe
> ambari-server/src/main/resources/common-services/PIG/0.12.0.2.0/package/scripts/params_linux.py 2be49fa
> ambari-server/src/main/resources/common-services/SLIDER/0.60.0.2.2/package/scripts/params.py c05de5a
> ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/params.py 8d2d285
> ambari-server/src/main/resources/common-services/SQOOP/1.4.4.2.0/package/scripts/params_linux.py d5278c4
> ambari-server/src/main/resources/common-services/STORM/0.9.1.2.1/package/scripts/status_params.py 2c06d16
> ambari-server/src/main/resources/common-services/TEZ/0.4.0.2.1/package/scripts/params_linux.py 3245ff0
> ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/package/scripts/params.py 871162a
> ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/package/scripts/status_params.py 5ed99fd
> ambari-server/src/main/resources/common-services/ZOOKEEPER/3.4.5.2.0/package/scripts/params_linux.py ef92b76
> ambari-server/src/main/resources/common-services/ZOOKEEPER/3.4.5.2.0/package/scripts/status_params.py 5b2c953
> ambari-server/src/main/resources/stacks/BIGTOP/0.8/services/HBASE/package/scripts/params.py 88e02e7
> ambari-server/src/main/resources/stacks/BIGTOP/0.8/services/HDFS/package/scripts/params.py 7360835
> ambari-server/src/main/resources/stacks/BIGTOP/0.8/services/HIVE/package/files/alert_hive_thrift_port.py 96d68b3
> ambari-server/src/main/resources/stacks/BIGTOP/0.8/services/HIVE/package/scripts/params.py 9dd7f89
> ambari-server/src/main/resources/stacks/BIGTOP/0.8/services/OOZIE/package/files/alert_check_oozie_server.py 9e2775b
> ambari-server/src/main/resources/stacks/BIGTOP/0.8/services/OOZIE/package/scripts/params.py a7236ce
> ambari-server/src/main/resources/stacks/BIGTOP/0.8/services/PIG/package/scripts/params.py b2c5441
> ambari-server/src/main/resources/stacks/BIGTOP/0.8/services/WEBHCAT/package/files/alert_webhcat_server.py fb6c4c2
> ambari-server/src/main/resources/stacks/BIGTOP/0.8/services/YARN/package/scripts/params.py 5a31518
> ambari-server/src/main/resources/stacks/BIGTOP/0.8/services/ZOOKEEPER/package/scripts/params.py a0d504b
> ambari-server/src/main/resources/stacks/HDP/2.0.6.GlusterFS/services/YARN/package/scripts/params.py 55fda42
> ambari-server/src/main/resources/stacks/HDP/2.1.GlusterFS/services/FALCON/package/scripts/params.py 78d22b4
> ambari-server/src/main/resources/stacks/HDP/2.1.GlusterFS/services/YARN/package/scripts/params.py 55fda42
> ambari-server/src/main/resources/stacks/HDP/2.2.GlusterFS/services/KNOX/package/scripts/params.py b5c61e8
> ambari-server/src/main/resources/stacks/HDP/2.2.GlusterFS/services/SLIDER/package/scripts/params.py 9b6731e
> ambari-server/src/main/resources/stacks/HDPWIN/2.1/services/YARN/package/scripts/params.py e48655d
> ambari-server/src/main/resources/stacks/PHD/3.0.0.0/services/HBASE/package/scripts/params.py f745e39
> ambari-server/src/main/resources/stacks/PHD/3.0.0.0/services/HDFS/package/scripts/params.py 91aca2f
> ambari-server/src/main/resources/stacks/PHD/3.0.0.0/services/HIVE/package/scripts/params.py fed3287
> ambari-server/src/main/resources/stacks/PHD/3.0.0.0/services/NAGIOS/package/scripts/params.py 8bec940
> ambari-server/src/main/resources/stacks/PHD/3.0.0.0/services/OOZIE/package/scripts/params.py b46ab73
> ambari-server/src/main/resources/stacks/PHD/3.0.0.0/services/PIG/package/scripts/params.py 6284aed
> ambari-server/src/main/resources/stacks/PHD/3.0.0.0/services/YARN/package/scripts/params.py 23bbc39
> ambari-server/src/main/resources/stacks/PHD/3.0.0.0/services/ZOOKEEPER/package/scripts/params.py fdf7ddc
> ambari-server/src/test/resources/TestAmbaryServer.samples/dummy_common_services/HIVE/0.11.0.2.0.5.0/package/scripts/params.py a49e231
> ambari-server/src/test/resources/TestAmbaryServer.samples/dummy_stack/HIVE/package/scripts/params.py a49e231
> ambari-server/src/test/resources/stacks/HDP/2.0.7/services/HIVE/package/scripts/params.py 7817a4d
>
> Diff: https://reviews.apache.org/r/33130/diff/
>
>
> Testing
> -------
>
> Manually tested to see custom Kerberos executables (kadmin, kinit, klist, etc...) were found in custom path
>
> #Jenkins test results: PENDING
>
>
> Thanks,
>
> Robert Levas
>
>
Re: Review Request 33130: Ambari unable to start services using
non-default kinit_path_local
Posted by Robert Levas <rl...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/33130/
-----------------------------------------------------------
(Updated April 13, 2015, 10:10 a.m.)
Review request for Ambari, Andrew Onischuk, Jonathan Hurley, and Vitalyi Brodetskyi.
Changes
-------
Fixed merge issue.
Bugs: AMBARI-10452
https://issues.apache.org/jira/browse/AMBARI-10452
Repository: ambari
Description
-------
PROBLEM: Ambari is unable to start services after running the Enable Security wizard on a cluster that uses a non-standard path to the Kerberos utilities, such as kinit.
STEPS TO REPRODUCE:
1. Start with non-Kerberized cluster (2.2 Sandbox works fine)
2. Move Kerberos utilities from /usr/bin/ to a new location, example: /usr/myorg/bin/
3. Run 'Enable Security' wizard in Ambari, specify new path for kinit, Apply
4. Watch 'Start All Services' step fail
5. Attempt to 'Restart all components with Stale Configs for HDFS,' which fails with the following error:
Fail: Execution of ' -kt /etc/security/keytabs/hdfs.headless.keytab hdfs' returned 127. -bash: -kt: command not found
Due to the error that occurs with trying to manually restart the HDFS service, it seems like kinit_path_local is empty when the path to kinit is modified. It looks like each service uses the function from:
./ambari-common/src/main/python/resource_management/libraries/functions/get_kinit_path.py
But typically only these three hardcoded paths are passed to that function:
/usr/bin, /usr/kerberos/bin, /usr/sbin
The custom path defined in Ambari is never passed to that function, so the result is always empty.
Diffs (updated)
-----
ambari-agent/src/main/python/ambari_agent/alerts/web_alert.py ab68560
ambari-common/src/main/python/resource_management/libraries/functions/find_executable.py ad5eb0c
ambari-common/src/main/python/resource_management/libraries/functions/find_path.py 45f2269
ambari-server/src/main/resources/common-services/ACCUMULO/1.6.1.2.2.0/package/scripts/status_params.py 2d7cd61
ambari-server/src/main/resources/common-services/AMBARI_METRICS/0.1.0/package/scripts/params.py f9fb396
ambari-server/src/main/resources/common-services/AMBARI_METRICS/0.1.0/package/scripts/status_params.py 5ce3d4f
ambari-server/src/main/resources/common-services/FALCON/0.5.0.2.1/package/scripts/params_linux.py e986fdd
ambari-server/src/main/resources/common-services/FALCON/0.5.0.2.1/package/scripts/status_params.py bc3d21e
ambari-server/src/main/resources/common-services/HBASE/0.96.0.2.0/package/scripts/params_linux.py 98f0473
ambari-server/src/main/resources/common-services/HBASE/0.96.0.2.0/package/scripts/status_params.py 14a06d3
ambari-server/src/main/resources/common-services/HDFS/2.1.0.2.0/package/scripts/namenode.py 63639c4
ambari-server/src/main/resources/common-services/HDFS/2.1.0.2.0/package/scripts/params_linux.py 7611ec1
ambari-server/src/main/resources/common-services/HDFS/2.1.0.2.0/package/scripts/status_params.py 66332bb
ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/alerts/alert_hive_metastore.py 3d1e18e
ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/alerts/alert_hive_thrift_port.py 96d68b3
ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/alerts/alert_webhcat_server.py fb6c4c2
ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/scripts/params.py e4e52b8
ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/scripts/status_params.py 3b75b98
ambari-server/src/main/resources/common-services/KERBEROS/1.10.3-10/package/scripts/kerberos_common.py e3032bd
ambari-server/src/main/resources/common-services/KERBEROS/1.10.3-10/package/scripts/service_check.py 738d511
ambari-server/src/main/resources/common-services/KERBEROS/1.10.3-10/package/scripts/status_params.py 1c73f40
ambari-server/src/main/resources/common-services/KNOX/0.5.0.2.2/package/scripts/params.py 6fc4fb0
ambari-server/src/main/resources/common-services/KNOX/0.5.0.2.2/package/scripts/status_params.py f420ba6
ambari-server/src/main/resources/common-services/MAHOUT/1.0.0.2.3/package/scripts/params.py 874de56
ambari-server/src/main/resources/common-services/OOZIE/4.0.0.2.0/package/alerts/alert_check_oozie_server.py 9e65e6b
ambari-server/src/main/resources/common-services/OOZIE/4.0.0.2.0/package/scripts/params_linux.py c9ae569
ambari-server/src/main/resources/common-services/OOZIE/4.0.0.2.0/package/scripts/status_params.py 5ae57fe
ambari-server/src/main/resources/common-services/PIG/0.12.0.2.0/package/scripts/params_linux.py 2be49fa
ambari-server/src/main/resources/common-services/SLIDER/0.60.0.2.2/package/scripts/params.py c05de5a
ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/params.py 8d2d285
ambari-server/src/main/resources/common-services/SQOOP/1.4.4.2.0/package/scripts/params_linux.py d5278c4
ambari-server/src/main/resources/common-services/STORM/0.9.1.2.1/package/scripts/status_params.py 2c06d16
ambari-server/src/main/resources/common-services/TEZ/0.4.0.2.1/package/scripts/params_linux.py 3245ff0
ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/package/scripts/params.py 871162a
ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/package/scripts/status_params.py 5ed99fd
ambari-server/src/main/resources/common-services/ZOOKEEPER/3.4.5.2.0/package/scripts/params_linux.py ef92b76
ambari-server/src/main/resources/common-services/ZOOKEEPER/3.4.5.2.0/package/scripts/status_params.py 5b2c953
ambari-server/src/main/resources/stacks/BIGTOP/0.8/services/HBASE/package/scripts/params.py 88e02e7
ambari-server/src/main/resources/stacks/BIGTOP/0.8/services/HDFS/package/scripts/params.py 7360835
ambari-server/src/main/resources/stacks/BIGTOP/0.8/services/HIVE/package/files/alert_hive_thrift_port.py 96d68b3
ambari-server/src/main/resources/stacks/BIGTOP/0.8/services/HIVE/package/scripts/params.py 9dd7f89
ambari-server/src/main/resources/stacks/BIGTOP/0.8/services/OOZIE/package/files/alert_check_oozie_server.py 9e2775b
ambari-server/src/main/resources/stacks/BIGTOP/0.8/services/OOZIE/package/scripts/params.py a7236ce
ambari-server/src/main/resources/stacks/BIGTOP/0.8/services/PIG/package/scripts/params.py b2c5441
ambari-server/src/main/resources/stacks/BIGTOP/0.8/services/WEBHCAT/package/files/alert_webhcat_server.py fb6c4c2
ambari-server/src/main/resources/stacks/BIGTOP/0.8/services/YARN/package/scripts/params.py 5a31518
ambari-server/src/main/resources/stacks/BIGTOP/0.8/services/ZOOKEEPER/package/scripts/params.py a0d504b
ambari-server/src/main/resources/stacks/HDP/2.0.6.GlusterFS/services/YARN/package/scripts/params.py 55fda42
ambari-server/src/main/resources/stacks/HDP/2.1.GlusterFS/services/FALCON/package/scripts/params.py 78d22b4
ambari-server/src/main/resources/stacks/HDP/2.1.GlusterFS/services/YARN/package/scripts/params.py 55fda42
ambari-server/src/main/resources/stacks/HDP/2.2.GlusterFS/services/KNOX/package/scripts/params.py b5c61e8
ambari-server/src/main/resources/stacks/HDP/2.2.GlusterFS/services/SLIDER/package/scripts/params.py 9b6731e
ambari-server/src/main/resources/stacks/HDPWIN/2.1/services/YARN/package/scripts/params.py e48655d
ambari-server/src/main/resources/stacks/PHD/3.0.0.0/services/HBASE/package/scripts/params.py f745e39
ambari-server/src/main/resources/stacks/PHD/3.0.0.0/services/HDFS/package/scripts/params.py 91aca2f
ambari-server/src/main/resources/stacks/PHD/3.0.0.0/services/HIVE/package/scripts/params.py fed3287
ambari-server/src/main/resources/stacks/PHD/3.0.0.0/services/NAGIOS/package/scripts/params.py 8bec940
ambari-server/src/main/resources/stacks/PHD/3.0.0.0/services/OOZIE/package/scripts/params.py b46ab73
ambari-server/src/main/resources/stacks/PHD/3.0.0.0/services/PIG/package/scripts/params.py 6284aed
ambari-server/src/main/resources/stacks/PHD/3.0.0.0/services/YARN/package/scripts/params.py 23bbc39
ambari-server/src/main/resources/stacks/PHD/3.0.0.0/services/ZOOKEEPER/package/scripts/params.py fdf7ddc
ambari-server/src/test/resources/TestAmbaryServer.samples/dummy_common_services/HIVE/0.11.0.2.0.5.0/package/scripts/params.py a49e231
ambari-server/src/test/resources/TestAmbaryServer.samples/dummy_stack/HIVE/package/scripts/params.py a49e231
ambari-server/src/test/resources/stacks/HDP/2.0.7/services/HIVE/package/scripts/params.py 7817a4d
Diff: https://reviews.apache.org/r/33130/diff/
Testing
-------
Manually tested to see custom Kerberos executables (kadmin, kinit, klist, etc...) were found in custom path
#Jenkins test results: PENDING
Thanks,
Robert Levas