You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@ambari.apache.org by Dmitro Lisnichenko <dl...@hortonworks.com> on 2014/05/07 22:28:20 UTC
Review Request 21172: Fail to install hive client with error: Fail:
Execution of '/bin/sh -c 'cd /usr/lib/ambari-agent/ && curl -kf --retry 5
http://hadoop1:8080/resources/DBConnectionVerification.jar -o
DBConnectionVerification.jar'' returned 22.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/21172/
-----------------------------------------------------------
Review request for Ambari, Dmytro Sen and Mahadev Konar.
Bugs: AMBARI-5705
https://issues.apache.org/jira/browse/AMBARI-5705
Repository: ambari
Description
-------
PROBLEM: Fresh install of HDP 2.1, when deploying hive client it fail with error: Execution of '/bin/sh -c 'cd /usr/lib/ambari-agent/ && curl -kf --retry 5 http://hadoop1:8080/resources/DBConnectionVerification.jar -o DBConnectionVerification.jar'' returned 22.
Steps to reproduce: set up a proxy (http_proxy="<proxy host that has not access to cluster>").
Fix:
Added
--noproxy <ambari-server hostname>
option to all our curl invocations that download files from ambari-server. I would go for this option because sometimes ftp_proxy may be used as well.
Also, I've fixed an error message that is shown when jce_name property is not defined in a non-secure cluster and added a proper handling of this situation in secure cluster.
Diffs
-----
ambari-server/src/main/java/org/apache/ambari/server/utils/StageUtils.java f8b9636
ambari-server/src/main/resources/stacks/HDP/1.3.2/hooks/before-INSTALL/scripts/params.py f2a4199
ambari-server/src/main/resources/stacks/HDP/1.3.2/hooks/before-INSTALL/scripts/shared_initialization.py 4a0669b
ambari-server/src/main/resources/stacks/HDP/1.3.2/hooks/before-START/scripts/params.py 897e669
ambari-server/src/main/resources/stacks/HDP/1.3.2/hooks/before-START/scripts/shared_initialization.py 3fa511a
ambari-server/src/main/resources/stacks/HDP/1.3.2/services/HIVE/package/scripts/hive.py 5f2f15e
ambari-server/src/main/resources/stacks/HDP/1.3.2/services/HIVE/package/scripts/params.py bf52dba
ambari-server/src/main/resources/stacks/HDP/1.3.2/services/NAGIOS/package/files/check_namenodes_ha.sh 50b075a
ambari-server/src/main/resources/stacks/HDP/1.3.2/services/NAGIOS/package/files/check_nodemanager_health.sh 020b41d
ambari-server/src/main/resources/stacks/HDP/1.3.2/services/NAGIOS/package/files/check_templeton_status.sh 7fbc4c4
ambari-server/src/main/resources/stacks/HDP/1.3.2/services/NAGIOS/package/files/check_webui.sh b23045e
ambari-server/src/main/resources/stacks/HDP/1.3.2/services/OOZIE/package/scripts/oozie.py 6523fbd
ambari-server/src/main/resources/stacks/HDP/1.3.2/services/OOZIE/package/scripts/params.py bb6e27c
ambari-server/src/main/resources/stacks/HDP/1.3.2/services/WEBHCAT/package/files/templetonSmoke.sh cefc4f0
ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-INSTALL/scripts/params.py 1f8bfa8
ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-INSTALL/scripts/shared_initialization.py 8affb55
ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-START/scripts/params.py 91c06f5
ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-START/scripts/shared_initialization.py b91b1a0
ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/scripts/hive.py 42a8610
ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/scripts/params.py ab4aee7
ambari-server/src/main/resources/stacks/HDP/2.0.6/services/NAGIOS/package/files/check_namenodes_ha.sh 50b075a
ambari-server/src/main/resources/stacks/HDP/2.0.6/services/NAGIOS/package/files/check_nodemanager_health.sh 020b41d
ambari-server/src/main/resources/stacks/HDP/2.0.6/services/NAGIOS/package/files/check_templeton_status.sh 7fbc4c4
ambari-server/src/main/resources/stacks/HDP/2.0.6/services/NAGIOS/package/files/check_webui.sh 8116dc5
ambari-server/src/main/resources/stacks/HDP/2.0.6/services/OOZIE/package/scripts/oozie.py 818874d
ambari-server/src/main/resources/stacks/HDP/2.0.6/services/OOZIE/package/scripts/params.py 9a5df00
ambari-server/src/main/resources/stacks/HDP/2.0.6/services/WEBHCAT/package/files/templetonSmoke.sh 304b459
ambari-server/src/test/java/org/apache/ambari/server/utils/TestStageUtils.java ee93431
ambari-server/src/test/python/stacks/1.3.2/HIVE/test_hive_client.py 80a3c5c
ambari-server/src/test/python/stacks/1.3.2/HIVE/test_hive_metastore.py 3914844
ambari-server/src/test/python/stacks/1.3.2/HIVE/test_hive_server.py f5997e4
ambari-server/src/test/python/stacks/1.3.2/configs/default.hbasedecom.json a1f62bd
ambari-server/src/test/python/stacks/1.3.2/configs/default.json 40cdc57
ambari-server/src/test/python/stacks/1.3.2/configs/default.non_gmetad_host.json 00ddf6a
ambari-server/src/test/python/stacks/1.3.2/configs/secured.json 8c5f6b5
ambari-server/src/test/python/stacks/1.3.2/configs/secured.json 8c5f6b5
ambari-server/src/test/python/stacks/1.3.2/hooks/before-INSTALL/test_before_install.py 0215ba2
ambari-server/src/test/python/stacks/2.0.6/HIVE/test_hive_client.py 9c570d1
ambari-server/src/test/python/stacks/2.0.6/HIVE/test_hive_metastore.py 61ef4b5
ambari-server/src/test/python/stacks/2.0.6/HIVE/test_hive_server.py c056591
ambari-server/src/test/python/stacks/2.0.6/configs/default.hbasedecom.json 51e13d0
ambari-server/src/test/python/stacks/2.0.6/configs/default.json c621a6d
ambari-server/src/test/python/stacks/2.0.6/configs/default.non_gmetad_host.json c835c94
ambari-server/src/test/python/stacks/2.0.6/configs/flume_target.json 4bd9aea
ambari-server/src/test/python/stacks/2.0.6/configs/ha_default.json 924ed64
ambari-server/src/test/python/stacks/2.0.6/configs/ha_secured.json e64b87a
ambari-server/src/test/python/stacks/2.0.6/configs/secured.json 9889426
ambari-server/src/test/python/stacks/2.0.6/configs/secured.json 9889426
ambari-server/src/test/python/stacks/2.0.6/hooks/before-INSTALL/test_before_install.py 60c9704
ambari-server/src/test/python/stacks/2.1/HIVE/test_hive_metastore.py 0f1ad88
ambari-server/src/test/python/stacks/2.1/configs/default.json 6400314
ambari-server/src/test/python/stacks/2.1/configs/secured.json 245e5dd
Diff: https://reviews.apache.org/r/21172/diff/
Testing
-------
performed manual cluster installation using 1.3.2 and 2.1 stack.
Unit test run:
[INFO] 63 resources included (use -debug for more details)
[INFO] Rat check: Summary of files. Unapproved: 0 unknown: 0 generated: 0 approved: 34 licence.
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Ambari Main ....................................... SUCCESS [4.221s]
[INFO] Apache Ambari Project POM ......................... SUCCESS [0.322s]
[INFO] Ambari Web ........................................ SUCCESS [9.192s]
[INFO] Ambari Views ...................................... SUCCESS [3.259s]
[INFO] Ambari Server ..................................... SUCCESS [19:02.503s]
[INFO] Ambari Agent ...................................... SUCCESS [9.098s]
[INFO] Ambari Client ..................................... SUCCESS [0.762s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 19:30.050s
[INFO] Finished at: Wed May 07 23:26:36 FET 2014
[INFO] Final Memory: 27M/252M
[INFO] ------------------------------------------------------------------------
Thanks,
Dmitro Lisnichenko
Re: Review Request 21172: Fail to install hive client with error: Fail:
Execution of '/bin/sh -c 'cd /usr/lib/ambari-agent/ && curl -kf --retry 5
http://hadoop1:8080/resources/DBConnectionVerification.jar -o
DBConnectionVerification.jar'' returned 22.
Posted by Dmitro Lisnichenko <dl...@hortonworks.com>.
> On May 8, 2014, 12:03 a.m., Mahadev Konar wrote:
> > ambari-server/src/main/java/org/apache/ambari/server/utils/StageUtils.java, line 242
> > <https://reviews.apache.org/r/21172/diff/1/?file=576277#file576277line242>
> >
> > Why did we change this?
Because at clusterHostInfo we don't send hostnames as strings. We send a complete list of hostnames only at all_hosts field. At other fields we send only integer indexes of hostname at all_hosts list. This optimisation (collapsing hostnames) has been done to reduce heartbeat size on large clusters.
> On May 8, 2014, 12:03 a.m., Mahadev Konar wrote:
> > ambari-server/src/main/resources/stacks/HDP/1.3.2/hooks/before-START/scripts/params.py, line 37
> > <https://reviews.apache.org/r/21172/diff/1/?file=576280#file576280line37>
> >
> > So we are using the same hostname that ambari server is configured with?
Yes. At server, this hostname is a result of InetAddress.getLocalHost().getCanonicalHostName() call
- Dmitro
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/21172/#review42441
-----------------------------------------------------------
On May 7, 2014, 8:28 p.m., Dmitro Lisnichenko wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/21172/
> -----------------------------------------------------------
>
> (Updated May 7, 2014, 8:28 p.m.)
>
>
> Review request for Ambari, Dmytro Sen and Mahadev Konar.
>
>
> Bugs: AMBARI-5705
> https://issues.apache.org/jira/browse/AMBARI-5705
>
>
> Repository: ambari
>
>
> Description
> -------
>
> PROBLEM: Fresh install of HDP 2.1, when deploying hive client it fail with error: Execution of '/bin/sh -c 'cd /usr/lib/ambari-agent/ && curl -kf --retry 5 http://hadoop1:8080/resources/DBConnectionVerification.jar -o DBConnectionVerification.jar'' returned 22.
> Steps to reproduce: set up a proxy (http_proxy="<proxy host that has not access to cluster>").
> Fix:
> Added
> --noproxy <ambari-server hostname>
> option to all our curl invocations that download files from ambari-server. I would go for this option because sometimes ftp_proxy may be used as well.
> Also, I've fixed an error message that is shown when jce_name property is not defined in a non-secure cluster and added a proper handling of this situation in secure cluster.
>
>
> Diffs
> -----
>
> ambari-server/src/main/java/org/apache/ambari/server/utils/StageUtils.java f8b9636
> ambari-server/src/main/resources/stacks/HDP/1.3.2/hooks/before-INSTALL/scripts/params.py f2a4199
> ambari-server/src/main/resources/stacks/HDP/1.3.2/hooks/before-INSTALL/scripts/shared_initialization.py 4a0669b
> ambari-server/src/main/resources/stacks/HDP/1.3.2/hooks/before-START/scripts/params.py 897e669
> ambari-server/src/main/resources/stacks/HDP/1.3.2/hooks/before-START/scripts/shared_initialization.py 3fa511a
> ambari-server/src/main/resources/stacks/HDP/1.3.2/services/HIVE/package/scripts/hive.py 5f2f15e
> ambari-server/src/main/resources/stacks/HDP/1.3.2/services/HIVE/package/scripts/params.py bf52dba
> ambari-server/src/main/resources/stacks/HDP/1.3.2/services/NAGIOS/package/files/check_namenodes_ha.sh 50b075a
> ambari-server/src/main/resources/stacks/HDP/1.3.2/services/NAGIOS/package/files/check_nodemanager_health.sh 020b41d
> ambari-server/src/main/resources/stacks/HDP/1.3.2/services/NAGIOS/package/files/check_templeton_status.sh 7fbc4c4
> ambari-server/src/main/resources/stacks/HDP/1.3.2/services/NAGIOS/package/files/check_webui.sh b23045e
> ambari-server/src/main/resources/stacks/HDP/1.3.2/services/OOZIE/package/scripts/oozie.py 6523fbd
> ambari-server/src/main/resources/stacks/HDP/1.3.2/services/OOZIE/package/scripts/params.py bb6e27c
> ambari-server/src/main/resources/stacks/HDP/1.3.2/services/WEBHCAT/package/files/templetonSmoke.sh cefc4f0
> ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-INSTALL/scripts/params.py 1f8bfa8
> ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-INSTALL/scripts/shared_initialization.py 8affb55
> ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-START/scripts/params.py 91c06f5
> ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-START/scripts/shared_initialization.py b91b1a0
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/scripts/hive.py 42a8610
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/scripts/params.py ab4aee7
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/NAGIOS/package/files/check_namenodes_ha.sh 50b075a
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/NAGIOS/package/files/check_nodemanager_health.sh 020b41d
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/NAGIOS/package/files/check_templeton_status.sh 7fbc4c4
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/NAGIOS/package/files/check_webui.sh 8116dc5
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/OOZIE/package/scripts/oozie.py 818874d
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/OOZIE/package/scripts/params.py 9a5df00
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/WEBHCAT/package/files/templetonSmoke.sh 304b459
> ambari-server/src/test/java/org/apache/ambari/server/utils/TestStageUtils.java ee93431
> ambari-server/src/test/python/stacks/1.3.2/HIVE/test_hive_client.py 80a3c5c
> ambari-server/src/test/python/stacks/1.3.2/HIVE/test_hive_metastore.py 3914844
> ambari-server/src/test/python/stacks/1.3.2/HIVE/test_hive_server.py f5997e4
> ambari-server/src/test/python/stacks/1.3.2/configs/default.hbasedecom.json a1f62bd
> ambari-server/src/test/python/stacks/1.3.2/configs/default.json 40cdc57
> ambari-server/src/test/python/stacks/1.3.2/configs/default.non_gmetad_host.json 00ddf6a
> ambari-server/src/test/python/stacks/1.3.2/configs/secured.json 8c5f6b5
> ambari-server/src/test/python/stacks/1.3.2/configs/secured.json 8c5f6b5
> ambari-server/src/test/python/stacks/1.3.2/hooks/before-INSTALL/test_before_install.py 0215ba2
> ambari-server/src/test/python/stacks/2.0.6/HIVE/test_hive_client.py 9c570d1
> ambari-server/src/test/python/stacks/2.0.6/HIVE/test_hive_metastore.py 61ef4b5
> ambari-server/src/test/python/stacks/2.0.6/HIVE/test_hive_server.py c056591
> ambari-server/src/test/python/stacks/2.0.6/configs/default.hbasedecom.json 51e13d0
> ambari-server/src/test/python/stacks/2.0.6/configs/default.json c621a6d
> ambari-server/src/test/python/stacks/2.0.6/configs/default.non_gmetad_host.json c835c94
> ambari-server/src/test/python/stacks/2.0.6/configs/flume_target.json 4bd9aea
> ambari-server/src/test/python/stacks/2.0.6/configs/ha_default.json 924ed64
> ambari-server/src/test/python/stacks/2.0.6/configs/ha_secured.json e64b87a
> ambari-server/src/test/python/stacks/2.0.6/configs/secured.json 9889426
> ambari-server/src/test/python/stacks/2.0.6/configs/secured.json 9889426
> ambari-server/src/test/python/stacks/2.0.6/hooks/before-INSTALL/test_before_install.py 60c9704
> ambari-server/src/test/python/stacks/2.1/HIVE/test_hive_metastore.py 0f1ad88
> ambari-server/src/test/python/stacks/2.1/configs/default.json 6400314
> ambari-server/src/test/python/stacks/2.1/configs/secured.json 245e5dd
>
> Diff: https://reviews.apache.org/r/21172/diff/
>
>
> Testing
> -------
>
> performed manual cluster installation using 1.3.2 and 2.1 stack.
>
> Unit test run:
> [INFO] 63 resources included (use -debug for more details)
> [INFO] Rat check: Summary of files. Unapproved: 0 unknown: 0 generated: 0 approved: 34 licence.
> [INFO] ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO]
> [INFO] Ambari Main ....................................... SUCCESS [4.221s]
> [INFO] Apache Ambari Project POM ......................... SUCCESS [0.322s]
> [INFO] Ambari Web ........................................ SUCCESS [9.192s]
> [INFO] Ambari Views ...................................... SUCCESS [3.259s]
> [INFO] Ambari Server ..................................... SUCCESS [19:02.503s]
> [INFO] Ambari Agent ...................................... SUCCESS [9.098s]
> [INFO] Ambari Client ..................................... SUCCESS [0.762s]
> [INFO] ------------------------------------------------------------------------
> [INFO] BUILD SUCCESS
> [INFO] ------------------------------------------------------------------------
> [INFO] Total time: 19:30.050s
> [INFO] Finished at: Wed May 07 23:26:36 FET 2014
> [INFO] Final Memory: 27M/252M
> [INFO] ------------------------------------------------------------------------
>
>
> Thanks,
>
> Dmitro Lisnichenko
>
>
Re: Review Request 21172: Fail to install hive client with error: Fail:
Execution of '/bin/sh -c 'cd /usr/lib/ambari-agent/ && curl -kf --retry 5
http://hadoop1:8080/resources/DBConnectionVerification.jar -o
DBConnectionVerification.jar'' returned 22.
Posted by Mahadev Konar <ma...@apache.org>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/21172/#review42441
-----------------------------------------------------------
ambari-server/src/main/java/org/apache/ambari/server/utils/StageUtils.java
<https://reviews.apache.org/r/21172/#comment76245>
Why did we change this?
ambari-server/src/main/resources/stacks/HDP/1.3.2/hooks/before-START/scripts/params.py
<https://reviews.apache.org/r/21172/#comment76246>
So we are using the same hostname that ambari server is configured with?
- Mahadev Konar
On May 7, 2014, 8:28 p.m., Dmitro Lisnichenko wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/21172/
> -----------------------------------------------------------
>
> (Updated May 7, 2014, 8:28 p.m.)
>
>
> Review request for Ambari, Dmytro Sen and Mahadev Konar.
>
>
> Bugs: AMBARI-5705
> https://issues.apache.org/jira/browse/AMBARI-5705
>
>
> Repository: ambari
>
>
> Description
> -------
>
> PROBLEM: Fresh install of HDP 2.1, when deploying hive client it fail with error: Execution of '/bin/sh -c 'cd /usr/lib/ambari-agent/ && curl -kf --retry 5 http://hadoop1:8080/resources/DBConnectionVerification.jar -o DBConnectionVerification.jar'' returned 22.
> Steps to reproduce: set up a proxy (http_proxy="<proxy host that has not access to cluster>").
> Fix:
> Added
> --noproxy <ambari-server hostname>
> option to all our curl invocations that download files from ambari-server. I would go for this option because sometimes ftp_proxy may be used as well.
> Also, I've fixed an error message that is shown when jce_name property is not defined in a non-secure cluster and added a proper handling of this situation in secure cluster.
>
>
> Diffs
> -----
>
> ambari-server/src/main/java/org/apache/ambari/server/utils/StageUtils.java f8b9636
> ambari-server/src/main/resources/stacks/HDP/1.3.2/hooks/before-INSTALL/scripts/params.py f2a4199
> ambari-server/src/main/resources/stacks/HDP/1.3.2/hooks/before-INSTALL/scripts/shared_initialization.py 4a0669b
> ambari-server/src/main/resources/stacks/HDP/1.3.2/hooks/before-START/scripts/params.py 897e669
> ambari-server/src/main/resources/stacks/HDP/1.3.2/hooks/before-START/scripts/shared_initialization.py 3fa511a
> ambari-server/src/main/resources/stacks/HDP/1.3.2/services/HIVE/package/scripts/hive.py 5f2f15e
> ambari-server/src/main/resources/stacks/HDP/1.3.2/services/HIVE/package/scripts/params.py bf52dba
> ambari-server/src/main/resources/stacks/HDP/1.3.2/services/NAGIOS/package/files/check_namenodes_ha.sh 50b075a
> ambari-server/src/main/resources/stacks/HDP/1.3.2/services/NAGIOS/package/files/check_nodemanager_health.sh 020b41d
> ambari-server/src/main/resources/stacks/HDP/1.3.2/services/NAGIOS/package/files/check_templeton_status.sh 7fbc4c4
> ambari-server/src/main/resources/stacks/HDP/1.3.2/services/NAGIOS/package/files/check_webui.sh b23045e
> ambari-server/src/main/resources/stacks/HDP/1.3.2/services/OOZIE/package/scripts/oozie.py 6523fbd
> ambari-server/src/main/resources/stacks/HDP/1.3.2/services/OOZIE/package/scripts/params.py bb6e27c
> ambari-server/src/main/resources/stacks/HDP/1.3.2/services/WEBHCAT/package/files/templetonSmoke.sh cefc4f0
> ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-INSTALL/scripts/params.py 1f8bfa8
> ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-INSTALL/scripts/shared_initialization.py 8affb55
> ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-START/scripts/params.py 91c06f5
> ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-START/scripts/shared_initialization.py b91b1a0
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/scripts/hive.py 42a8610
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/scripts/params.py ab4aee7
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/NAGIOS/package/files/check_namenodes_ha.sh 50b075a
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/NAGIOS/package/files/check_nodemanager_health.sh 020b41d
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/NAGIOS/package/files/check_templeton_status.sh 7fbc4c4
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/NAGIOS/package/files/check_webui.sh 8116dc5
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/OOZIE/package/scripts/oozie.py 818874d
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/OOZIE/package/scripts/params.py 9a5df00
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/WEBHCAT/package/files/templetonSmoke.sh 304b459
> ambari-server/src/test/java/org/apache/ambari/server/utils/TestStageUtils.java ee93431
> ambari-server/src/test/python/stacks/1.3.2/HIVE/test_hive_client.py 80a3c5c
> ambari-server/src/test/python/stacks/1.3.2/HIVE/test_hive_metastore.py 3914844
> ambari-server/src/test/python/stacks/1.3.2/HIVE/test_hive_server.py f5997e4
> ambari-server/src/test/python/stacks/1.3.2/configs/default.hbasedecom.json a1f62bd
> ambari-server/src/test/python/stacks/1.3.2/configs/default.json 40cdc57
> ambari-server/src/test/python/stacks/1.3.2/configs/default.non_gmetad_host.json 00ddf6a
> ambari-server/src/test/python/stacks/1.3.2/configs/secured.json 8c5f6b5
> ambari-server/src/test/python/stacks/1.3.2/configs/secured.json 8c5f6b5
> ambari-server/src/test/python/stacks/1.3.2/hooks/before-INSTALL/test_before_install.py 0215ba2
> ambari-server/src/test/python/stacks/2.0.6/HIVE/test_hive_client.py 9c570d1
> ambari-server/src/test/python/stacks/2.0.6/HIVE/test_hive_metastore.py 61ef4b5
> ambari-server/src/test/python/stacks/2.0.6/HIVE/test_hive_server.py c056591
> ambari-server/src/test/python/stacks/2.0.6/configs/default.hbasedecom.json 51e13d0
> ambari-server/src/test/python/stacks/2.0.6/configs/default.json c621a6d
> ambari-server/src/test/python/stacks/2.0.6/configs/default.non_gmetad_host.json c835c94
> ambari-server/src/test/python/stacks/2.0.6/configs/flume_target.json 4bd9aea
> ambari-server/src/test/python/stacks/2.0.6/configs/ha_default.json 924ed64
> ambari-server/src/test/python/stacks/2.0.6/configs/ha_secured.json e64b87a
> ambari-server/src/test/python/stacks/2.0.6/configs/secured.json 9889426
> ambari-server/src/test/python/stacks/2.0.6/configs/secured.json 9889426
> ambari-server/src/test/python/stacks/2.0.6/hooks/before-INSTALL/test_before_install.py 60c9704
> ambari-server/src/test/python/stacks/2.1/HIVE/test_hive_metastore.py 0f1ad88
> ambari-server/src/test/python/stacks/2.1/configs/default.json 6400314
> ambari-server/src/test/python/stacks/2.1/configs/secured.json 245e5dd
>
> Diff: https://reviews.apache.org/r/21172/diff/
>
>
> Testing
> -------
>
> performed manual cluster installation using 1.3.2 and 2.1 stack.
>
> Unit test run:
> [INFO] 63 resources included (use -debug for more details)
> [INFO] Rat check: Summary of files. Unapproved: 0 unknown: 0 generated: 0 approved: 34 licence.
> [INFO] ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO]
> [INFO] Ambari Main ....................................... SUCCESS [4.221s]
> [INFO] Apache Ambari Project POM ......................... SUCCESS [0.322s]
> [INFO] Ambari Web ........................................ SUCCESS [9.192s]
> [INFO] Ambari Views ...................................... SUCCESS [3.259s]
> [INFO] Ambari Server ..................................... SUCCESS [19:02.503s]
> [INFO] Ambari Agent ...................................... SUCCESS [9.098s]
> [INFO] Ambari Client ..................................... SUCCESS [0.762s]
> [INFO] ------------------------------------------------------------------------
> [INFO] BUILD SUCCESS
> [INFO] ------------------------------------------------------------------------
> [INFO] Total time: 19:30.050s
> [INFO] Finished at: Wed May 07 23:26:36 FET 2014
> [INFO] Final Memory: 27M/252M
> [INFO] ------------------------------------------------------------------------
>
>
> Thanks,
>
> Dmitro Lisnichenko
>
>
Re: Review Request 21172: Fail to install hive client with error: Fail:
Execution of '/bin/sh -c 'cd /usr/lib/ambari-agent/ && curl -kf --retry 5
http://hadoop1:8080/resources/DBConnectionVerification.jar -o
DBConnectionVerification.jar'' returned 22.
Posted by Dmytro Sen <ds...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/21172/#review42501
-----------------------------------------------------------
Ship it!
Ship It!
- Dmytro Sen
On May 7, 2014, 8:28 p.m., Dmitro Lisnichenko wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/21172/
> -----------------------------------------------------------
>
> (Updated May 7, 2014, 8:28 p.m.)
>
>
> Review request for Ambari, Dmytro Sen and Mahadev Konar.
>
>
> Bugs: AMBARI-5705
> https://issues.apache.org/jira/browse/AMBARI-5705
>
>
> Repository: ambari
>
>
> Description
> -------
>
> PROBLEM: Fresh install of HDP 2.1, when deploying hive client it fail with error: Execution of '/bin/sh -c 'cd /usr/lib/ambari-agent/ && curl -kf --retry 5 http://hadoop1:8080/resources/DBConnectionVerification.jar -o DBConnectionVerification.jar'' returned 22.
> Steps to reproduce: set up a proxy (http_proxy="<proxy host that has not access to cluster>").
> Fix:
> Added
> --noproxy <ambari-server hostname>
> option to all our curl invocations that download files from ambari-server. I would go for this option because sometimes ftp_proxy may be used as well.
> Also, I've fixed an error message that is shown when jce_name property is not defined in a non-secure cluster and added a proper handling of this situation in secure cluster.
>
>
> Diffs
> -----
>
> ambari-server/src/main/java/org/apache/ambari/server/utils/StageUtils.java f8b9636
> ambari-server/src/main/resources/stacks/HDP/1.3.2/hooks/before-INSTALL/scripts/params.py f2a4199
> ambari-server/src/main/resources/stacks/HDP/1.3.2/hooks/before-INSTALL/scripts/shared_initialization.py 4a0669b
> ambari-server/src/main/resources/stacks/HDP/1.3.2/hooks/before-START/scripts/params.py 897e669
> ambari-server/src/main/resources/stacks/HDP/1.3.2/hooks/before-START/scripts/shared_initialization.py 3fa511a
> ambari-server/src/main/resources/stacks/HDP/1.3.2/services/HIVE/package/scripts/hive.py 5f2f15e
> ambari-server/src/main/resources/stacks/HDP/1.3.2/services/HIVE/package/scripts/params.py bf52dba
> ambari-server/src/main/resources/stacks/HDP/1.3.2/services/NAGIOS/package/files/check_namenodes_ha.sh 50b075a
> ambari-server/src/main/resources/stacks/HDP/1.3.2/services/NAGIOS/package/files/check_nodemanager_health.sh 020b41d
> ambari-server/src/main/resources/stacks/HDP/1.3.2/services/NAGIOS/package/files/check_templeton_status.sh 7fbc4c4
> ambari-server/src/main/resources/stacks/HDP/1.3.2/services/NAGIOS/package/files/check_webui.sh b23045e
> ambari-server/src/main/resources/stacks/HDP/1.3.2/services/OOZIE/package/scripts/oozie.py 6523fbd
> ambari-server/src/main/resources/stacks/HDP/1.3.2/services/OOZIE/package/scripts/params.py bb6e27c
> ambari-server/src/main/resources/stacks/HDP/1.3.2/services/WEBHCAT/package/files/templetonSmoke.sh cefc4f0
> ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-INSTALL/scripts/params.py 1f8bfa8
> ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-INSTALL/scripts/shared_initialization.py 8affb55
> ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-START/scripts/params.py 91c06f5
> ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-START/scripts/shared_initialization.py b91b1a0
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/scripts/hive.py 42a8610
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/scripts/params.py ab4aee7
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/NAGIOS/package/files/check_namenodes_ha.sh 50b075a
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/NAGIOS/package/files/check_nodemanager_health.sh 020b41d
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/NAGIOS/package/files/check_templeton_status.sh 7fbc4c4
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/NAGIOS/package/files/check_webui.sh 8116dc5
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/OOZIE/package/scripts/oozie.py 818874d
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/OOZIE/package/scripts/params.py 9a5df00
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/WEBHCAT/package/files/templetonSmoke.sh 304b459
> ambari-server/src/test/java/org/apache/ambari/server/utils/TestStageUtils.java ee93431
> ambari-server/src/test/python/stacks/1.3.2/HIVE/test_hive_client.py 80a3c5c
> ambari-server/src/test/python/stacks/1.3.2/HIVE/test_hive_metastore.py 3914844
> ambari-server/src/test/python/stacks/1.3.2/HIVE/test_hive_server.py f5997e4
> ambari-server/src/test/python/stacks/1.3.2/configs/default.hbasedecom.json a1f62bd
> ambari-server/src/test/python/stacks/1.3.2/configs/default.json 40cdc57
> ambari-server/src/test/python/stacks/1.3.2/configs/default.non_gmetad_host.json 00ddf6a
> ambari-server/src/test/python/stacks/1.3.2/configs/secured.json 8c5f6b5
> ambari-server/src/test/python/stacks/1.3.2/configs/secured.json 8c5f6b5
> ambari-server/src/test/python/stacks/1.3.2/hooks/before-INSTALL/test_before_install.py 0215ba2
> ambari-server/src/test/python/stacks/2.0.6/HIVE/test_hive_client.py 9c570d1
> ambari-server/src/test/python/stacks/2.0.6/HIVE/test_hive_metastore.py 61ef4b5
> ambari-server/src/test/python/stacks/2.0.6/HIVE/test_hive_server.py c056591
> ambari-server/src/test/python/stacks/2.0.6/configs/default.hbasedecom.json 51e13d0
> ambari-server/src/test/python/stacks/2.0.6/configs/default.json c621a6d
> ambari-server/src/test/python/stacks/2.0.6/configs/default.non_gmetad_host.json c835c94
> ambari-server/src/test/python/stacks/2.0.6/configs/flume_target.json 4bd9aea
> ambari-server/src/test/python/stacks/2.0.6/configs/ha_default.json 924ed64
> ambari-server/src/test/python/stacks/2.0.6/configs/ha_secured.json e64b87a
> ambari-server/src/test/python/stacks/2.0.6/configs/secured.json 9889426
> ambari-server/src/test/python/stacks/2.0.6/configs/secured.json 9889426
> ambari-server/src/test/python/stacks/2.0.6/hooks/before-INSTALL/test_before_install.py 60c9704
> ambari-server/src/test/python/stacks/2.1/HIVE/test_hive_metastore.py 0f1ad88
> ambari-server/src/test/python/stacks/2.1/configs/default.json 6400314
> ambari-server/src/test/python/stacks/2.1/configs/secured.json 245e5dd
>
> Diff: https://reviews.apache.org/r/21172/diff/
>
>
> Testing
> -------
>
> performed manual cluster installation using 1.3.2 and 2.1 stack.
>
> Unit test run:
> [INFO] 63 resources included (use -debug for more details)
> [INFO] Rat check: Summary of files. Unapproved: 0 unknown: 0 generated: 0 approved: 34 licence.
> [INFO] ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO]
> [INFO] Ambari Main ....................................... SUCCESS [4.221s]
> [INFO] Apache Ambari Project POM ......................... SUCCESS [0.322s]
> [INFO] Ambari Web ........................................ SUCCESS [9.192s]
> [INFO] Ambari Views ...................................... SUCCESS [3.259s]
> [INFO] Ambari Server ..................................... SUCCESS [19:02.503s]
> [INFO] Ambari Agent ...................................... SUCCESS [9.098s]
> [INFO] Ambari Client ..................................... SUCCESS [0.762s]
> [INFO] ------------------------------------------------------------------------
> [INFO] BUILD SUCCESS
> [INFO] ------------------------------------------------------------------------
> [INFO] Total time: 19:30.050s
> [INFO] Finished at: Wed May 07 23:26:36 FET 2014
> [INFO] Final Memory: 27M/252M
> [INFO] ------------------------------------------------------------------------
>
>
> Thanks,
>
> Dmitro Lisnichenko
>
>
Re: Review Request 21172: Fail to install hive client with error: Fail:
Execution of '/bin/sh -c 'cd /usr/lib/ambari-agent/ && curl -kf --retry 5
http://hadoop1:8080/resources/DBConnectionVerification.jar -o
DBConnectionVerification.jar'' returned 22.
Posted by Mahadev Konar <ma...@apache.org>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/21172/#review42508
-----------------------------------------------------------
Ship it!
Ship It!
- Mahadev Konar
On May 7, 2014, 8:28 p.m., Dmitro Lisnichenko wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/21172/
> -----------------------------------------------------------
>
> (Updated May 7, 2014, 8:28 p.m.)
>
>
> Review request for Ambari, Dmytro Sen and Mahadev Konar.
>
>
> Bugs: AMBARI-5705
> https://issues.apache.org/jira/browse/AMBARI-5705
>
>
> Repository: ambari
>
>
> Description
> -------
>
> PROBLEM: Fresh install of HDP 2.1, when deploying hive client it fail with error: Execution of '/bin/sh -c 'cd /usr/lib/ambari-agent/ && curl -kf --retry 5 http://hadoop1:8080/resources/DBConnectionVerification.jar -o DBConnectionVerification.jar'' returned 22.
> Steps to reproduce: set up a proxy (http_proxy="<proxy host that has not access to cluster>").
> Fix:
> Added
> --noproxy <ambari-server hostname>
> option to all our curl invocations that download files from ambari-server. I would go for this option because sometimes ftp_proxy may be used as well.
> Also, I've fixed an error message that is shown when jce_name property is not defined in a non-secure cluster and added a proper handling of this situation in secure cluster.
>
>
> Diffs
> -----
>
> ambari-server/src/main/java/org/apache/ambari/server/utils/StageUtils.java f8b9636
> ambari-server/src/main/resources/stacks/HDP/1.3.2/hooks/before-INSTALL/scripts/params.py f2a4199
> ambari-server/src/main/resources/stacks/HDP/1.3.2/hooks/before-INSTALL/scripts/shared_initialization.py 4a0669b
> ambari-server/src/main/resources/stacks/HDP/1.3.2/hooks/before-START/scripts/params.py 897e669
> ambari-server/src/main/resources/stacks/HDP/1.3.2/hooks/before-START/scripts/shared_initialization.py 3fa511a
> ambari-server/src/main/resources/stacks/HDP/1.3.2/services/HIVE/package/scripts/hive.py 5f2f15e
> ambari-server/src/main/resources/stacks/HDP/1.3.2/services/HIVE/package/scripts/params.py bf52dba
> ambari-server/src/main/resources/stacks/HDP/1.3.2/services/NAGIOS/package/files/check_namenodes_ha.sh 50b075a
> ambari-server/src/main/resources/stacks/HDP/1.3.2/services/NAGIOS/package/files/check_nodemanager_health.sh 020b41d
> ambari-server/src/main/resources/stacks/HDP/1.3.2/services/NAGIOS/package/files/check_templeton_status.sh 7fbc4c4
> ambari-server/src/main/resources/stacks/HDP/1.3.2/services/NAGIOS/package/files/check_webui.sh b23045e
> ambari-server/src/main/resources/stacks/HDP/1.3.2/services/OOZIE/package/scripts/oozie.py 6523fbd
> ambari-server/src/main/resources/stacks/HDP/1.3.2/services/OOZIE/package/scripts/params.py bb6e27c
> ambari-server/src/main/resources/stacks/HDP/1.3.2/services/WEBHCAT/package/files/templetonSmoke.sh cefc4f0
> ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-INSTALL/scripts/params.py 1f8bfa8
> ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-INSTALL/scripts/shared_initialization.py 8affb55
> ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-START/scripts/params.py 91c06f5
> ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-START/scripts/shared_initialization.py b91b1a0
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/scripts/hive.py 42a8610
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/scripts/params.py ab4aee7
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/NAGIOS/package/files/check_namenodes_ha.sh 50b075a
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/NAGIOS/package/files/check_nodemanager_health.sh 020b41d
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/NAGIOS/package/files/check_templeton_status.sh 7fbc4c4
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/NAGIOS/package/files/check_webui.sh 8116dc5
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/OOZIE/package/scripts/oozie.py 818874d
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/OOZIE/package/scripts/params.py 9a5df00
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/WEBHCAT/package/files/templetonSmoke.sh 304b459
> ambari-server/src/test/java/org/apache/ambari/server/utils/TestStageUtils.java ee93431
> ambari-server/src/test/python/stacks/1.3.2/HIVE/test_hive_client.py 80a3c5c
> ambari-server/src/test/python/stacks/1.3.2/HIVE/test_hive_metastore.py 3914844
> ambari-server/src/test/python/stacks/1.3.2/HIVE/test_hive_server.py f5997e4
> ambari-server/src/test/python/stacks/1.3.2/configs/default.hbasedecom.json a1f62bd
> ambari-server/src/test/python/stacks/1.3.2/configs/default.json 40cdc57
> ambari-server/src/test/python/stacks/1.3.2/configs/default.non_gmetad_host.json 00ddf6a
> ambari-server/src/test/python/stacks/1.3.2/configs/secured.json 8c5f6b5
> ambari-server/src/test/python/stacks/1.3.2/configs/secured.json 8c5f6b5
> ambari-server/src/test/python/stacks/1.3.2/hooks/before-INSTALL/test_before_install.py 0215ba2
> ambari-server/src/test/python/stacks/2.0.6/HIVE/test_hive_client.py 9c570d1
> ambari-server/src/test/python/stacks/2.0.6/HIVE/test_hive_metastore.py 61ef4b5
> ambari-server/src/test/python/stacks/2.0.6/HIVE/test_hive_server.py c056591
> ambari-server/src/test/python/stacks/2.0.6/configs/default.hbasedecom.json 51e13d0
> ambari-server/src/test/python/stacks/2.0.6/configs/default.json c621a6d
> ambari-server/src/test/python/stacks/2.0.6/configs/default.non_gmetad_host.json c835c94
> ambari-server/src/test/python/stacks/2.0.6/configs/flume_target.json 4bd9aea
> ambari-server/src/test/python/stacks/2.0.6/configs/ha_default.json 924ed64
> ambari-server/src/test/python/stacks/2.0.6/configs/ha_secured.json e64b87a
> ambari-server/src/test/python/stacks/2.0.6/configs/secured.json 9889426
> ambari-server/src/test/python/stacks/2.0.6/configs/secured.json 9889426
> ambari-server/src/test/python/stacks/2.0.6/hooks/before-INSTALL/test_before_install.py 60c9704
> ambari-server/src/test/python/stacks/2.1/HIVE/test_hive_metastore.py 0f1ad88
> ambari-server/src/test/python/stacks/2.1/configs/default.json 6400314
> ambari-server/src/test/python/stacks/2.1/configs/secured.json 245e5dd
>
> Diff: https://reviews.apache.org/r/21172/diff/
>
>
> Testing
> -------
>
> performed manual cluster installation using 1.3.2 and 2.1 stack.
>
> Unit test run:
> [INFO] 63 resources included (use -debug for more details)
> [INFO] Rat check: Summary of files. Unapproved: 0 unknown: 0 generated: 0 approved: 34 licence.
> [INFO] ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO]
> [INFO] Ambari Main ....................................... SUCCESS [4.221s]
> [INFO] Apache Ambari Project POM ......................... SUCCESS [0.322s]
> [INFO] Ambari Web ........................................ SUCCESS [9.192s]
> [INFO] Ambari Views ...................................... SUCCESS [3.259s]
> [INFO] Ambari Server ..................................... SUCCESS [19:02.503s]
> [INFO] Ambari Agent ...................................... SUCCESS [9.098s]
> [INFO] Ambari Client ..................................... SUCCESS [0.762s]
> [INFO] ------------------------------------------------------------------------
> [INFO] BUILD SUCCESS
> [INFO] ------------------------------------------------------------------------
> [INFO] Total time: 19:30.050s
> [INFO] Finished at: Wed May 07 23:26:36 FET 2014
> [INFO] Final Memory: 27M/252M
> [INFO] ------------------------------------------------------------------------
>
>
> Thanks,
>
> Dmitro Lisnichenko
>
>