You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@ambari.apache.org by Jonathan Hurley <jh...@hortonworks.com> on 2015/12/18 20:38:14 UTC

Review Request 41562: Unable To Restart HCat Client When Not Colocated With WebHCat Server

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/41562/
-----------------------------------------------------------

Review request for Ambari, Alejandro Fernandez, Nate Cole, and Sumit Mohanty.


Bugs: AMBARI-14437
    https://issues.apache.org/jira/browse/AMBARI-14437


Repository: ambari


Description
-------

Errors are encountered while restart Hive HCat client when it is not located on a host which also has WebHCat daemon.

{code:title=This is good - the pointers have moved for 2.3.4}
root@os-d7-dkezlu-ambari-hv-r-upg-7-re1-5:/usr/hdp/current/hive-webhcat/etc# ls -l /usr/hdp/2.3.4.0-3485/hive-hcatalog/etc
total 4
lrwxrwxrwx 1 root root   33 Dec 18 14:45 hcatalog -> /etc/hive-hcatalog/2.3.4.0-3485/0
drwxr-xr-x 2 root root 4096 Dec 18 14:45 init.d
lrwxrwxrwx 1 root root   32 Dec 18 14:45 webhcat -> /etc/hive-webhcat/2.3.4.0-3485/0
{code}

{code:title=This is bad - current for hcatalog is still 2.3.2, which has the symlink issue}
root@os-d7-dkezlu-ambari-hv-r-upg-7-re1-5:/usr/hdp/current/hive-webhcat/etc# ls -l /usr/hdp/current | grep hive
lrwxrwxrwx 1 root root 26 Dec 18 15:50 hive-client -> /usr/hdp/2.3.4.0-3485/hive
lrwxrwxrwx 1 root root 26 Dec 18 12:59 hive-metastore -> /usr/hdp/2.3.2.0-2826/hive
lrwxrwxrwx 1 root root 26 Dec 18 12:59 hive-server2 -> /usr/hdp/2.3.2.0-2826/hive
lrwxrwxrwx 1 root root 35 Dec 18 12:59 hive-webhcat -> /usr/hdp/2.3.2.0-2826/hive-hcatalog
{code}

The problem is that {{hcat_client.py}} must write out configs to {{/usr/hdp/current/hive-webhcat/etc/hcatalog}} but {{hcat_client.py}} doesn't {{hdp-select}} anything.

So that the "current" pointers are never changed. {{hcat_client.py}} should probably {{hdp-select hive-webhcat}} since there is no {{hcat-client}} in {{hdp-select}}.


Diffs
-----

  ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/scripts/hcat_client.py 75a37f1 
  ambari-server/src/test/python/stacks/2.0.6/HIVE/test_hcat_client.py 396e6a1 

Diff: https://reviews.apache.org/r/41562/diff/


Testing
-------

mvn clean test

----------------------------------------------------------------------
Total run:853
Total errors:0
Total failures:0
OK

Upgraded cluster with multiple hcat clients not located with other hive components.


Thanks,

Jonathan Hurley


Re: Review Request 41562: Unable To Restart HCat Client When Not Colocated With WebHCat Server

Posted by Nate Cole <nc...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/41562/#review111245
-----------------------------------------------------------

Ship it!


Ship It!

- Nate Cole


On Dec. 18, 2015, 2:38 p.m., Jonathan Hurley wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/41562/
> -----------------------------------------------------------
> 
> (Updated Dec. 18, 2015, 2:38 p.m.)
> 
> 
> Review request for Ambari, Alejandro Fernandez, Nate Cole, and Sumit Mohanty.
> 
> 
> Bugs: AMBARI-14437
>     https://issues.apache.org/jira/browse/AMBARI-14437
> 
> 
> Repository: ambari
> 
> 
> Description
> -------
> 
> Errors are encountered while restart Hive HCat client when it is not located on a host which also has WebHCat daemon.
> 
> {code:title=This is good - the pointers have moved for 2.3.4}
> root@os-d7-dkezlu-ambari-hv-r-upg-7-re1-5:/usr/hdp/current/hive-webhcat/etc# ls -l /usr/hdp/2.3.4.0-3485/hive-hcatalog/etc
> total 4
> lrwxrwxrwx 1 root root   33 Dec 18 14:45 hcatalog -> /etc/hive-hcatalog/2.3.4.0-3485/0
> drwxr-xr-x 2 root root 4096 Dec 18 14:45 init.d
> lrwxrwxrwx 1 root root   32 Dec 18 14:45 webhcat -> /etc/hive-webhcat/2.3.4.0-3485/0
> {code}
> 
> {code:title=This is bad - current for hcatalog is still 2.3.2, which has the symlink issue}
> root@os-d7-dkezlu-ambari-hv-r-upg-7-re1-5:/usr/hdp/current/hive-webhcat/etc# ls -l /usr/hdp/current | grep hive
> lrwxrwxrwx 1 root root 26 Dec 18 15:50 hive-client -> /usr/hdp/2.3.4.0-3485/hive
> lrwxrwxrwx 1 root root 26 Dec 18 12:59 hive-metastore -> /usr/hdp/2.3.2.0-2826/hive
> lrwxrwxrwx 1 root root 26 Dec 18 12:59 hive-server2 -> /usr/hdp/2.3.2.0-2826/hive
> lrwxrwxrwx 1 root root 35 Dec 18 12:59 hive-webhcat -> /usr/hdp/2.3.2.0-2826/hive-hcatalog
> {code}
> 
> The problem is that {{hcat_client.py}} must write out configs to {{/usr/hdp/current/hive-webhcat/etc/hcatalog}} but {{hcat_client.py}} doesn't {{hdp-select}} anything.
> 
> So that the "current" pointers are never changed. {{hcat_client.py}} should probably {{hdp-select hive-webhcat}} since there is no {{hcat-client}} in {{hdp-select}}.
> 
> 
> Diffs
> -----
> 
>   ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/scripts/hcat_client.py 75a37f1 
>   ambari-server/src/test/python/stacks/2.0.6/HIVE/test_hcat_client.py 396e6a1 
> 
> Diff: https://reviews.apache.org/r/41562/diff/
> 
> 
> Testing
> -------
> 
> mvn clean test
> 
> ----------------------------------------------------------------------
> Total run:853
> Total errors:0
> Total failures:0
> OK
> 
> Upgraded cluster with multiple hcat clients not located with other hive components.
> 
> 
> Thanks,
> 
> Jonathan Hurley
> 
>