You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@ambari.apache.org by Jonathan Hurley <jh...@hortonworks.com> on 2015/03/20 17:50:10 UTC

Review Request 32311: Hive Metastore alert check "show databases" results in a Tez session causing RM to be unresponsive

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/32311/
-----------------------------------------------------------

Review request for Ambari, Alejandro Fernandez and Nate Cole.


Bugs: AMBARI-10160
    https://issues.apache.org/jira/browse/AMBARI-10160


Repository: ambari


Description
-------

Hive requests using the hive client use Tez instead of MR for the engine. This causes new Tez sessions every time `hive` is invoked. Alerts uses `hive` for the metastore check, which overloads the RM with too many Tez sessions.

Switching to use `mr` as the engine.


Diffs
-----

  ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/alerts/alert_hive_metastore.py f302896 

Diff: https://reviews.apache.org/r/32311/diff/


Testing
-------

Deployed changes and verified hive metastore alert behaved correctly and that no more Tez sessions were show in YARN.


Thanks,

Jonathan Hurley


Re: Review Request 32311: Hive Metastore alert check "show databases" results in a Tez session causing RM to be unresponsive

Posted by Nate Cole <nc...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/32311/#review77237
-----------------------------------------------------------

Ship it!


Ship It!

- Nate Cole


On March 20, 2015, 12:50 p.m., Jonathan Hurley wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/32311/
> -----------------------------------------------------------
> 
> (Updated March 20, 2015, 12:50 p.m.)
> 
> 
> Review request for Ambari, Alejandro Fernandez and Nate Cole.
> 
> 
> Bugs: AMBARI-10160
>     https://issues.apache.org/jira/browse/AMBARI-10160
> 
> 
> Repository: ambari
> 
> 
> Description
> -------
> 
> Hive requests using the hive client use Tez instead of MR for the engine. This causes new Tez sessions every time `hive` is invoked. Alerts uses `hive` for the metastore check, which overloads the RM with too many Tez sessions.
> 
> Switching to use `mr` as the engine.
> 
> 
> Diffs
> -----
> 
>   ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/alerts/alert_hive_metastore.py f302896 
> 
> Diff: https://reviews.apache.org/r/32311/diff/
> 
> 
> Testing
> -------
> 
> Deployed changes and verified hive metastore alert behaved correctly and that no more Tez sessions were show in YARN.
> 
> 
> Thanks,
> 
> Jonathan Hurley
> 
>