You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@ambari.apache.org by Andrew Onischuk <ao...@hortonworks.com> on 2017/11/01 12:43:07 UTC

Review Request 63464: Beeline connection hangs for longer time when connection to HS2 with metastore DB down

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/63464/
-----------------------------------------------------------

Review request for Ambari and Vitalyi Brodetskyi.


Bugs: AMBARI-22346
    https://issues.apache.org/jira/browse/AMBARI-22346


Repository: ambari


Description
-------

PROBLEM:  
beeline connection to HS2 hangs when hive metastore Database is down.  
Issue seen on HDP 2.5.3 and 2.6 version clusters, same test on HDP 2.4.2
beeline doesn't hangs.

BUSINESS IMPACT:  
Ambari spawning multiple beeline processes thats hanging causes unnecessary
memory usage, resulting in master service failures.


Diffs
-----

  ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/alerts/alert_hive_thrift_port.py 3560bf82f5 


Diff: https://reviews.apache.org/r/63464/diff/1/


Testing
-------

mvn clean test


Thanks,

Andrew Onischuk


Re: Review Request 63464: Beeline connection hangs for longer time when connection to HS2 with metastore DB down

Posted by Vitalyi Brodetskyi <vb...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/63464/#review190585
-----------------------------------------------------------


Ship it!




Ship It!

- Vitalyi Brodetskyi


On Ноя. 1, 2017, 12:43 п.п., Andrew Onischuk wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/63464/
> -----------------------------------------------------------
> 
> (Updated Ноя. 1, 2017, 12:43 п.п.)
> 
> 
> Review request for Ambari and Vitalyi Brodetskyi.
> 
> 
> Bugs: AMBARI-22346
>     https://issues.apache.org/jira/browse/AMBARI-22346
> 
> 
> Repository: ambari
> 
> 
> Description
> -------
> 
> PROBLEM:  
> beeline connection to HS2 hangs when hive metastore Database is down.  
> Issue seen on HDP 2.5.3 and 2.6 version clusters, same test on HDP 2.4.2
> beeline doesn't hangs.
> 
> BUSINESS IMPACT:  
> Ambari spawning multiple beeline processes thats hanging causes unnecessary
> memory usage, resulting in master service failures.
> 
> 
> Diffs
> -----
> 
>   ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/alerts/alert_hive_thrift_port.py 3560bf82f5 
> 
> 
> Diff: https://reviews.apache.org/r/63464/diff/1/
> 
> 
> Testing
> -------
> 
> mvn clean test
> 
> 
> Thanks,
> 
> Andrew Onischuk
> 
>


Re: Review Request 63464: Beeline connection hangs for longer time when connection to HS2 with metastore DB down

Posted by Andrew Onischuk <ao...@hortonworks.com>.

> On Nov. 9, 2017, 3:27 p.m., Attila Doroszlai wrote:
> > Doesn't the same problem affect Spark/Spark2 Thrift Server alert, which also uses Beeline?

Wow nice find Attila. Didn't know that we used beeline for Spark and Spark2


- Andrew


-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/63464/#review190596
-----------------------------------------------------------


On Nov. 1, 2017, 12:43 p.m., Andrew Onischuk wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/63464/
> -----------------------------------------------------------
> 
> (Updated Nov. 1, 2017, 12:43 p.m.)
> 
> 
> Review request for Ambari and Vitalyi Brodetskyi.
> 
> 
> Bugs: AMBARI-22346
>     https://issues.apache.org/jira/browse/AMBARI-22346
> 
> 
> Repository: ambari
> 
> 
> Description
> -------
> 
> PROBLEM:  
> beeline connection to HS2 hangs when hive metastore Database is down.  
> Issue seen on HDP 2.5.3 and 2.6 version clusters, same test on HDP 2.4.2
> beeline doesn't hangs.
> 
> BUSINESS IMPACT:  
> Ambari spawning multiple beeline processes thats hanging causes unnecessary
> memory usage, resulting in master service failures.
> 
> 
> Diffs
> -----
> 
>   ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/alerts/alert_hive_thrift_port.py 3560bf82f5 
> 
> 
> Diff: https://reviews.apache.org/r/63464/diff/1/
> 
> 
> Testing
> -------
> 
> mvn clean test
> 
> 
> Thanks,
> 
> Andrew Onischuk
> 
>


Re: Review Request 63464: Beeline connection hangs for longer time when connection to HS2 with metastore DB down

Posted by Attila Doroszlai <ad...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/63464/#review190596
-----------------------------------------------------------



Doesn't the same problem affect Spark/Spark2 Thrift Server alert, which also uses Beeline?

- Attila Doroszlai


On Nov. 1, 2017, 1:43 p.m., Andrew Onischuk wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/63464/
> -----------------------------------------------------------
> 
> (Updated Nov. 1, 2017, 1:43 p.m.)
> 
> 
> Review request for Ambari and Vitalyi Brodetskyi.
> 
> 
> Bugs: AMBARI-22346
>     https://issues.apache.org/jira/browse/AMBARI-22346
> 
> 
> Repository: ambari
> 
> 
> Description
> -------
> 
> PROBLEM:  
> beeline connection to HS2 hangs when hive metastore Database is down.  
> Issue seen on HDP 2.5.3 and 2.6 version clusters, same test on HDP 2.4.2
> beeline doesn't hangs.
> 
> BUSINESS IMPACT:  
> Ambari spawning multiple beeline processes thats hanging causes unnecessary
> memory usage, resulting in master service failures.
> 
> 
> Diffs
> -----
> 
>   ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/alerts/alert_hive_thrift_port.py 3560bf82f5 
> 
> 
> Diff: https://reviews.apache.org/r/63464/diff/1/
> 
> 
> Testing
> -------
> 
> mvn clean test
> 
> 
> Thanks,
> 
> Andrew Onischuk
> 
>


Re: Review Request 63464: Beeline connection hangs for longer time when connection to HS2 with metastore DB down

Posted by Andrew Onischuk <ao...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/63464/
-----------------------------------------------------------

(Updated Nov. 10, 2017, 11:27 a.m.)


Review request for Ambari and Vitalyi Brodetskyi.


Bugs: AMBARI-22346
    https://issues.apache.org/jira/browse/AMBARI-22346


Repository: ambari


Description
-------

PROBLEM:  
beeline connection to HS2 hangs when hive metastore Database is down.  
Issue seen on HDP 2.5.3 and 2.6 version clusters, same test on HDP 2.4.2
beeline doesn't hangs.

BUSINESS IMPACT:  
Ambari spawning multiple beeline processes thats hanging causes unnecessary
memory usage, resulting in master service failures.


Diffs (updated)
-----

  ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/alerts/alert_hive_thrift_port.py 3560bf82f5 
  ambari-server/src/main/resources/common-services/SPARK/1.2.1/package/scripts/alerts/alert_spark_thrift_port.py 3f80fd941d 
  ambari-server/src/main/resources/common-services/SPARK2/2.0.0/package/scripts/alerts/alert_spark2_thrift_port.py 9e1afea374 


Diff: https://reviews.apache.org/r/63464/diff/2/

Changes: https://reviews.apache.org/r/63464/diff/1-2/


Testing
-------

mvn clean test


Thanks,

Andrew Onischuk