You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@ambari.apache.org by Andrew Onischuk <ao...@hortonworks.com> on 2014/11/07 20:56:25 UTC
Review Request 27740: ambari cluster HS2 health check causing errors
in logs
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/27740/
-----------------------------------------------------------
Review request for Ambari and Mahadev Konar.
Bugs: AMBARI-8213
https://issues.apache.org/jira/browse/AMBARI-8213
Repository: ambari
Description
-------
The following stack trace is seen every 30 seconds in hiveServer2.log . I
noticed this in a ambari installed secure cluster. It seems to be coming as a
result of some ambari health check command. It is either not using kerberos to
authenticate, or not using proper thrift protocol .
2014-11-04 06:37:01,333 ERROR server.TThreadPoolServer (TThreadPoolServer.java:run(215)) - Error occurred during processing of message.
java.lang.RuntimeException: org.apache.thrift.transport.TTransportException
at org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:219)
at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge20S$Server$TUGIAssumingTransportFactory$1.run(HadoopThriftAuthBridge20S.java:725)
at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge20S$Server$TUGIAssumingTransportFactory$1.run(HadoopThriftAuthBridge20S.java:722)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:356)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1608)
at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge20S$Server$TUGIAssumingTransportFactory.getTransport(HadoopThriftAuthBridge20S.java:722)
at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:189)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.thrift.transport.TTransportException
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:132)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:84)
at org.apache.thrift.transport.TSaslTransport.receiveSaslMessage(TSaslTransport.java:178)
at org.apache.thrift.transport.TSaslServerTransport.handleSaslStartMessage(TSaslServerTransport.java:125)
at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:253)
at org.apache.thrift.transport.TSaslServerTransport.open(TSaslServerTransport.java:41)
at org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:216)
... 10 more
Diffs
-----
ambari-common/src/main/python/resource_management/libraries/functions/hive_check.py 282fed2
ambari-server/src/main/resources/stacks/HDP/1.3.2/services/HIVE/package/scripts/hive_service.py d3bd71b
ambari-server/src/main/resources/stacks/HDP/1.3.2/services/HIVE/package/scripts/params.py f27c28c
ambari-server/src/main/resources/stacks/HDP/1.3.2/services/HIVE/package/scripts/service_check.py b75578b
ambari-server/src/main/resources/stacks/HDP/1.3.2/services/NAGIOS/package/files/check_hive_thrift_port.py c9414f7
ambari-server/src/main/resources/stacks/HDP/1.3.2/services/NAGIOS/package/scripts/params.py 2384e3a
ambari-server/src/main/resources/stacks/HDP/1.3.2/services/NAGIOS/package/templates/hadoop-commands.cfg.j2 ff13c0d
ambari-server/src/main/resources/stacks/HDP/1.3.2/services/NAGIOS/package/templates/hadoop-services.cfg.j2 48bba18
ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/scripts/hive_service.py 294121d
ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/scripts/params.py c1279d8
ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/scripts/service_check.py b75578b
ambari-server/src/main/resources/stacks/HDP/2.0.6/services/NAGIOS/package/files/check_hive_thrift_port.py c9414f7
ambari-server/src/main/resources/stacks/HDP/2.0.6/services/NAGIOS/package/scripts/params.py ba91cfb
ambari-server/src/main/resources/stacks/HDP/2.0.6/services/NAGIOS/package/templates/hadoop-commands.cfg.j2 c1a792c
ambari-server/src/main/resources/stacks/HDP/2.0.6/services/NAGIOS/package/templates/hadoop-services.cfg.j2 0d8b2e8
ambari-server/src/test/python/stacks/1.3.2/HIVE/test_hive_server.py 4dceec1
ambari-server/src/test/python/stacks/1.3.2/HIVE/test_hive_service_check.py ad75ce1
ambari-server/src/test/python/stacks/1.3.2/configs/default.json a39d51d
ambari-server/src/test/python/stacks/1.3.2/configs/secured.json 3e84df6
ambari-server/src/test/python/stacks/2.0.6/HIVE/test_hive_server.py 581b4d3
ambari-server/src/test/python/stacks/2.0.6/HIVE/test_hive_service_check.py 6ba4d48
ambari-server/src/test/python/stacks/2.0.6/configs/default.json 6b68e0b
ambari-server/src/test/python/stacks/2.0.6/configs/secured.json 83b9b9e
Diff: https://reviews.apache.org/r/27740/diff/
Testing
-------
mvn clean test
Thanks,
Andrew Onischuk
Re: Review Request 27740: ambari cluster HS2 health check causing
errors in logs
Posted by Andrew Onischuk <ao...@hortonworks.com>.
> On Nov. 7, 2014, 8:23 p.m., Jonathan Hurley wrote:
> > ambari-common/src/main/python/resource_management/libraries/functions/hive_check.py, line 26
> > <https://reviews.apache.org/r/27740/diff/1/?file=754658#file754658line26>
> >
> > alert_hive_thrift_port.py which is used by the new alerts framework on trunk uses this method.
> >
> > is_thrift_port_ok = hive_check.check_thrift_port_sasl(host_name,
> > thrift_port, security_enabled=security_enabled)
> >
> > If this code change is for trunk, you'll need to update the new alert scripts as well. If it's not for trunk, then you can close the issue.
Gonna create a separate jira for trunk
- Andrew
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/27740/#review60371
-----------------------------------------------------------
On Nov. 7, 2014, 8:04 p.m., Andrew Onischuk wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/27740/
> -----------------------------------------------------------
>
> (Updated Nov. 7, 2014, 8:04 p.m.)
>
>
> Review request for Ambari, Mahadev Konar and Nate Cole.
>
>
> Bugs: AMBARI-8213
> https://issues.apache.org/jira/browse/AMBARI-8213
>
>
> Repository: ambari
>
>
> Description
> -------
>
> The following stack trace is seen every 30 seconds in hiveServer2.log . I
> noticed this in a ambari installed secure cluster. It seems to be coming as a
> result of some ambari health check command. It is either not using kerberos to
> authenticate, or not using proper thrift protocol .
>
>
>
> 2014-11-04 06:37:01,333 ERROR server.TThreadPoolServer (TThreadPoolServer.java:run(215)) - Error occurred during processing of message.
> java.lang.RuntimeException: org.apache.thrift.transport.TTransportException
> at org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:219)
> at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge20S$Server$TUGIAssumingTransportFactory$1.run(HadoopThriftAuthBridge20S.java:725)
> at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge20S$Server$TUGIAssumingTransportFactory$1.run(HadoopThriftAuthBridge20S.java:722)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:356)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1608)
> at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge20S$Server$TUGIAssumingTransportFactory.getTransport(HadoopThriftAuthBridge20S.java:722)
> at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:189)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: org.apache.thrift.transport.TTransportException
> at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:132)
> at org.apache.thrift.transport.TTransport.readAll(TTransport.java:84)
> at org.apache.thrift.transport.TSaslTransport.receiveSaslMessage(TSaslTransport.java:178)
> at org.apache.thrift.transport.TSaslServerTransport.handleSaslStartMessage(TSaslServerTransport.java:125)
> at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:253)
> at org.apache.thrift.transport.TSaslServerTransport.open(TSaslServerTransport.java:41)
> at org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:216)
> ... 10 more
>
>
>
>
> Diffs
> -----
>
> ambari-common/src/main/python/resource_management/libraries/functions/hive_check.py 282fed2
> ambari-server/src/main/resources/stacks/HDP/1.3.2/services/HIVE/package/scripts/hive_service.py d3bd71b
> ambari-server/src/main/resources/stacks/HDP/1.3.2/services/HIVE/package/scripts/params.py f27c28c
> ambari-server/src/main/resources/stacks/HDP/1.3.2/services/HIVE/package/scripts/service_check.py b75578b
> ambari-server/src/main/resources/stacks/HDP/1.3.2/services/NAGIOS/package/files/check_hive_thrift_port.py c9414f7
> ambari-server/src/main/resources/stacks/HDP/1.3.2/services/NAGIOS/package/scripts/params.py 2384e3a
> ambari-server/src/main/resources/stacks/HDP/1.3.2/services/NAGIOS/package/templates/hadoop-commands.cfg.j2 ff13c0d
> ambari-server/src/main/resources/stacks/HDP/1.3.2/services/NAGIOS/package/templates/hadoop-services.cfg.j2 48bba18
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/scripts/hive_service.py 294121d
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/scripts/params.py c1279d8
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/scripts/service_check.py b75578b
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/NAGIOS/package/files/check_hive_thrift_port.py c9414f7
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/NAGIOS/package/scripts/params.py ba91cfb
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/NAGIOS/package/templates/hadoop-commands.cfg.j2 c1a792c
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/NAGIOS/package/templates/hadoop-services.cfg.j2 0d8b2e8
> ambari-server/src/test/python/stacks/1.3.2/HIVE/test_hive_server.py 4dceec1
> ambari-server/src/test/python/stacks/1.3.2/HIVE/test_hive_service_check.py ad75ce1
> ambari-server/src/test/python/stacks/1.3.2/configs/default.json a39d51d
> ambari-server/src/test/python/stacks/1.3.2/configs/secured.json 3e84df6
> ambari-server/src/test/python/stacks/2.0.6/HIVE/test_hive_server.py 581b4d3
> ambari-server/src/test/python/stacks/2.0.6/HIVE/test_hive_service_check.py 6ba4d48
> ambari-server/src/test/python/stacks/2.0.6/configs/default.json 6b68e0b
> ambari-server/src/test/python/stacks/2.0.6/configs/secured.json 83b9b9e
>
> Diff: https://reviews.apache.org/r/27740/diff/
>
>
> Testing
> -------
>
> mvn clean test
>
>
> Thanks,
>
> Andrew Onischuk
>
>
Re: Review Request 27740: ambari cluster HS2 health check causing
errors in logs
Posted by Jonathan Hurley <jh...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/27740/#review60371
-----------------------------------------------------------
ambari-common/src/main/python/resource_management/libraries/functions/hive_check.py
<https://reviews.apache.org/r/27740/#comment101727>
alert_hive_thrift_port.py which is used by the new alerts framework on trunk uses this method.
is_thrift_port_ok = hive_check.check_thrift_port_sasl(host_name,
thrift_port, security_enabled=security_enabled)
If this code change is for trunk, you'll need to update the new alert scripts as well. If it's not for trunk, then you can close the issue.
- Jonathan Hurley
On Nov. 7, 2014, 3:04 p.m., Andrew Onischuk wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/27740/
> -----------------------------------------------------------
>
> (Updated Nov. 7, 2014, 3:04 p.m.)
>
>
> Review request for Ambari, Mahadev Konar and Nate Cole.
>
>
> Bugs: AMBARI-8213
> https://issues.apache.org/jira/browse/AMBARI-8213
>
>
> Repository: ambari
>
>
> Description
> -------
>
> The following stack trace is seen every 30 seconds in hiveServer2.log . I
> noticed this in a ambari installed secure cluster. It seems to be coming as a
> result of some ambari health check command. It is either not using kerberos to
> authenticate, or not using proper thrift protocol .
>
>
>
> 2014-11-04 06:37:01,333 ERROR server.TThreadPoolServer (TThreadPoolServer.java:run(215)) - Error occurred during processing of message.
> java.lang.RuntimeException: org.apache.thrift.transport.TTransportException
> at org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:219)
> at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge20S$Server$TUGIAssumingTransportFactory$1.run(HadoopThriftAuthBridge20S.java:725)
> at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge20S$Server$TUGIAssumingTransportFactory$1.run(HadoopThriftAuthBridge20S.java:722)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:356)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1608)
> at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge20S$Server$TUGIAssumingTransportFactory.getTransport(HadoopThriftAuthBridge20S.java:722)
> at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:189)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: org.apache.thrift.transport.TTransportException
> at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:132)
> at org.apache.thrift.transport.TTransport.readAll(TTransport.java:84)
> at org.apache.thrift.transport.TSaslTransport.receiveSaslMessage(TSaslTransport.java:178)
> at org.apache.thrift.transport.TSaslServerTransport.handleSaslStartMessage(TSaslServerTransport.java:125)
> at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:253)
> at org.apache.thrift.transport.TSaslServerTransport.open(TSaslServerTransport.java:41)
> at org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:216)
> ... 10 more
>
>
>
>
> Diffs
> -----
>
> ambari-common/src/main/python/resource_management/libraries/functions/hive_check.py 282fed2
> ambari-server/src/main/resources/stacks/HDP/1.3.2/services/HIVE/package/scripts/hive_service.py d3bd71b
> ambari-server/src/main/resources/stacks/HDP/1.3.2/services/HIVE/package/scripts/params.py f27c28c
> ambari-server/src/main/resources/stacks/HDP/1.3.2/services/HIVE/package/scripts/service_check.py b75578b
> ambari-server/src/main/resources/stacks/HDP/1.3.2/services/NAGIOS/package/files/check_hive_thrift_port.py c9414f7
> ambari-server/src/main/resources/stacks/HDP/1.3.2/services/NAGIOS/package/scripts/params.py 2384e3a
> ambari-server/src/main/resources/stacks/HDP/1.3.2/services/NAGIOS/package/templates/hadoop-commands.cfg.j2 ff13c0d
> ambari-server/src/main/resources/stacks/HDP/1.3.2/services/NAGIOS/package/templates/hadoop-services.cfg.j2 48bba18
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/scripts/hive_service.py 294121d
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/scripts/params.py c1279d8
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/scripts/service_check.py b75578b
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/NAGIOS/package/files/check_hive_thrift_port.py c9414f7
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/NAGIOS/package/scripts/params.py ba91cfb
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/NAGIOS/package/templates/hadoop-commands.cfg.j2 c1a792c
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/NAGIOS/package/templates/hadoop-services.cfg.j2 0d8b2e8
> ambari-server/src/test/python/stacks/1.3.2/HIVE/test_hive_server.py 4dceec1
> ambari-server/src/test/python/stacks/1.3.2/HIVE/test_hive_service_check.py ad75ce1
> ambari-server/src/test/python/stacks/1.3.2/configs/default.json a39d51d
> ambari-server/src/test/python/stacks/1.3.2/configs/secured.json 3e84df6
> ambari-server/src/test/python/stacks/2.0.6/HIVE/test_hive_server.py 581b4d3
> ambari-server/src/test/python/stacks/2.0.6/HIVE/test_hive_service_check.py 6ba4d48
> ambari-server/src/test/python/stacks/2.0.6/configs/default.json 6b68e0b
> ambari-server/src/test/python/stacks/2.0.6/configs/secured.json 83b9b9e
>
> Diff: https://reviews.apache.org/r/27740/diff/
>
>
> Testing
> -------
>
> mvn clean test
>
>
> Thanks,
>
> Andrew Onischuk
>
>
Re: Review Request 27740: ambari cluster HS2 health check causing
errors in logs
Posted by Nate Cole <nc...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/27740/#review60369
-----------------------------------------------------------
Ship it!
Ship It!
- Nate Cole
On Nov. 7, 2014, 3:04 p.m., Andrew Onischuk wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/27740/
> -----------------------------------------------------------
>
> (Updated Nov. 7, 2014, 3:04 p.m.)
>
>
> Review request for Ambari, Mahadev Konar and Nate Cole.
>
>
> Bugs: AMBARI-8213
> https://issues.apache.org/jira/browse/AMBARI-8213
>
>
> Repository: ambari
>
>
> Description
> -------
>
> The following stack trace is seen every 30 seconds in hiveServer2.log . I
> noticed this in a ambari installed secure cluster. It seems to be coming as a
> result of some ambari health check command. It is either not using kerberos to
> authenticate, or not using proper thrift protocol .
>
>
>
> 2014-11-04 06:37:01,333 ERROR server.TThreadPoolServer (TThreadPoolServer.java:run(215)) - Error occurred during processing of message.
> java.lang.RuntimeException: org.apache.thrift.transport.TTransportException
> at org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:219)
> at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge20S$Server$TUGIAssumingTransportFactory$1.run(HadoopThriftAuthBridge20S.java:725)
> at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge20S$Server$TUGIAssumingTransportFactory$1.run(HadoopThriftAuthBridge20S.java:722)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:356)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1608)
> at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge20S$Server$TUGIAssumingTransportFactory.getTransport(HadoopThriftAuthBridge20S.java:722)
> at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:189)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: org.apache.thrift.transport.TTransportException
> at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:132)
> at org.apache.thrift.transport.TTransport.readAll(TTransport.java:84)
> at org.apache.thrift.transport.TSaslTransport.receiveSaslMessage(TSaslTransport.java:178)
> at org.apache.thrift.transport.TSaslServerTransport.handleSaslStartMessage(TSaslServerTransport.java:125)
> at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:253)
> at org.apache.thrift.transport.TSaslServerTransport.open(TSaslServerTransport.java:41)
> at org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:216)
> ... 10 more
>
>
>
>
> Diffs
> -----
>
> ambari-common/src/main/python/resource_management/libraries/functions/hive_check.py 282fed2
> ambari-server/src/main/resources/stacks/HDP/1.3.2/services/HIVE/package/scripts/hive_service.py d3bd71b
> ambari-server/src/main/resources/stacks/HDP/1.3.2/services/HIVE/package/scripts/params.py f27c28c
> ambari-server/src/main/resources/stacks/HDP/1.3.2/services/HIVE/package/scripts/service_check.py b75578b
> ambari-server/src/main/resources/stacks/HDP/1.3.2/services/NAGIOS/package/files/check_hive_thrift_port.py c9414f7
> ambari-server/src/main/resources/stacks/HDP/1.3.2/services/NAGIOS/package/scripts/params.py 2384e3a
> ambari-server/src/main/resources/stacks/HDP/1.3.2/services/NAGIOS/package/templates/hadoop-commands.cfg.j2 ff13c0d
> ambari-server/src/main/resources/stacks/HDP/1.3.2/services/NAGIOS/package/templates/hadoop-services.cfg.j2 48bba18
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/scripts/hive_service.py 294121d
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/scripts/params.py c1279d8
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/scripts/service_check.py b75578b
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/NAGIOS/package/files/check_hive_thrift_port.py c9414f7
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/NAGIOS/package/scripts/params.py ba91cfb
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/NAGIOS/package/templates/hadoop-commands.cfg.j2 c1a792c
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/NAGIOS/package/templates/hadoop-services.cfg.j2 0d8b2e8
> ambari-server/src/test/python/stacks/1.3.2/HIVE/test_hive_server.py 4dceec1
> ambari-server/src/test/python/stacks/1.3.2/HIVE/test_hive_service_check.py ad75ce1
> ambari-server/src/test/python/stacks/1.3.2/configs/default.json a39d51d
> ambari-server/src/test/python/stacks/1.3.2/configs/secured.json 3e84df6
> ambari-server/src/test/python/stacks/2.0.6/HIVE/test_hive_server.py 581b4d3
> ambari-server/src/test/python/stacks/2.0.6/HIVE/test_hive_service_check.py 6ba4d48
> ambari-server/src/test/python/stacks/2.0.6/configs/default.json 6b68e0b
> ambari-server/src/test/python/stacks/2.0.6/configs/secured.json 83b9b9e
>
> Diff: https://reviews.apache.org/r/27740/diff/
>
>
> Testing
> -------
>
> mvn clean test
>
>
> Thanks,
>
> Andrew Onischuk
>
>
Re: Review Request 27740: ambari cluster HS2 health check causing
errors in logs
Posted by Jonathan Hurley <jh...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/27740/#review60370
-----------------------------------------------------------
Is this change only for branch-1.7.0, or is it for trunk?
If it's for trunk, then alert_hive_thrift_port.py uses the hive_check function. You should also verify that your changes also work on the new alerts framework. You can verify this alert by executing
http://localhost:8080/api/v1/clusters/c1/alerts?Alert/name=hive_server_process
- Jonathan Hurley
On Nov. 7, 2014, 3:04 p.m., Andrew Onischuk wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/27740/
> -----------------------------------------------------------
>
> (Updated Nov. 7, 2014, 3:04 p.m.)
>
>
> Review request for Ambari, Mahadev Konar and Nate Cole.
>
>
> Bugs: AMBARI-8213
> https://issues.apache.org/jira/browse/AMBARI-8213
>
>
> Repository: ambari
>
>
> Description
> -------
>
> The following stack trace is seen every 30 seconds in hiveServer2.log . I
> noticed this in a ambari installed secure cluster. It seems to be coming as a
> result of some ambari health check command. It is either not using kerberos to
> authenticate, or not using proper thrift protocol .
>
>
>
> 2014-11-04 06:37:01,333 ERROR server.TThreadPoolServer (TThreadPoolServer.java:run(215)) - Error occurred during processing of message.
> java.lang.RuntimeException: org.apache.thrift.transport.TTransportException
> at org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:219)
> at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge20S$Server$TUGIAssumingTransportFactory$1.run(HadoopThriftAuthBridge20S.java:725)
> at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge20S$Server$TUGIAssumingTransportFactory$1.run(HadoopThriftAuthBridge20S.java:722)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:356)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1608)
> at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge20S$Server$TUGIAssumingTransportFactory.getTransport(HadoopThriftAuthBridge20S.java:722)
> at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:189)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: org.apache.thrift.transport.TTransportException
> at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:132)
> at org.apache.thrift.transport.TTransport.readAll(TTransport.java:84)
> at org.apache.thrift.transport.TSaslTransport.receiveSaslMessage(TSaslTransport.java:178)
> at org.apache.thrift.transport.TSaslServerTransport.handleSaslStartMessage(TSaslServerTransport.java:125)
> at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:253)
> at org.apache.thrift.transport.TSaslServerTransport.open(TSaslServerTransport.java:41)
> at org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:216)
> ... 10 more
>
>
>
>
> Diffs
> -----
>
> ambari-common/src/main/python/resource_management/libraries/functions/hive_check.py 282fed2
> ambari-server/src/main/resources/stacks/HDP/1.3.2/services/HIVE/package/scripts/hive_service.py d3bd71b
> ambari-server/src/main/resources/stacks/HDP/1.3.2/services/HIVE/package/scripts/params.py f27c28c
> ambari-server/src/main/resources/stacks/HDP/1.3.2/services/HIVE/package/scripts/service_check.py b75578b
> ambari-server/src/main/resources/stacks/HDP/1.3.2/services/NAGIOS/package/files/check_hive_thrift_port.py c9414f7
> ambari-server/src/main/resources/stacks/HDP/1.3.2/services/NAGIOS/package/scripts/params.py 2384e3a
> ambari-server/src/main/resources/stacks/HDP/1.3.2/services/NAGIOS/package/templates/hadoop-commands.cfg.j2 ff13c0d
> ambari-server/src/main/resources/stacks/HDP/1.3.2/services/NAGIOS/package/templates/hadoop-services.cfg.j2 48bba18
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/scripts/hive_service.py 294121d
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/scripts/params.py c1279d8
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/scripts/service_check.py b75578b
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/NAGIOS/package/files/check_hive_thrift_port.py c9414f7
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/NAGIOS/package/scripts/params.py ba91cfb
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/NAGIOS/package/templates/hadoop-commands.cfg.j2 c1a792c
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/NAGIOS/package/templates/hadoop-services.cfg.j2 0d8b2e8
> ambari-server/src/test/python/stacks/1.3.2/HIVE/test_hive_server.py 4dceec1
> ambari-server/src/test/python/stacks/1.3.2/HIVE/test_hive_service_check.py ad75ce1
> ambari-server/src/test/python/stacks/1.3.2/configs/default.json a39d51d
> ambari-server/src/test/python/stacks/1.3.2/configs/secured.json 3e84df6
> ambari-server/src/test/python/stacks/2.0.6/HIVE/test_hive_server.py 581b4d3
> ambari-server/src/test/python/stacks/2.0.6/HIVE/test_hive_service_check.py 6ba4d48
> ambari-server/src/test/python/stacks/2.0.6/configs/default.json 6b68e0b
> ambari-server/src/test/python/stacks/2.0.6/configs/secured.json 83b9b9e
>
> Diff: https://reviews.apache.org/r/27740/diff/
>
>
> Testing
> -------
>
> mvn clean test
>
>
> Thanks,
>
> Andrew Onischuk
>
>
Re: Review Request 27740: ambari cluster HS2 health check causing
errors in logs
Posted by Andrew Onischuk <ao...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/27740/
-----------------------------------------------------------
(Updated Nov. 7, 2014, 8:04 p.m.)
Review request for Ambari, Mahadev Konar and Nate Cole.
Bugs: AMBARI-8213
https://issues.apache.org/jira/browse/AMBARI-8213
Repository: ambari
Description
-------
The following stack trace is seen every 30 seconds in hiveServer2.log . I
noticed this in a ambari installed secure cluster. It seems to be coming as a
result of some ambari health check command. It is either not using kerberos to
authenticate, or not using proper thrift protocol .
2014-11-04 06:37:01,333 ERROR server.TThreadPoolServer (TThreadPoolServer.java:run(215)) - Error occurred during processing of message.
java.lang.RuntimeException: org.apache.thrift.transport.TTransportException
at org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:219)
at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge20S$Server$TUGIAssumingTransportFactory$1.run(HadoopThriftAuthBridge20S.java:725)
at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge20S$Server$TUGIAssumingTransportFactory$1.run(HadoopThriftAuthBridge20S.java:722)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:356)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1608)
at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge20S$Server$TUGIAssumingTransportFactory.getTransport(HadoopThriftAuthBridge20S.java:722)
at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:189)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.thrift.transport.TTransportException
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:132)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:84)
at org.apache.thrift.transport.TSaslTransport.receiveSaslMessage(TSaslTransport.java:178)
at org.apache.thrift.transport.TSaslServerTransport.handleSaslStartMessage(TSaslServerTransport.java:125)
at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:253)
at org.apache.thrift.transport.TSaslServerTransport.open(TSaslServerTransport.java:41)
at org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:216)
... 10 more
Diffs
-----
ambari-common/src/main/python/resource_management/libraries/functions/hive_check.py 282fed2
ambari-server/src/main/resources/stacks/HDP/1.3.2/services/HIVE/package/scripts/hive_service.py d3bd71b
ambari-server/src/main/resources/stacks/HDP/1.3.2/services/HIVE/package/scripts/params.py f27c28c
ambari-server/src/main/resources/stacks/HDP/1.3.2/services/HIVE/package/scripts/service_check.py b75578b
ambari-server/src/main/resources/stacks/HDP/1.3.2/services/NAGIOS/package/files/check_hive_thrift_port.py c9414f7
ambari-server/src/main/resources/stacks/HDP/1.3.2/services/NAGIOS/package/scripts/params.py 2384e3a
ambari-server/src/main/resources/stacks/HDP/1.3.2/services/NAGIOS/package/templates/hadoop-commands.cfg.j2 ff13c0d
ambari-server/src/main/resources/stacks/HDP/1.3.2/services/NAGIOS/package/templates/hadoop-services.cfg.j2 48bba18
ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/scripts/hive_service.py 294121d
ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/scripts/params.py c1279d8
ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/scripts/service_check.py b75578b
ambari-server/src/main/resources/stacks/HDP/2.0.6/services/NAGIOS/package/files/check_hive_thrift_port.py c9414f7
ambari-server/src/main/resources/stacks/HDP/2.0.6/services/NAGIOS/package/scripts/params.py ba91cfb
ambari-server/src/main/resources/stacks/HDP/2.0.6/services/NAGIOS/package/templates/hadoop-commands.cfg.j2 c1a792c
ambari-server/src/main/resources/stacks/HDP/2.0.6/services/NAGIOS/package/templates/hadoop-services.cfg.j2 0d8b2e8
ambari-server/src/test/python/stacks/1.3.2/HIVE/test_hive_server.py 4dceec1
ambari-server/src/test/python/stacks/1.3.2/HIVE/test_hive_service_check.py ad75ce1
ambari-server/src/test/python/stacks/1.3.2/configs/default.json a39d51d
ambari-server/src/test/python/stacks/1.3.2/configs/secured.json 3e84df6
ambari-server/src/test/python/stacks/2.0.6/HIVE/test_hive_server.py 581b4d3
ambari-server/src/test/python/stacks/2.0.6/HIVE/test_hive_service_check.py 6ba4d48
ambari-server/src/test/python/stacks/2.0.6/configs/default.json 6b68e0b
ambari-server/src/test/python/stacks/2.0.6/configs/secured.json 83b9b9e
Diff: https://reviews.apache.org/r/27740/diff/
Testing
-------
mvn clean test
Thanks,
Andrew Onischuk