You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@ambari.apache.org by Andrew Onischuk <ao...@hortonworks.com> on 2014/12/03 15:51:39 UTC
Review Request 28646: ambari cluster HS2 health check causing errors
in logs
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/28646/
-----------------------------------------------------------
Review request for Ambari and Dmitro Lisnichenko.
Bugs: AMBARI-8523
https://issues.apache.org/jira/browse/AMBARI-8523
Repository: ambari
Description
-------
The following stack trace is seen every 30 seconds in hiveServer2.log . I
noticed this in a ambari installed secure cluster. It seems to be coming as a
result of some ambari health check command. It is either not using kerberos to
authenticate, or not using proper thrift protocol .
2014-11-04 06:37:01,333 ERROR server.TThreadPoolServer (TThreadPoolServer.java:run(215)) - Error occurred during processing of message.
java.lang.RuntimeException: org.apache.thrift.transport.TTransportException
at org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:219)
at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge20S$Server$TUGIAssumingTransportFactory$1.run(HadoopThriftAuthBridge20S.java:725)
at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge20S$Server$TUGIAssumingTransportFactory$1.run(HadoopThriftAuthBridge20S.java:722)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:356)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1608)
at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge20S$Server$TUGIAssumingTransportFactory.getTransport(HadoopThriftAuthBridge20S.java:722)
at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:189)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.thrift.transport.TTransportException
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:132)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:84)
at org.apache.thrift.transport.TSaslTransport.receiveSaslMessage(TSaslTransport.java:178)
at org.apache.thrift.transport.TSaslServerTransport.handleSaslStartMessage(TSaslServerTransport.java:125)
at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:253)
at org.apache.thrift.transport.TSaslServerTransport.open(TSaslServerTransport.java:41)
at org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:216)
... 10 more
Please assume the following:
> alert_hive_thrift_port.py which is used by the new alerts framework on trunk
uses this method.
>
> is_thrift_port_ok = hive_check.check_thrift_port_sasl(host_name,
thrift_port, security_enabled=security_enabled)
>
> If this code change is for trunk, you'll need to update the new alert
scripts as well. If it's not for trunk, then you can close the issue.
Diffs
-----
ambari-common/src/main/python/resource_management/libraries/functions/hive_check.py 282fed2
ambari-server/src/main/java/org/apache/ambari/server/controller/jetty.xml PRE-CREATION
ambari-server/src/main/resources/stacks/HDP/1.3.2/services/HIVE/package/files/alert_hive_thrift_port.py bd3f276
ambari-server/src/main/resources/stacks/HDP/1.3.2/services/HIVE/package/scripts/hive_service.py 9437843
ambari-server/src/main/resources/stacks/HDP/1.3.2/services/HIVE/package/scripts/params.py f27c28c
ambari-server/src/main/resources/stacks/HDP/1.3.2/services/HIVE/package/scripts/service_check.py b75578b
ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/files/alert_hive_thrift_port.py bd3f276
ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/scripts/hive_service.py ae64c35
ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/scripts/params.py 6e44a0f
ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/scripts/service_check.py b75578b
ambari-server/src/test/python/stacks/1.3.2/HIVE/test_hive_server.py aa88cfd
ambari-server/src/test/python/stacks/1.3.2/HIVE/test_hive_service_check.py ad75ce1
ambari-server/src/test/python/stacks/1.3.2/configs/default.json 3448b83
ambari-server/src/test/python/stacks/2.0.6/HIVE/test_hive_server.py 2e37162
ambari-server/src/test/python/stacks/2.0.6/HIVE/test_hive_service_check.py 6ba4d48
ambari-server/src/test/python/stacks/2.0.6/configs/default.json 4ddc718
Diff: https://reviews.apache.org/r/28646/diff/
Testing
-------
mvn clean test
Thanks,
Andrew Onischuk
Re: Review Request 28646: ambari cluster HS2 health check causing
errors in logs
Posted by Jonathan Hurley <jh...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/28646/#review63674
-----------------------------------------------------------
Ship it!
Ship It!
- Jonathan Hurley
On Dec. 3, 2014, 9:52 a.m., Andrew Onischuk wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/28646/
> -----------------------------------------------------------
>
> (Updated Dec. 3, 2014, 9:52 a.m.)
>
>
> Review request for Ambari, Dmitro Lisnichenko and Jonathan Hurley.
>
>
> Bugs: AMBARI-8523
> https://issues.apache.org/jira/browse/AMBARI-8523
>
>
> Repository: ambari
>
>
> Description
> -------
>
> The following stack trace is seen every 30 seconds in hiveServer2.log . I
> noticed this in a ambari installed secure cluster. It seems to be coming as a
> result of some ambari health check command. It is either not using kerberos to
> authenticate, or not using proper thrift protocol .
>
>
>
> 2014-11-04 06:37:01,333 ERROR server.TThreadPoolServer (TThreadPoolServer.java:run(215)) - Error occurred during processing of message.
> java.lang.RuntimeException: org.apache.thrift.transport.TTransportException
> at org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:219)
> at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge20S$Server$TUGIAssumingTransportFactory$1.run(HadoopThriftAuthBridge20S.java:725)
> at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge20S$Server$TUGIAssumingTransportFactory$1.run(HadoopThriftAuthBridge20S.java:722)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:356)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1608)
> at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge20S$Server$TUGIAssumingTransportFactory.getTransport(HadoopThriftAuthBridge20S.java:722)
> at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:189)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: org.apache.thrift.transport.TTransportException
> at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:132)
> at org.apache.thrift.transport.TTransport.readAll(TTransport.java:84)
> at org.apache.thrift.transport.TSaslTransport.receiveSaslMessage(TSaslTransport.java:178)
> at org.apache.thrift.transport.TSaslServerTransport.handleSaslStartMessage(TSaslServerTransport.java:125)
> at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:253)
> at org.apache.thrift.transport.TSaslServerTransport.open(TSaslServerTransport.java:41)
> at org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:216)
> ... 10 more
>
>
>
> Please assume the following:
>
> > alert_hive_thrift_port.py which is used by the new alerts framework on trunk
> uses this method.
>
> >
>
> > is_thrift_port_ok = hive_check.check_thrift_port_sasl(host_name,
> thrift_port, security_enabled=security_enabled)
>
> >
>
> > If this code change is for trunk, you'll need to update the new alert
> scripts as well. If it's not for trunk, then you can close the issue.
>
>
> Diffs
> -----
>
> ambari-common/src/main/python/resource_management/libraries/functions/hive_check.py 282fed2
> ambari-server/src/main/java/org/apache/ambari/server/controller/jetty.xml PRE-CREATION
> ambari-server/src/main/resources/stacks/HDP/1.3.2/services/HIVE/package/files/alert_hive_thrift_port.py bd3f276
> ambari-server/src/main/resources/stacks/HDP/1.3.2/services/HIVE/package/scripts/hive_service.py 9437843
> ambari-server/src/main/resources/stacks/HDP/1.3.2/services/HIVE/package/scripts/params.py f27c28c
> ambari-server/src/main/resources/stacks/HDP/1.3.2/services/HIVE/package/scripts/service_check.py b75578b
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/files/alert_hive_thrift_port.py bd3f276
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/scripts/hive_service.py ae64c35
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/scripts/params.py 6e44a0f
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/scripts/service_check.py b75578b
> ambari-server/src/test/python/stacks/1.3.2/HIVE/test_hive_server.py aa88cfd
> ambari-server/src/test/python/stacks/1.3.2/HIVE/test_hive_service_check.py ad75ce1
> ambari-server/src/test/python/stacks/1.3.2/configs/default.json 3448b83
> ambari-server/src/test/python/stacks/2.0.6/HIVE/test_hive_server.py 2e37162
> ambari-server/src/test/python/stacks/2.0.6/HIVE/test_hive_service_check.py 6ba4d48
> ambari-server/src/test/python/stacks/2.0.6/configs/default.json 4ddc718
>
> Diff: https://reviews.apache.org/r/28646/diff/
>
>
> Testing
> -------
>
> mvn clean test
>
>
> Thanks,
>
> Andrew Onischuk
>
>
Re: Review Request 28646: ambari cluster HS2 health check causing
errors in logs
Posted by Dmitro Lisnichenko <dl...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/28646/#review63673
-----------------------------------------------------------
Ship it!
Ship It!
- Dmitro Lisnichenko
On Dec. 3, 2014, 2:52 p.m., Andrew Onischuk wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/28646/
> -----------------------------------------------------------
>
> (Updated Dec. 3, 2014, 2:52 p.m.)
>
>
> Review request for Ambari, Dmitro Lisnichenko and Jonathan Hurley.
>
>
> Bugs: AMBARI-8523
> https://issues.apache.org/jira/browse/AMBARI-8523
>
>
> Repository: ambari
>
>
> Description
> -------
>
> The following stack trace is seen every 30 seconds in hiveServer2.log . I
> noticed this in a ambari installed secure cluster. It seems to be coming as a
> result of some ambari health check command. It is either not using kerberos to
> authenticate, or not using proper thrift protocol .
>
>
>
> 2014-11-04 06:37:01,333 ERROR server.TThreadPoolServer (TThreadPoolServer.java:run(215)) - Error occurred during processing of message.
> java.lang.RuntimeException: org.apache.thrift.transport.TTransportException
> at org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:219)
> at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge20S$Server$TUGIAssumingTransportFactory$1.run(HadoopThriftAuthBridge20S.java:725)
> at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge20S$Server$TUGIAssumingTransportFactory$1.run(HadoopThriftAuthBridge20S.java:722)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:356)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1608)
> at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge20S$Server$TUGIAssumingTransportFactory.getTransport(HadoopThriftAuthBridge20S.java:722)
> at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:189)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: org.apache.thrift.transport.TTransportException
> at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:132)
> at org.apache.thrift.transport.TTransport.readAll(TTransport.java:84)
> at org.apache.thrift.transport.TSaslTransport.receiveSaslMessage(TSaslTransport.java:178)
> at org.apache.thrift.transport.TSaslServerTransport.handleSaslStartMessage(TSaslServerTransport.java:125)
> at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:253)
> at org.apache.thrift.transport.TSaslServerTransport.open(TSaslServerTransport.java:41)
> at org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:216)
> ... 10 more
>
>
>
> Please assume the following:
>
> > alert_hive_thrift_port.py which is used by the new alerts framework on trunk
> uses this method.
>
> >
>
> > is_thrift_port_ok = hive_check.check_thrift_port_sasl(host_name,
> thrift_port, security_enabled=security_enabled)
>
> >
>
> > If this code change is for trunk, you'll need to update the new alert
> scripts as well. If it's not for trunk, then you can close the issue.
>
>
> Diffs
> -----
>
> ambari-common/src/main/python/resource_management/libraries/functions/hive_check.py 282fed2
> ambari-server/src/main/java/org/apache/ambari/server/controller/jetty.xml PRE-CREATION
> ambari-server/src/main/resources/stacks/HDP/1.3.2/services/HIVE/package/files/alert_hive_thrift_port.py bd3f276
> ambari-server/src/main/resources/stacks/HDP/1.3.2/services/HIVE/package/scripts/hive_service.py 9437843
> ambari-server/src/main/resources/stacks/HDP/1.3.2/services/HIVE/package/scripts/params.py f27c28c
> ambari-server/src/main/resources/stacks/HDP/1.3.2/services/HIVE/package/scripts/service_check.py b75578b
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/files/alert_hive_thrift_port.py bd3f276
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/scripts/hive_service.py ae64c35
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/scripts/params.py 6e44a0f
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/scripts/service_check.py b75578b
> ambari-server/src/test/python/stacks/1.3.2/HIVE/test_hive_server.py aa88cfd
> ambari-server/src/test/python/stacks/1.3.2/HIVE/test_hive_service_check.py ad75ce1
> ambari-server/src/test/python/stacks/1.3.2/configs/default.json 3448b83
> ambari-server/src/test/python/stacks/2.0.6/HIVE/test_hive_server.py 2e37162
> ambari-server/src/test/python/stacks/2.0.6/HIVE/test_hive_service_check.py 6ba4d48
> ambari-server/src/test/python/stacks/2.0.6/configs/default.json 4ddc718
>
> Diff: https://reviews.apache.org/r/28646/diff/
>
>
> Testing
> -------
>
> mvn clean test
>
>
> Thanks,
>
> Andrew Onischuk
>
>
Re: Review Request 28646: ambari cluster HS2 health check causing
errors in logs
Posted by Dmitro Lisnichenko <dl...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/28646/#review63830
-----------------------------------------------------------
Ship it!
Ship It!
- Dmitro Lisnichenko
On Dec. 3, 2014, 8:36 p.m., Andrew Onischuk wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/28646/
> -----------------------------------------------------------
>
> (Updated Dec. 3, 2014, 8:36 p.m.)
>
>
> Review request for Ambari, Dmitro Lisnichenko and Jonathan Hurley.
>
>
> Bugs: AMBARI-8523
> https://issues.apache.org/jira/browse/AMBARI-8523
>
>
> Repository: ambari
>
>
> Description
> -------
>
> The following stack trace is seen every 30 seconds in hiveServer2.log . I
> noticed this in a ambari installed secure cluster. It seems to be coming as a
> result of some ambari health check command. It is either not using kerberos to
> authenticate, or not using proper thrift protocol .
>
>
>
> 2014-11-04 06:37:01,333 ERROR server.TThreadPoolServer (TThreadPoolServer.java:run(215)) - Error occurred during processing of message.
> java.lang.RuntimeException: org.apache.thrift.transport.TTransportException
> at org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:219)
> at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge20S$Server$TUGIAssumingTransportFactory$1.run(HadoopThriftAuthBridge20S.java:725)
> at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge20S$Server$TUGIAssumingTransportFactory$1.run(HadoopThriftAuthBridge20S.java:722)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:356)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1608)
> at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge20S$Server$TUGIAssumingTransportFactory.getTransport(HadoopThriftAuthBridge20S.java:722)
> at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:189)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: org.apache.thrift.transport.TTransportException
> at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:132)
> at org.apache.thrift.transport.TTransport.readAll(TTransport.java:84)
> at org.apache.thrift.transport.TSaslTransport.receiveSaslMessage(TSaslTransport.java:178)
> at org.apache.thrift.transport.TSaslServerTransport.handleSaslStartMessage(TSaslServerTransport.java:125)
> at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:253)
> at org.apache.thrift.transport.TSaslServerTransport.open(TSaslServerTransport.java:41)
> at org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:216)
> ... 10 more
>
>
>
> Please assume the following:
>
> > alert_hive_thrift_port.py which is used by the new alerts framework on trunk
> uses this method.
>
> >
>
> > is_thrift_port_ok = hive_check.check_thrift_port_sasl(host_name,
> thrift_port, security_enabled=security_enabled)
>
> >
>
> > If this code change is for trunk, you'll need to update the new alert
> scripts as well. If it's not for trunk, then you can close the issue.
>
>
> Diffs
> -----
>
> ambari-common/src/main/python/resource_management/libraries/functions/hive_check.py 282fed2
> ambari-server/src/main/resources/stacks/HDP/1.3.2/services/HIVE/package/files/alert_hive_thrift_port.py bd3f276
> ambari-server/src/main/resources/stacks/HDP/1.3.2/services/HIVE/package/scripts/hive_service.py 9437843
> ambari-server/src/main/resources/stacks/HDP/1.3.2/services/HIVE/package/scripts/params.py f27c28c
> ambari-server/src/main/resources/stacks/HDP/1.3.2/services/HIVE/package/scripts/service_check.py b75578b
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/files/alert_hive_thrift_port.py bd3f276
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/scripts/hive_service.py ae64c35
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/scripts/params.py 6e44a0f
> ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/scripts/service_check.py b75578b
> ambari-server/src/test/python/stacks/1.3.2/HIVE/test_hive_server.py aa88cfd
> ambari-server/src/test/python/stacks/1.3.2/HIVE/test_hive_service_check.py ad75ce1
> ambari-server/src/test/python/stacks/1.3.2/configs/default.json 3448b83
> ambari-server/src/test/python/stacks/2.0.6/HIVE/test_hive_server.py 2e37162
> ambari-server/src/test/python/stacks/2.0.6/HIVE/test_hive_service_check.py 6ba4d48
> ambari-server/src/test/python/stacks/2.0.6/configs/default.json 4ddc718
>
> Diff: https://reviews.apache.org/r/28646/diff/
>
>
> Testing
> -------
>
> mvn clean test
>
>
> Thanks,
>
> Andrew Onischuk
>
>
Re: Review Request 28646: ambari cluster HS2 health check causing
errors in logs
Posted by Andrew Onischuk <ao...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/28646/
-----------------------------------------------------------
(Updated Dec. 3, 2014, 8:36 p.m.)
Review request for Ambari, Dmitro Lisnichenko and Jonathan Hurley.
Bugs: AMBARI-8523
https://issues.apache.org/jira/browse/AMBARI-8523
Repository: ambari
Description
-------
The following stack trace is seen every 30 seconds in hiveServer2.log . I
noticed this in a ambari installed secure cluster. It seems to be coming as a
result of some ambari health check command. It is either not using kerberos to
authenticate, or not using proper thrift protocol .
2014-11-04 06:37:01,333 ERROR server.TThreadPoolServer (TThreadPoolServer.java:run(215)) - Error occurred during processing of message.
java.lang.RuntimeException: org.apache.thrift.transport.TTransportException
at org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:219)
at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge20S$Server$TUGIAssumingTransportFactory$1.run(HadoopThriftAuthBridge20S.java:725)
at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge20S$Server$TUGIAssumingTransportFactory$1.run(HadoopThriftAuthBridge20S.java:722)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:356)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1608)
at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge20S$Server$TUGIAssumingTransportFactory.getTransport(HadoopThriftAuthBridge20S.java:722)
at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:189)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.thrift.transport.TTransportException
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:132)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:84)
at org.apache.thrift.transport.TSaslTransport.receiveSaslMessage(TSaslTransport.java:178)
at org.apache.thrift.transport.TSaslServerTransport.handleSaslStartMessage(TSaslServerTransport.java:125)
at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:253)
at org.apache.thrift.transport.TSaslServerTransport.open(TSaslServerTransport.java:41)
at org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:216)
... 10 more
Please assume the following:
> alert_hive_thrift_port.py which is used by the new alerts framework on trunk
uses this method.
>
> is_thrift_port_ok = hive_check.check_thrift_port_sasl(host_name,
thrift_port, security_enabled=security_enabled)
>
> If this code change is for trunk, you'll need to update the new alert
scripts as well. If it's not for trunk, then you can close the issue.
Diffs (updated)
-----
ambari-common/src/main/python/resource_management/libraries/functions/hive_check.py 282fed2
ambari-server/src/main/resources/stacks/HDP/1.3.2/services/HIVE/package/files/alert_hive_thrift_port.py bd3f276
ambari-server/src/main/resources/stacks/HDP/1.3.2/services/HIVE/package/scripts/hive_service.py 9437843
ambari-server/src/main/resources/stacks/HDP/1.3.2/services/HIVE/package/scripts/params.py f27c28c
ambari-server/src/main/resources/stacks/HDP/1.3.2/services/HIVE/package/scripts/service_check.py b75578b
ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/files/alert_hive_thrift_port.py bd3f276
ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/scripts/hive_service.py ae64c35
ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/scripts/params.py 6e44a0f
ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/scripts/service_check.py b75578b
ambari-server/src/test/python/stacks/1.3.2/HIVE/test_hive_server.py aa88cfd
ambari-server/src/test/python/stacks/1.3.2/HIVE/test_hive_service_check.py ad75ce1
ambari-server/src/test/python/stacks/1.3.2/configs/default.json 3448b83
ambari-server/src/test/python/stacks/2.0.6/HIVE/test_hive_server.py 2e37162
ambari-server/src/test/python/stacks/2.0.6/HIVE/test_hive_service_check.py 6ba4d48
ambari-server/src/test/python/stacks/2.0.6/configs/default.json 4ddc718
Diff: https://reviews.apache.org/r/28646/diff/
Testing
-------
mvn clean test
Thanks,
Andrew Onischuk
Re: Review Request 28646: ambari cluster HS2 health check causing
errors in logs
Posted by Andrew Onischuk <ao...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/28646/
-----------------------------------------------------------
(Updated Dec. 3, 2014, 2:52 p.m.)
Review request for Ambari, Dmitro Lisnichenko and Jonathan Hurley.
Bugs: AMBARI-8523
https://issues.apache.org/jira/browse/AMBARI-8523
Repository: ambari
Description
-------
The following stack trace is seen every 30 seconds in hiveServer2.log . I
noticed this in a ambari installed secure cluster. It seems to be coming as a
result of some ambari health check command. It is either not using kerberos to
authenticate, or not using proper thrift protocol .
2014-11-04 06:37:01,333 ERROR server.TThreadPoolServer (TThreadPoolServer.java:run(215)) - Error occurred during processing of message.
java.lang.RuntimeException: org.apache.thrift.transport.TTransportException
at org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:219)
at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge20S$Server$TUGIAssumingTransportFactory$1.run(HadoopThriftAuthBridge20S.java:725)
at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge20S$Server$TUGIAssumingTransportFactory$1.run(HadoopThriftAuthBridge20S.java:722)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:356)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1608)
at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge20S$Server$TUGIAssumingTransportFactory.getTransport(HadoopThriftAuthBridge20S.java:722)
at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:189)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.thrift.transport.TTransportException
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:132)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:84)
at org.apache.thrift.transport.TSaslTransport.receiveSaslMessage(TSaslTransport.java:178)
at org.apache.thrift.transport.TSaslServerTransport.handleSaslStartMessage(TSaslServerTransport.java:125)
at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:253)
at org.apache.thrift.transport.TSaslServerTransport.open(TSaslServerTransport.java:41)
at org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:216)
... 10 more
Please assume the following:
> alert_hive_thrift_port.py which is used by the new alerts framework on trunk
uses this method.
>
> is_thrift_port_ok = hive_check.check_thrift_port_sasl(host_name,
thrift_port, security_enabled=security_enabled)
>
> If this code change is for trunk, you'll need to update the new alert
scripts as well. If it's not for trunk, then you can close the issue.
Diffs
-----
ambari-common/src/main/python/resource_management/libraries/functions/hive_check.py 282fed2
ambari-server/src/main/java/org/apache/ambari/server/controller/jetty.xml PRE-CREATION
ambari-server/src/main/resources/stacks/HDP/1.3.2/services/HIVE/package/files/alert_hive_thrift_port.py bd3f276
ambari-server/src/main/resources/stacks/HDP/1.3.2/services/HIVE/package/scripts/hive_service.py 9437843
ambari-server/src/main/resources/stacks/HDP/1.3.2/services/HIVE/package/scripts/params.py f27c28c
ambari-server/src/main/resources/stacks/HDP/1.3.2/services/HIVE/package/scripts/service_check.py b75578b
ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/files/alert_hive_thrift_port.py bd3f276
ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/scripts/hive_service.py ae64c35
ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/scripts/params.py 6e44a0f
ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HIVE/package/scripts/service_check.py b75578b
ambari-server/src/test/python/stacks/1.3.2/HIVE/test_hive_server.py aa88cfd
ambari-server/src/test/python/stacks/1.3.2/HIVE/test_hive_service_check.py ad75ce1
ambari-server/src/test/python/stacks/1.3.2/configs/default.json 3448b83
ambari-server/src/test/python/stacks/2.0.6/HIVE/test_hive_server.py 2e37162
ambari-server/src/test/python/stacks/2.0.6/HIVE/test_hive_service_check.py 6ba4d48
ambari-server/src/test/python/stacks/2.0.6/configs/default.json 4ddc718
Diff: https://reviews.apache.org/r/28646/diff/
Testing
-------
mvn clean test
Thanks,
Andrew Onischuk