You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Vaibhav Gumashta (JIRA)" <ji...@apache.org> on 2014/04/03 03:35:15 UTC
[jira] [Commented] (HIVE-6468) HS2 out of memory error when curl
sends a get request
[ https://issues.apache.org/jira/browse/HIVE-6468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13958420#comment-13958420 ]
Vaibhav Gumashta commented on HIVE-6468:
----------------------------------------
[~navis] HiveServer2 can run in http mode (I just updated the wiki [Setting+up+HiveServer2|https://cwiki.apache.org/confluence/display/Hive/Setting+up+HiveServer2]), where basically the thrift RPC calls happen over http. In the http mode, there is an embedded jetty instance listening on the port which HiveServer2 was started on.
[~leftylev] I will modify the warning message to indicate that even in http mode, the message body is thrift payloads.
Thanks!
> HS2 out of memory error when curl sends a get request
> -----------------------------------------------------
>
> Key: HIVE-6468
> URL: https://issues.apache.org/jira/browse/HIVE-6468
> Project: Hive
> Issue Type: Bug
> Affects Versions: 0.12.0
> Environment: Centos 6.3, hive 12, hadoop-2.2
> Reporter: Abin Shahab
> Assignee: Navis
> Attachments: HIVE-6468.1.patch.txt
>
>
> We see an out of memory error when we run simple beeline calls.
> (The hive.server2.transport.mode is binary)
> curl localhost:10000
> Exception in thread "pool-2-thread-8" java.lang.OutOfMemoryError: Java heap space
> at org.apache.thrift.transport.TSaslTransport.receiveSaslMessage(TSaslTransport.java:181)
> at org.apache.thrift.transport.TSaslServerTransport.handleSaslStartMessage(TSaslServerTransport.java:125)
> at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:253)
> at org.apache.thrift.transport.TSaslServerTransport.open(TSaslServerTransport.java:41)
> at org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:216)
> at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:189)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:744)
--
This message was sent by Atlassian JIRA
(v6.2#6252)
Re: [jira] [Updated] (HIVE-6468) HS2 out of memory error when curl
sends a get request
Posted by Edward Capriolo <ed...@gmail.com>.
I believe thrift has two transports , framed an unframed, cassandra used to
topple over with random messagea to thrift. We should look at how they
hardened it.
On Wednesday, April 2, 2014, Vaibhav Gumashta (JIRA) <ji...@apache.org>
wrote:
>
> [
https://issues.apache.org/jira/browse/HIVE-6468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13958420#comment-13958420]
>
> Vaibhav Gumashta commented on HIVE-6468:
> ----------------------------------------
>
> [~navis] HiveServer2 can run in http mode (I just updated the wiki
[Setting+up+HiveServer2|
https://cwiki.apache.org/confluence/display/Hive/Setting+up+HiveServer2]),
where basically the thrift RPC calls happen over http. In the http mode,
there is an embedded jetty instance listening on the port which HiveServer2
was started on.
>
> [~leftylev] I will modify the warning message to indicate that even in
http mode, the message body is thrift payloads.
> Thanks!
>
>> HS2 out of memory error when curl sends a get request
>> -----------------------------------------------------
>>
>> Key: HIVE-6468
>> URL: https://issues.apache.org/jira/browse/HIVE-6468
>> Project: Hive
>> Issue Type: Bug
>> Affects Versions: 0.12.0
>> Environment: Centos 6.3, hive 12, hadoop-2.2
>> Reporter: Abin Shahab
>> Assignee: Navis
>> Attachments: HIVE-6468.1.patch.txt
>>
>>
>> We see an out of memory error when we run simple beeline calls.
>> (The hive.server2.transport.mode is binary)
>> curl localhost:10000
>> Exception in thread "pool-2-thread-8" java.lang.OutOfMemoryError: Java
heap space
>> at
org.apache.thrift.transport.TSaslTransport.receiveSaslMessage(TSaslTransport.java:181)
>> at
org.apache.thrift.transport.TSaslServerTransport.handleSaslStartMessage(TSaslServerTransport.java:125)
>> at
org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:253)
>> at
org.apache.thrift.transport.TSaslServerTransport.open(TSaslServerTransport.java:41)
>> at
org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:216)
>> at
org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:189)
>> at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>> at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>> at java.lang.Thread.run(Thread.java:744)
>
>
>
> --
> This message was sent by Atlassian JIRA
> (v6.2#6252)
>
--
Sorry this was sent from mobile. Will do less grammar and spell check than
usual.