You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@thrift.apache.org by "Vaibhav Gumashta (JIRA)" <ji...@apache.org> on 2013/09/25 00:06:03 UTC

[jira] [Comment Edited] (THRIFT-2207) Thrift goes OOM when used in an HTTP over Thrift setting

    [ https://issues.apache.org/jira/browse/THRIFT-2207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13776815#comment-13776815 ] 

Vaibhav Gumashta edited comment on THRIFT-2207 at 9/24/13 10:05 PM:
--------------------------------------------------------------------

*Heap dump of the main thread that went OOM:*
main" prio=5 tid=1 RUNNABLE
	at java.lang.OutOfMemoryError.<init>(OutOfMemoryError.java:25)
	at org.apache.thrift.transport.TSaslTransport.receiveSaslMessage(TSaslTransport.java:181)
	at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:288)
	at org.apache.thrift.transport.TSaslClientTransport.open(TSaslClientTransport.java:37)
	   Local Variable: org.apache.thrift.transport.TSaslClientTransport#1
	at org.apache.hive.service.cli.thrift.TestThriftHttpCLIService.testIncompatibeClientServer(TestThriftHttpCLIService.java:121)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
	   Local Variable: sun.reflect.NativeMethodAccessorImpl#16
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	   Local Variable: sun.reflect.DelegatingMethodAccessorImpl#22
	at java.lang.reflect.Method.invoke(Method.java:597)
	   Local Variable: java.lang.reflect.Method#49
	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:45)
	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:15)
	   Local Variable: org.junit.runners.model.FrameworkMethod$1#1
	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:42)
	   Local Variable: java.lang.Object[]#2425
	   Local Variable: org.apache.hive.service.cli.thrift.TestThriftHttpCLIService#1
	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:20)
	   Local Variable: org.junit.internal.runners.statements.InvokeMethod#1
	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:28)
	   Local Variable: java.util.AbstractList$Itr#2
	   Local Variable: org.junit.internal.runners.statements.RunBefores#2
	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:30)
	   Local Variable: java.util.ArrayList#885
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:263)
	   Local Variable: org.junit.internal.runners.model.EachTestNotifier#2
	   Local Variable: org.junit.internal.runners.statements.RunAfters#2
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:68)
	   Local Variable: org.junit.runner.Description#5
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:47)
	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:231)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:60)
	   Local Variable: org.junit.runners.ParentRunner$3#1
	   Local Variable: org.junit.runners.ParentRunner$1#1
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:229)
	   Local Variable: java.util.AbstractList$Itr#3
	   Local Variable: org.junit.runners.model.FrameworkMethod#3
	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:50)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:222)
	   Local Variable: org.junit.runners.ParentRunner$2#1
	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:28)
	   Local Variable: org.junit.internal.runners.statements.RunBefores#1
	   Local Variable: java.util.AbstractList$Itr#1
	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:30)
	   Local Variable: java.util.ArrayList#1
	at org.junit.runners.ParentRunner.run(ParentRunner.java:300)
	   Local Variable: org.junit.internal.runners.statements.RunAfters#1
	   Local Variable: org.junit.internal.runners.model.EachTestNotifier#1
	   Local Variable: org.junit.runner.notification.RunNotifier#1
	   Local Variable: org.junit.runners.BlockJUnit4ClassRunner#1
	at junit.framework.JUnit4TestAdapter.run(JUnit4TestAdapter.java:39)
	   Local Variable: junit.framework.TestResult#1
	at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:518)
	   Local Variable: java.io.ByteArrayOutputStream#2
	   Local Variable: junit.framework.JUnit4TestAdapter#1
	   Local Variable: java.io.ByteArrayOutputStream#1
	at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:1052)
	   Local Variable: org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner#1
	at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:906)
	   Local Variable: java.lang.String[]#9
	   Local Variable: java.util.Properties#3
	   Local Variable: java.util.Properties#1
	   Local Variable: org.apache.tools.ant.taskdefs.optional.junit.JUnitTest#1

                
      was (Author: vgumashta):
    Heap dump of the main thread that went OOM:
main" prio=5 tid=1 RUNNABLE
	at java.lang.OutOfMemoryError.<init>(OutOfMemoryError.java:25)
	at org.apache.thrift.transport.TSaslTransport.receiveSaslMessage(TSaslTransport.java:181)
	at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:288)
	at org.apache.thrift.transport.TSaslClientTransport.open(TSaslClientTransport.java:37)
	   Local Variable: org.apache.thrift.transport.TSaslClientTransport#1
	at org.apache.hive.service.cli.thrift.TestThriftHttpCLIService.testIncompatibeClientServer(TestThriftHttpCLIService.java:121)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
	   Local Variable: sun.reflect.NativeMethodAccessorImpl#16
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	   Local Variable: sun.reflect.DelegatingMethodAccessorImpl#22
	at java.lang.reflect.Method.invoke(Method.java:597)
	   Local Variable: java.lang.reflect.Method#49
	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:45)
	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:15)
	   Local Variable: org.junit.runners.model.FrameworkMethod$1#1
	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:42)
	   Local Variable: java.lang.Object[]#2425
	   Local Variable: org.apache.hive.service.cli.thrift.TestThriftHttpCLIService#1
	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:20)
	   Local Variable: org.junit.internal.runners.statements.InvokeMethod#1
	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:28)
	   Local Variable: java.util.AbstractList$Itr#2
	   Local Variable: org.junit.internal.runners.statements.RunBefores#2
	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:30)
	   Local Variable: java.util.ArrayList#885
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:263)
	   Local Variable: org.junit.internal.runners.model.EachTestNotifier#2
	   Local Variable: org.junit.internal.runners.statements.RunAfters#2
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:68)
	   Local Variable: org.junit.runner.Description#5
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:47)
	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:231)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:60)
	   Local Variable: org.junit.runners.ParentRunner$3#1
	   Local Variable: org.junit.runners.ParentRunner$1#1
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:229)
	   Local Variable: java.util.AbstractList$Itr#3
	   Local Variable: org.junit.runners.model.FrameworkMethod#3
	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:50)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:222)
	   Local Variable: org.junit.runners.ParentRunner$2#1
	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:28)
	   Local Variable: org.junit.internal.runners.statements.RunBefores#1
	   Local Variable: java.util.AbstractList$Itr#1
	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:30)
	   Local Variable: java.util.ArrayList#1
	at org.junit.runners.ParentRunner.run(ParentRunner.java:300)
	   Local Variable: org.junit.internal.runners.statements.RunAfters#1
	   Local Variable: org.junit.internal.runners.model.EachTestNotifier#1
	   Local Variable: org.junit.runner.notification.RunNotifier#1
	   Local Variable: org.junit.runners.BlockJUnit4ClassRunner#1
	at junit.framework.JUnit4TestAdapter.run(JUnit4TestAdapter.java:39)
	   Local Variable: junit.framework.TestResult#1
	at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:518)
	   Local Variable: java.io.ByteArrayOutputStream#2
	   Local Variable: junit.framework.JUnit4TestAdapter#1
	   Local Variable: java.io.ByteArrayOutputStream#1
	at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:1052)
	   Local Variable: org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner#1
	at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:906)
	   Local Variable: java.lang.String[]#9
	   Local Variable: java.util.Properties#3
	   Local Variable: java.util.Properties#1
	   Local Variable: org.apache.tools.ant.taskdefs.optional.junit.JUnitTest#1

                  
> Thrift goes OOM when used in an HTTP over Thrift setting
> --------------------------------------------------------
>
>                 Key: THRIFT-2207
>                 URL: https://issues.apache.org/jira/browse/THRIFT-2207
>             Project: Thrift
>          Issue Type: Bug
>          Components: Java - Library
>    Affects Versions: 0.9
>            Reporter: Vaibhav Gumashta
>
> I am trying to use HTTP over thrift for HIVE. On the server side, I'm creating a Jetty instance and creating an instance of ThriftHttpServlet to handle the request. However, on client side, if I create a TSocket transport (wrapped in a TSaslClientTransport due to this: [THRIFT-1774|https://issues.apache.org/jira/browse/THRIFT-1774]), transport.open goes out of memory. Although Jetty throws an exception on trying to handle a non-HTTP message, it doesn't seem to be handles in TSaslTransport#receiveSaslMessage.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira