[jira] [Updated] (HIVE-11004) PermGen OOM error in Hiveserver2

["Martin Benson (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HIVE-11004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Martin Benson updated HIVE-11004:
---------------------------------
    Summary: PermGen OOM error in Hiveserver2  (was: PermGen)

> PermGen OOM error in Hiveserver2
> --------------------------------
>
>                 Key: HIVE-11004
>                 URL: https://issues.apache.org/jira/browse/HIVE-11004
>             Project: Hive
>          Issue Type: Bug
>          Components: HiveServer2
>    Affects Versions: 1.1.0
>         Environment: cdh 5.4
>            Reporter: Martin Benson
>            Priority: Critical
>
> Periodically Hiveserver2 will become unresponsive and looking in the logs there is the following error:
> 2:28:22.965 PM	ERROR	org.apache.hadoop.hive.ql.io.orc.OrcInputFormat	
> Unexpected Exception
> java.lang.OutOfMemoryError: PermGen space
> 2:28:22.969 PM	WARN	org.apache.hive.service.cli.thrift.ThriftCLIService	
> Error fetching results: 
> org.apache.hive.service.cli.HiveSQLException: java.io.IOException: java.lang.RuntimeException: serious problem
> 	at org.apache.hive.service.cli.operation.SQLOperation.getNextRowSet(SQLOperation.java:343)
> 	at org.apache.hive.service.cli.operation.OperationManager.getOperationNextRowSet(OperationManager.java:250)
> 	at org.apache.hive.service.cli.session.HiveSessionImpl.fetchResults(HiveSessionImpl.java:656)
> 	at org.apache.hive.service.cli.CLIService.fetchResults(CLIService.java:451)
> 	at org.apache.hive.service.cli.thrift.ThriftCLIService.FetchResults(ThriftCLIService.java:672)
> 	at org.apache.hive.service.cli.thrift.TCLIService$Processor$FetchResults.getResult(TCLIService.java:1553)
> 	at org.apache.hive.service.cli.thrift.TCLIService$Processor$FetchResults.getResult(TCLIService.java:1538)
> 	at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
> 	at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
> 	at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge$Server$TUGIAssumingProcessor.process(HadoopThriftAuthBridge.java:692)
> 	at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:285)
> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> 	at java.lang.Thread.run(Thread.java:745)
> Caused by: java.io.IOException: java.lang.RuntimeException: serious problem
> 	at org.apache.hadoop.hive.ql.exec.FetchOperator.getNextRow(FetchOperator.java:507)
> 	at org.apache.hadoop.hive.ql.exec.FetchOperator.pushRow(FetchOperator.java:414)
> 	at org.apache.hadoop.hive.ql.exec.FetchTask.fetch(FetchTask.java:138)
> 	at org.apache.hadoop.hive.ql.Driver.getResults(Driver.java:1655)
> 	at org.apache.hive.service.cli.operation.SQLOperation.getNextRowSet(SQLOperation.java:338)
> 	... 13 more
> Caused by: java.lang.RuntimeException: serious problem
> 	at org.apache.hadoop.hive.ql.io.orc.OrcInputFormat$Context.waitForTasks(OrcInputFormat.java:478)
> 	at org.apache.hadoop.hive.ql.io.orc.OrcInputFormat.generateSplitsInfo(OrcInputFormat.java:944)
> 	at org.apache.hadoop.hive.ql.io.orc.OrcInputFormat.getSplits(OrcInputFormat.java:969)
> 	at org.apache.hadoop.hive.ql.exec.FetchOperator.getNextSplits(FetchOperator.java:362)
> 	at org.apache.hadoop.hive.ql.exec.FetchOperator.getRecordReader(FetchOperator.java:294)
> 	at org.apache.hadoop.hive.ql.exec.FetchOperator.getNextRow(FetchOperator.java:445)
> 	... 17 more
> Caused by: java.lang.OutOfMemoryError: PermGen space
> There does not appear to be an obvious trigger for this (other than the fact that the error mentions ORC). If further details would be helpful in diagnosing the issue please let me know and I'll supply them.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)