You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "royal (Jira)" <ji...@apache.org> on 2022/05/09 13:26:00 UTC
[jira] [Updated] (HIVE-26212) hive fetch data timeout
[ https://issues.apache.org/jira/browse/HIVE-26212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
royal updated HIVE-26212:
-------------------------
Description:
When i fetch data from hive, The following error message appears, I think it's related to the size of the data
2022-05-09 19:28:17,156 INFO org.apache.hadoop.mapred.FileInputFormat: [HiveServer2-Handler-Pool: Thread-773525]: Total input paths to process : 47751
2022-05-09 19:30:19,729 WARN org.apache.hadoop.hive.conf.HiveConf: [HiveServer2-Handler-Pool: Thread-773521]: HiveConf of name hive.server2.idle.session.timeout_check_operation does not exist
2022-05-09 19:30:19,729 WARN org.apache.hadoop.hive.conf.HiveConf: [HiveServer2-Handler-Pool: Thread-773521]: HiveConf of name hive.sentry.conf.url does not exist
2022-05-09 19:30:19,729 WARN org.apache.hadoop.hive.conf.HiveConf: [HiveServer2-Handler-Pool: Thread-773521]: HiveConf of name hive.entity.capture.input.URI does not exist
2022-05-09 19:30:19,733 INFO org.apache.hadoop.hive.ql.exec.ListSinkOperator: [HiveServer2-Handler-Pool: Thread-773521]: 749375 finished. closing...
2022-05-09 19:30:19,733 INFO org.apache.hadoop.hive.ql.exec.ListSinkOperator: [HiveServer2-Handler-Pool: Thread-773521]: 749375 Close done
2022-05-09 19:30:19,733 INFO org.apache.hadoop.hive.ql.exec.ListSinkOperator: [HiveServer2-Handler-Pool: Thread-773521]: Initializing Self OP[749375]
2022-05-09 19:30:19,733 INFO org.apache.hadoop.hive.ql.exec.ListSinkOperator: [HiveServer2-Handler-Pool: Thread-773521]: Operator 749375 OP initialized
2022-05-09 19:30:19,733 INFO org.apache.hadoop.hive.ql.exec.ListSinkOperator: [HiveServer2-Handler-Pool: Thread-773521]: Initialization Done 749375 OP
2022-05-09 19:30:19,741 WARN org.apache.hive.service.cli.thrift.ThriftCLIService: [HiveServer2-Handler-Pool: Thread-773525]: Error fetching results:
org.apache.hive.service.cli.HiveSQLException: java.io.IOException: java.lang.NullPointerException
at org.apache.hive.service.cli.operation.SQLOperation.getNextRowSet(SQLOperation.java:463)
at org.apache.hive.service.cli.operation.OperationManager.getOperationNextRowSet(OperationManager.java:294)
at org.apache.hive.service.cli.session.HiveSessionImpl.fetchResults(HiveSessionImpl.java:769)
at org.apache.hive.service.cli.CLIService.fetchResults(CLIService.java:462)
at org.apache.hive.service.cli.thrift.ThriftCLIService.FetchResults(ThriftCLIService.java:694)
at org.apache.hive.service.cli.thrift.TCLIService$Processor$FetchResults.getResult(TCLIService.java:1553)
at org.apache.hive.service.cli.thrift.TCLIService$Processor$FetchResults.getResult(TCLIService.java:1538)
at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge$Server$TUGIAssumingProcessor.process(HadoopThriftAuthBridge.java:706)
at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:286)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.io.IOException: java.lang.NullPointerException
at org.apache.hadoop.hive.ql.exec.FetchOperator.getNextRow(FetchOperator.java:508)
at org.apache.hadoop.hive.ql.exec.FetchOperator.pushRow(FetchOperator.java:415)
at org.apache.hadoop.hive.ql.exec.FetchTask.fetch(FetchTask.java:140)
at org.apache.hadoop.hive.ql.Driver.getResults(Driver.java:2071)
at org.apache.hive.service.cli.operation.SQLOperation.getNextRowSet(SQLOperation.java:458)
... 13 more
Caused by: java.lang.NullPointerException
at org.apache.hadoop.hive.ql.exec.FetchOperator.getNextPath(FetchOperator.java:255)
at org.apache.hadoop.hive.ql.exec.FetchOperator.getNextSplits(FetchOperator.java:350)
at org.apache.hadoop.hive.ql.exec.FetchOperator.getRecordReader(FetchOperator.java:295)
at org.apache.hadoop.hive.ql.exec.FetchOperator.getNextRow(FetchOperator.java:446)
... 17 more
Reply
0 KUDOS
> hive fetch data timeout
> -----------------------
>
> Key: HIVE-26212
> URL: https://issues.apache.org/jira/browse/HIVE-26212
> Project: Hive
> Issue Type: Bug
> Components: HiveServer2
> Affects Versions: 1.1.0
> Reporter: royal
> Priority: Major
>
> When i fetch data from hive, The following error message appears, I think it's related to the size of the data
>
> 2022-05-09 19:28:17,156 INFO org.apache.hadoop.mapred.FileInputFormat: [HiveServer2-Handler-Pool: Thread-773525]: Total input paths to process : 47751
> 2022-05-09 19:30:19,729 WARN org.apache.hadoop.hive.conf.HiveConf: [HiveServer2-Handler-Pool: Thread-773521]: HiveConf of name hive.server2.idle.session.timeout_check_operation does not exist
> 2022-05-09 19:30:19,729 WARN org.apache.hadoop.hive.conf.HiveConf: [HiveServer2-Handler-Pool: Thread-773521]: HiveConf of name hive.sentry.conf.url does not exist
> 2022-05-09 19:30:19,729 WARN org.apache.hadoop.hive.conf.HiveConf: [HiveServer2-Handler-Pool: Thread-773521]: HiveConf of name hive.entity.capture.input.URI does not exist
> 2022-05-09 19:30:19,733 INFO org.apache.hadoop.hive.ql.exec.ListSinkOperator: [HiveServer2-Handler-Pool: Thread-773521]: 749375 finished. closing...
> 2022-05-09 19:30:19,733 INFO org.apache.hadoop.hive.ql.exec.ListSinkOperator: [HiveServer2-Handler-Pool: Thread-773521]: 749375 Close done
> 2022-05-09 19:30:19,733 INFO org.apache.hadoop.hive.ql.exec.ListSinkOperator: [HiveServer2-Handler-Pool: Thread-773521]: Initializing Self OP[749375]
> 2022-05-09 19:30:19,733 INFO org.apache.hadoop.hive.ql.exec.ListSinkOperator: [HiveServer2-Handler-Pool: Thread-773521]: Operator 749375 OP initialized
> 2022-05-09 19:30:19,733 INFO org.apache.hadoop.hive.ql.exec.ListSinkOperator: [HiveServer2-Handler-Pool: Thread-773521]: Initialization Done 749375 OP
> 2022-05-09 19:30:19,741 WARN org.apache.hive.service.cli.thrift.ThriftCLIService: [HiveServer2-Handler-Pool: Thread-773525]: Error fetching results:
> org.apache.hive.service.cli.HiveSQLException: java.io.IOException: java.lang.NullPointerException
> at org.apache.hive.service.cli.operation.SQLOperation.getNextRowSet(SQLOperation.java:463)
> at org.apache.hive.service.cli.operation.OperationManager.getOperationNextRowSet(OperationManager.java:294)
> at org.apache.hive.service.cli.session.HiveSessionImpl.fetchResults(HiveSessionImpl.java:769)
> at org.apache.hive.service.cli.CLIService.fetchResults(CLIService.java:462)
> at org.apache.hive.service.cli.thrift.ThriftCLIService.FetchResults(ThriftCLIService.java:694)
> at org.apache.hive.service.cli.thrift.TCLIService$Processor$FetchResults.getResult(TCLIService.java:1553)
> at org.apache.hive.service.cli.thrift.TCLIService$Processor$FetchResults.getResult(TCLIService.java:1538)
> at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
> at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
> at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge$Server$TUGIAssumingProcessor.process(HadoopThriftAuthBridge.java:706)
> at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:286)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)
> Caused by: java.io.IOException: java.lang.NullPointerException
> at org.apache.hadoop.hive.ql.exec.FetchOperator.getNextRow(FetchOperator.java:508)
> at org.apache.hadoop.hive.ql.exec.FetchOperator.pushRow(FetchOperator.java:415)
> at org.apache.hadoop.hive.ql.exec.FetchTask.fetch(FetchTask.java:140)
> at org.apache.hadoop.hive.ql.Driver.getResults(Driver.java:2071)
> at org.apache.hive.service.cli.operation.SQLOperation.getNextRowSet(SQLOperation.java:458)
> ... 13 more
> Caused by: java.lang.NullPointerException
> at org.apache.hadoop.hive.ql.exec.FetchOperator.getNextPath(FetchOperator.java:255)
> at org.apache.hadoop.hive.ql.exec.FetchOperator.getNextSplits(FetchOperator.java:350)
> at org.apache.hadoop.hive.ql.exec.FetchOperator.getRecordReader(FetchOperator.java:295)
> at org.apache.hadoop.hive.ql.exec.FetchOperator.getNextRow(FetchOperator.java:446)
> ... 17 more
> Reply
>
> 0 KUDOS
>
--
This message was sent by Atlassian Jira
(v8.20.7#820007)