You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Hongwei Lu (Jira)" <ji...@apache.org> on 2022/05/31 03:47:00 UTC
[jira] [Commented] (HIVE-25094) when easily insert row with hive, got ERROR exec.StatsTask: Failed to run stats task
[ https://issues.apache.org/jira/browse/HIVE-25094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17544113#comment-17544113 ]
Hongwei Lu commented on HIVE-25094:
-----------------------------------
I met the same error,have you relsoved it? :(
> when easily insert row with hive, got ERROR exec.StatsTask: Failed to run stats task
> ------------------------------------------------------------------------------------
>
> Key: HIVE-25094
> URL: https://issues.apache.org/jira/browse/HIVE-25094
> Project: Hive
> Issue Type: Bug
> Components: Hive
> Affects Versions: 3.1.2
> Environment: OS: CentOS 7 based on VMWare 16
> MEM:4G
> DISK:40G
> CPU: hostcpu: interl i5-10gen
> HADOOP 3.1.3, one namenode, two datanode
> HIVE 3.1.2 with metadata changed to mysql
> Reporter: Lei Su
> Priority: Major
>
> Dear profeesors,
> As described, after installing hadoop 3.1.3 and hive 3.1.2, I easily insert one row into a simple table with SQL
> Hive> insert into test2 values ('aaa') ;
> I got FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.StatsTask
> Then I check into the detailed log, found it seems something wrong with the hive stats task on coding level, part of the detailed logs as follows for your reference
> would you please kindly take a look and advise ?
> thanks in advance and kind regards
> Lei
> "
> 2021-05-06T14:30:32,609 INFO [38c1f98d-9d5a-4bb6-b052-e63eda036c08 main] metastore.RetryingMetaStoreClient: RetryingMetaStoreClient trying reconnect as root (auth:SIMPLE)
> 2021-05-06T14:30:32,609 INFO [38c1f98d-9d5a-4bb6-b052-e63eda036c08 main] metastore.HiveMetaStoreClient: Closed a connection to metastore, current connections: 1
> 2021-05-06T14:30:32,610 INFO [38c1f98d-9d5a-4bb6-b052-e63eda036c08 main] metastore.HiveMetaStoreClient: Trying to connect to metastore with URI thrift://master:9083
> 2021-05-06T14:30:32,610 INFO [38c1f98d-9d5a-4bb6-b052-e63eda036c08 main] metastore.HiveMetaStoreClient: Opened a connection to metastore, current connections: 2
> 2021-05-06T14:30:32,611 INFO [38c1f98d-9d5a-4bb6-b052-e63eda036c08 main] metastore.HiveMetaStoreClient: Connected to metastore.
> 2021-05-06T14:30:32,657 ERROR [38c1f98d-9d5a-4bb6-b052-e63eda036c08 main] exec.StatsTask: Failed to run stats task
> org.apache.hadoop.hive.ql.metadata.HiveException: org.apache.thrift.transport.TTransportException
> at org.apache.hadoop.hive.ql.metadata.Hive.setPartitionColumnStatistics(Hive.java:4423) ~[hive-exec-3.1.2.jar:3.1.2]
> at org.apache.hadoop.hive.ql.stats.ColStatsProcessor.persistColumnStats(ColStatsProcessor.java:179) ~[hive-exec-3.1.2.jar:3.1.2]
> at org.apache.hadoop.hive.ql.stats.ColStatsProcessor.process(ColStatsProcessor.java:83) ~[hive-exec-3.1.2.jar:3.1.2]
> at org.apache.hadoop.hive.ql.exec.StatsTask.execute(StatsTask.java:108) ~[hive-exec-3.1.2.jar:3.1.2]
> at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:205) ~[hive-exec-3.1.2.jar:3.1.2]
> at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:97) ~[hive-exec-3.1.2.jar:3.1.2]
> at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:2664) ~[hive-exec-3.1.2.jar:3.1.2]
> at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:2335) ~[hive-exec-3.1.2.jar:3.1.2]
> at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:2011) ~[hive-exec-3.1.2.jar:3.1.2]
> at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1709) ~[hive-exec-3.1.2.jar:3.1.2]
> at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1703) ~[hive-exec-3.1.2.jar:3.1.2]
> at org.apache.hadoop.hive.ql.reexec.ReExecDriver.run(ReExecDriver.java:157) ~[hive-exec-3.1.2.jar:3.1.2]
> at org.apache.hadoop.hive.ql.reexec.ReExecDriver.run(ReExecDriver.java:218) ~[hive-exec-3.1.2.jar:3.1.2]
> at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:239) ~[hive-cli-3.1.2.jar:3.1.2]
> at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:188) ~[hive-cli-3.1.2.jar:3.1.2]
> at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:402) ~[hive-cli-3.1.2.jar:3.1.2]
> at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:821) ~[hive-cli-3.1.2.jar:3.1.2]
> at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:759) ~[hive-cli-3.1.2.jar:3.1.2]
> at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:683) ~[hive-cli-3.1.2.jar:3.1.2]
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_212]
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_212]
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_212]
> at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_212]
> at org.apache.hadoop.util.RunJar.run(RunJar.java:318) ~[hadoop-common-3.1.3.jar:?]
> at org.apache.hadoop.util.RunJar.main(RunJar.java:232) ~[hadoop-common-3.1.3.jar:?]
> Caused by: org.apache.thrift.transport.TTransportException
> at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:132) ~[hive-exec-3.1.2.jar:3.1.2]
> at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86) ~[hive-exec-3.1.2.jar:3.1.2]
> at org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:429) ~[hive-exec-3.1.2.jar:3.1.2]
> at org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:318) ~[hive-exec-3.1.2.jar:3.1.2]
> at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:219) ~[hive-exec-3.1.2.jar:3.1.2]
> at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:77) ~[hive-exec-3.1.2.jar:3.1.2]
> at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.recv_set_aggr_stats_for(ThriftHiveMetastore.java:4104) ~[hive-exec-3.1.2.jar:3.1.2]
> at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.set_aggr_stats_for(ThriftHiveMetastore.java:4091) ~[hive-exec-3.1.2.jar:3.1.2]
> at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.setPartitionColumnStatistics(HiveMetaStoreClient.java:1927) ~[hive-exec-3.1.2.jar:3.1.2]
> at org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient.setPartitionColumnStatistics(SessionHiveMetaStoreClient.java:409) ~[hive-exec-3.1.2.jar:3.1.2]
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_212]
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_212]
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_212]
> at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_212]
> at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:212) ~[hive-exec-3.1.2.jar:3.1.2]
> at com.sun.proxy.$Proxy34.setPartitionColumnStatistics(Unknown Source) ~[?:?]
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_212]
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_212]
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_212]
> at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_212]
> at org.apache.hadoop.hive.metastore.HiveMetaStoreClient$SynchronizedHandler.invoke(HiveMetaStoreClient.java:2773) ~[hive-exec-3.1.2.jar:3.1.2]
> at com.sun.proxy.$Proxy34.setPartitionColumnStatistics(Unknown Source) ~[?:?]
> at org.apache.hadoop.hive.ql.metadata.Hive.setPartitionColumnStatistics(Hive.java:4420) ~[hive-exec-3.1.2.jar:3.1.2]
> ... 24 more
> 2021-05-06T14:30:32,657 INFO [38c1f98d-9d5a-4bb6-b052-e63eda036c08 main] reexec.ReOptimizePlugin: ReOptimization: retryPossible: false
> 2021-05-06T14:30:32,657 ERROR [38c1f98d-9d5a-4bb6-b052-e63eda036c08 main] ql.Driver: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.StatsTask
> 2021-05-06T14:30:32,657 INFO [38c1f98d-9d5a-4bb6-b052-e63eda036c08 main] ql.Driver: MapReduce Jobs Launched:
> 2021-05-06T14:30:32,657 INFO [38c1f98d-9d5a-4bb6-b052-e63eda036c08 main] ql.Driver: Stage-Stage-1: Map: 1 Reduce: 1 Cumulative CPU: 3.66 sec HDFS Read: 13193 HDFS Write: 203 SUCCESS
> 2021-05-06T14:30:32,657 INFO [38c1f98d-9d5a-4bb6-b052-e63eda036c08 main] ql.Driver: Total MapReduce CPU Time Spent: 3 seconds 660 msec
> 2021-05-06T14:30:32,657 INFO [38c1f98d-9d5a-4bb6-b052-e63eda036c08 main] ql.Driver: Completed executing command(queryId=root_20210506143001_39fbd0ce-3360-40ba-948b-015f2ec166c5); Time taken: 28.603 seconds
> 2021-05-06T14:30:32,657 INFO [38c1f98d-9d5a-4bb6-b052-e63eda036c08 main] ql.Driver: Concurrency mode is disabled, not creating a lock manager
> 2021-05-06T14:30:32,702 INFO [38c1f98d-9d5a-4bb6-b052-e63eda036c08 main] conf.HiveConf: Using the default value passed in for log id: 38c1f98d-9d5a-4bb6-b052-e63eda036c08
> 2021-05-06T14:30:32,702 INFO [38c1f98d-9d5a-4bb6-b052-e63eda036c08 main] session.SessionState: Resetting thread name to main
> "
--
This message was sent by Atlassian Jira
(v8.20.7#820007)