You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Daniel Becker (Jira)" <ji...@apache.org> on 2022/11/23 12:37:00 UTC
[jira] [Updated] (IMPALA-10344) Error loading functional_orc_def.alltypesaggmultifiles in hive
[ https://issues.apache.org/jira/browse/IMPALA-10344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Daniel Becker updated IMPALA-10344:
-----------------------------------
Target Version: Impala 4.3.0 (was: Impala 4.2.0)
> Error loading functional_orc_def.alltypesaggmultifiles in hive
> --------------------------------------------------------------
>
> Key: IMPALA-10344
> URL: https://issues.apache.org/jira/browse/IMPALA-10344
> Project: IMPALA
> Issue Type: Improvement
> Components: Infrastructure
> Affects Versions: Impala 4.0.0
> Reporter: Tim Armstrong
> Priority: Critical
> Labels: broken-build, flaky
> Attachments: hive-metastore.out, hive-server2.out, load-functional-query-exhaustive-hive-generated-orc-def-block.sql.log
>
>
> Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MoveTask. Exception when loading 11 partitions in table alltypesaggmultifiles
> {noformat}
> 0: jdbc:hive2://localhost:11050/default> insert into table functional_orc_def.al
> ltypesaggmultifiles partition (year, month, day) SELECT id, bool_col, tinyint_co
> l, smallint_col, int_col, bigint_col, float_col, double_col, date_string_col, st
> ring_col, timestamp_col, year, month, day FROM functional.alltypesaggmultifiles
> where id % 4 = 1;
> going to print operations logs
> printed operations logs
> going to print operations logs
> INFO : Compiling command(queryId=jenkins_20201113135913_d2ecc422-ec51-4fe2-9e92-e8d93b01aca9): insert into table functional_orc_def.alltypesaggmultifiles partition (year, month, day) SELECT id, bool_col, tinyint_col, smallint_col, int_col, bigint_col, float_col, double_col, date_string_col, string_col, timestamp_col, year, month, day FROM functional.alltypesaggmultifiles where id % 4 = 1
> INFO : No Stats for functional@alltypesaggmultifiles, Columns: float_col, int_col, string_col, bool_col, date_string_col, smallint_col, timestamp_col, tinyint_col, bigint_col, id, double_col
> INFO : Semantic Analysis Completed (retrial = false)
> INFO : Created Hive schema: Schema(fieldSchemas:[FieldSchema(name:id, type:int, comment:null), FieldSchema(name:bool_col, type:boolean, comment:null), FieldSchema(name:tinyint_col, type:tinyint, comment:null), FieldSchema(name:smallint_col, type:smallint, comment:null), FieldSchema(name:int_col, type:int, comment:null), FieldSchema(name:bigint_col, type:bigint, comment:null), FieldSchema(name:float_col, type:float, comment:null), FieldSchema(name:double_col, type:double, comment:null), FieldSchema(name:date_string_col, type:string, comment:null), FieldSchema(name:string_col, type:string, comment:null), FieldSchema(name:timestamp_col, type:timestamp, comment:null), FieldSchema(name:year, type:int, comment:null), FieldSchema(name:month, type:int, comment:null), FieldSchema(name:day, type:int, comment:null)], properties:null)
> INFO : Completed compiling command(queryId=jenkins_20201113135913_d2ecc422-ec51-4fe2-9e92-e8d93b01aca9); Time taken: 0.036 seconds
> INFO : Executing command(queryId=jenkins_20201113135913_d2ecc422-ec51-4fe2-9e92-e8d93b01aca9): insert into table functional_orc_def.alltypesaggmultifiles partition (year, month, day) SELECT id, bool_col, tinyint_col, smallint_col, int_col, bigint_col, float_col, double_col, date_string_col, string_col, timestamp_col, year, month, day FROM functional.alltypesaggmultifiles where id % 4 = 1
> INFO : Query ID = jenkins_20201113135913_d2ecc422-ec51-4fe2-9e92-e8d93b01aca9
> INFO : Total jobs = 1
> INFO : Launching Job 1 out of 1
> INFO : Starting task [Stage-1:MAPRED] in serial mode
> INFO : Subscribed to counters: [] for queryId: jenkins_20201113135913_d2ecc422-ec51-4fe2-9e92-e8d93b01aca9
> INFO : Session is already open
> INFO : Dag name: insert into table functional_orc_def.all...1 (Stage-1)
> INFO : Status: Running (Executing on YARN cluster with App id application_1605304119768_0012)
> printed operations logs
> [2K----------------------------------------------------------------------------------------------
> [2K[36;1m VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED
> [22;0m[2K----------------------------------------------------------------------------------------------
> [2KMap 1 .......... container SUCCEEDED 42 42 0 0 0 0
> Reducer 2 container RUNNING 1 0 1 0 0 0
> [2K----------------------------------------------------------------------------------------------
> [2K[31;1mVERTICES: 01/02 [=========================>>-] 97% ELAPSED TIME: 1.46 s
> [22;0m[2K----------------------------------------------------------------------------------------------
> [8A[2K----------------------------------------------------------------------------------------------
> [2K[36;1m VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED
> [22;0m[2K----------------------------------------------------------------------------------------------
> [2KMap 1 .......... container SUCCEEDED 42 42 0 0 0 0
> Reducer 2 container RUNNING 1 0 1 0 0 0
> [2K----------------------------------------------------------------------------------------------
> [2K[31;1mVERTICES: 01/02 [=========================>>-] 97% ELAPSED TIME: 1.96 s
> [22;0m[2K----------------------------------------------------------------------------------------------
> [8A[2K----------------------------------------------------------------------------------------------
> [2K[36;1m VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED
> [22;0m[2K----------------------------------------------------------------------------------------------
> [2KMap 1 .......... container SUCCEEDED 42 42 0 0 0 0
> Reducer 2 ...... container SUCCEEDED 1 1 0 0 1 0
> [2K----------------------------------------------------------------------------------------------
> [2K[31;1mVERTICES: 02/02 [==========================>>] 100% ELAPSED TIME: 2.46 s
> [22;0m[2K----------------------------------------------------------------------------------------------
> [8A[2K----------------------------------------------------------------------------------------------
> [2K[36;1m VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED
> [22;0m[2K----------------------------------------------------------------------------------------------
> [2KMap 1 .......... container SUCCEEDED 42 42 0 0 0 0
> Reducer 2 ...... container SUCCEEDED 1 1 0 0 1 0
> [2K----------------------------------------------------------------------------------------------
> [2K[31;1mVERTICES: 02/02 [==========================>>] 100% ELAPSED TIME: 2.49 s
> [22;0m[2K----------------------------------------------------------------------------------------------
> Getting log thread is interrupted, since query is done!
> INFO : Starting task [Stage-2:DEPENDENCY_COLLECTION] in serial mode
> INFO : Starting task [Stage-0:MOVE] in serial mode
> INFO : Loading data to table functional_orc_def.alltypesaggmultifiles partition (year=null, month=null, day=null) from hdfs://localhost:20500/test-warehouse/managed/alltypesaggmultifiles_orc_def
> INFO :
> ERROR : FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MoveTask. Exception when loading 11 partitions in table alltypesaggmultifiles with loadPath=hdfs://localhost:20500/test-warehouse/managed/alltypesaggmultifiles_orc_def
> INFO : Completed executing command(queryId=jenkins_20201113135913_d2ecc422-ec51-4fe2-9e92-e8d93b01aca9); Time taken: 2.511 seconds
> INFO : OK
> Error: Error while compiling statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MoveTask. Exception when loading 11 partitions in table alltypesaggmultifiles with loadPath=hdfs://localhost:20500/test-warehouse/managed/alltypesaggmultifiles_orc_def (state=08S01,code=1)
> java.sql.SQLException: Error while compiling statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MoveTask. Exception when loading 11 partitions in table alltypesaggmultifiles with loadPath=hdfs://localhost:20500/test-warehouse/managed/alltypesaggmultifiles_orc_def
> at org.apache.hive.jdbc.HiveStatement.waitForOperationToComplete(HiveStatement.java:401)
> at org.apache.hive.jdbc.HiveStatement.execute(HiveStatement.java:266)
> at org.apache.hive.beeline.Commands.executeInternal(Commands.java:1007)
> at org.apache.hive.beeline.Commands.execute(Commands.java:1217)
> at org.apache.hive.beeline.Commands.sql(Commands.java:1146)
> at org.apache.hive.beeline.BeeLine.dispatch(BeeLine.java:1497)
> at org.apache.hive.beeline.BeeLine.execute(BeeLine.java:1355)
> at org.apache.hive.beeline.BeeLine.executeFile(BeeLine.java:1329)
> at org.apache.hive.beeline.BeeLine.begin(BeeLine.java:1127)
> at org.apache.hive.beeline.BeeLine.begin(BeeLine.java:1082)
> at org.apache.hive.beeline.BeeLine.mainWithInputRedirection(BeeLine.java:546)
> at org.apache.hive.beeline.BeeLine.main(BeeLine.java:528)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at org.apache.hadoop.util.RunJar.run(RunJar.java:318)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:232)
> Closing: 0: jdbc:hive2://localhost:11050/default;auth=none
> {noformat}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org