You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ozone.apache.org by "Devesh Kumar Singh (Jira)" <ji...@apache.org> on 2022/10/10 06:21:00 UTC
[jira] [Assigned] (HDDS-6585) [Hive] [OFS] Execution error org.apache.hadoop.hive.ql.exec.MoveTask with partition
[ https://issues.apache.org/jira/browse/HDDS-6585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Devesh Kumar Singh reassigned HDDS-6585:
----------------------------------------
Assignee: Devesh Kumar Singh
> [Hive] [OFS] Execution error org.apache.hadoop.hive.ql.exec.MoveTask with partition
> -----------------------------------------------------------------------------------
>
> Key: HDDS-6585
> URL: https://issues.apache.org/jira/browse/HDDS-6585
> Project: Apache Ozone
> Issue Type: Bug
> Components: Ozone Manager
> Affects Versions: 1.3.0
> Reporter: Soumitra Sulav
> Assignee: Devesh Kumar Singh
> Priority: Major
>
> Hive runtime error observed with load in the table with partition
> {code:java}
> jdbc:hive2://quasar-fcurus-7.quasar-fcurus> LOAD DATA INPATH 'ofs://ozone1/ozone/hivetest/tmp/malus/data/Complex_data_type/data1.txt' OVERWRITE INTO TABLE table_stgejf3jlknmp PARTITION (filename = '1');
> going to print operations logs
> printed operations logs
> Getting log thread is interrupted, since query is done!
> INFO : Compiling command(queryId=hive_20220223153616_d866979f-bc94-4a71-9866-0e423cfef9a1): LOAD DATA INPATH 'ofs://ozone1/ozone/hivetest/tmp/malus/data/Complex_data_type/data1.txt' OVERWRITE INTO TABLE table_stgejf3jlknmp PARTITION (filename = '1')
> INFO : Semantic Analysis Completed (retrial = false)
> INFO : Created Hive schema: Schema(fieldSchemas:null, properties:null)
> INFO : Completed compiling command(queryId=hive_20220223153616_d866979f-bc94-4a71-9866-0e423cfef9a1); Time taken: 0.155 seconds
> INFO : Executing command(queryId=hive_20220223153616_d866979f-bc94-4a71-9866-0e423cfef9a1): LOAD DATA INPATH 'ofs://ozone1/ozone/hivetest/tmp/malus/data/Complex_data_type/data1.txt' OVERWRITE INTO TABLE table_stgejf3jlknmp PARTITION (filename = '1')
> INFO : Starting task [Stage-0:MOVE] in serial mode
> INFO : Loading data to table malus1.table_stgejf3jlknmp partition (filename=1) from ofs://ozone1/ozone/hivetest/tmp/malus/data/Complex_data_type/data1.txt
> ERROR : FAILED: Execution Error, return code 40000 from org.apache.hadoop.hive.ql.exec.MoveTask. Unable to move source ofs://ozone1/ozone/hivetest/tmp/malus/data/Complex_data_type/data1.txt to destination ofs://ozone1/warehouse/tablespace/external/hive/malus1.db/table_stgejf3jlknmp/filename=1/data1.txt
> INFO : Completed executing command(queryId=hive_20220223153616_d866979f-bc94-4a71-9866-0e423cfef9a1); Time taken: 0.179 seconds
> INFO : OK
> Error: Error while compiling statement: FAILED: Execution Error, return code 40000 from org.apache.hadoop.hive.ql.exec.MoveTask. Unable to move source ofs://ozone1/ozone/hivetest/tmp/malus/data/Complex_data_type/data1.txt to destination ofs://ozone1/warehouse/tablespace/external/hive/malus1.db/table_stgejf3jlknmp/filename=1/data1.txt (state=08S01,code=40000)
> java.sql.SQLException: Error while compiling statement: FAILED: Execution Error, return code 40000 from org.apache.hadoop.hive.ql.exec.MoveTask. Unable to move source ofs://ozone1/ozone/hivetest/tmp/malus/data/Complex_data_type/data1.txt to destination ofs://ozone1/warehouse/tablespace/external/hive/malus1.db/table_stgejf3jlknmp/filename=1/data1.txt
> at org.apache.hive.jdbc.HiveStatement.waitForOperationToComplete(HiveStatement.java:401)
> at org.apache.hive.jdbc.HiveStatement.execute(HiveStatement.java:266)
> at org.apache.hive.beeline.Commands.executeInternal(Commands.java:1007)
> at org.apache.hive.beeline.Commands.execute(Commands.java:1217)
> at org.apache.hive.beeline.Commands.sql(Commands.java:1146)
> at org.apache.hive.beeline.BeeLine.dispatch(BeeLine.java:1499)
> at org.apache.hive.beeline.BeeLine.execute(BeeLine.java:1357)
> at org.apache.hive.beeline.BeeLine.begin(BeeLine.java:1136)
> at org.apache.hive.beeline.BeeLine.begin(BeeLine.java:1084)
> at org.apache.hive.beeline.BeeLine.mainWithInputRedirection(BeeLine.java:546)
> at org.apache.hive.beeline.BeeLine.main(BeeLine.java:528)
> at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.base/java.lang.reflect.Method.invoke(Method.java:566)
> at org.apache.hadoop.util.RunJar.run(RunJar.java:318)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:232) {code}
> Steps to reproduce :
> {code:java}
> create external table table_stgejf3jlknmp ( k1 STRING, f1 STRING, f2 STRING, sequence_num BIGINT, create_bsk BIGINT, opcode STRING, create_ts STRING, part1 STRING ) PARTITIONED BY (filename STRING) ROW FORMAT DELIMITED FIELDS TERMINATED BY '|';
> LOAD DATA INPATH 'ofs://ozone1/ozone/hivetest/tmp/malus/data/Complex_data_type/data1.txt' OVERWRITE INTO TABLE table_stgejf3jlknmp PARTITION (filename = '1'){code}
> Keep file '{{{}ofs://ozone1/ozone/hivetest/tmp/malus/data/Complex_data_type/data1.txt{}}}' ready with below content :
> {code:java}
> I1|A1|B1|1|100| |2014-09-01 00:00:00|P1
> I2|A2|B2|1|100| |2014-09-01 00:00:00|P1
> I3|A3|B3|1|100| |2014-09-01 00:00:00|P1
> I4|A4|B4|1|100| |2014-09-01 00:00:00|P1
> J1|A1|B1|1|100| |2014-09-01 00:00:00|P2
> J2|A2|B2|1|100| |2014-09-01 00:00:00|P2
> J3|A3|B3|1|100| |2014-09-01 00:00:00|P2
> J4|A4|B4|1|100| |2014-09-01 00:00:00|P2{code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org