You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Michael (JIRA)" <ji...@apache.org> on 2014/03/11 18:05:44 UTC
[jira] [Created] (HIVE-6615) Cannot insert data into an ORC-based
table
Michael created HIVE-6615:
-----------------------------
Summary: Cannot insert data into an ORC-based table
Key: HIVE-6615
URL: https://issues.apache.org/jira/browse/HIVE-6615
Project: Hive
Issue Type: Bug
Components: File Formats
Affects Versions: 0.12.0, 0.11.0
Environment: Red Hat Enterprise Linux Server release 6.3 (Santiago)
hadoop-2.2.0
hive-0.12.0
Java(TM) SE Runtime Environment (build 1.7.0_10-b18)
Java HotSpot(TM) 64-Bit Server VM (build 23.6-b04, mixed mode)
Reporter: Michael
I have the following table definitions:
create external table rmtail(day int, dm1 int, dm2 int) row format delimited fields terminated by ',' location '${env:HOME}/hive_db/POC_RAW_DATA';
create table dag(day int, dm2 int) partitioned by (dm1 int) stored as orc ;
Unfortunately, the following insert statement
INSERT OVERWRITE TABLE dag PARTITION (dm1) SELECT rm. day,rm.dm2,rm.dm1 FROM rmtail rm;
give the errors and does nothing.
The problem is the conversion to the ORC format as everything works fine as soon as I remove the 'stored as ORC' clause.
The errors printed on the terminal are shown below:
Total MapReduce jobs = 3
Launching Job 1 out of 3
Number of reduce tasks is set to 0 since there's no reduce operator
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/devjuser1/jp/ccjp/michaelg/hadoop-2.2.0/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/devjuser1/jp/ccjp/michaelg/hive-0.12.0/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
14/03/11 20:49:51 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
14/03/11 20:49:53 WARN conf.Configuration: file:/tmp/hive-michaelg/hive_2014-03-11_20-49-44_726_2311004197897210334-1/-local-10003/jobconf.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring.
14/03/11 20:49:53 WARN conf.Configuration: file:/tmp/hive-michaelg/hive_2014-03-11_20-49-44_726_2311004197897210334-1/-local-10003/jobconf.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring.
14/03/11 20:49:53 INFO Configuration.deprecation: mapred.input.dir.recursive is deprecated. Instead, use mapreduce.input.fileinputformat.input.dir.recursive
14/03/11 20:49:53 INFO Configuration.deprecation: mapred.max.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.maxsize
14/03/11 20:49:53 INFO Configuration.deprecation: mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
14/03/11 20:49:53 INFO Configuration.deprecation: mapred.min.split.size.per.rack is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize.per.rack
14/03/11 20:49:53 INFO Configuration.deprecation: mapred.min.split.size.per.node is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize.per.node
14/03/11 20:49:53 INFO Configuration.deprecation: mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
14/03/11 20:49:53 INFO Configuration.deprecation: mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
14/03/11 20:49:53 WARN conf.HiveConf: DEPRECATED: Configuration property hive.metastore.local no longer has any effect. Make sure to provide a valid value for hive.metastore.uris if you are connecting to a remote metastore.
Execution log at: /tmp/michaelg/.log
Job running in-process (local Hadoop)
Hadoop job information for null: number of mappers: 0; number of reducers: 0
2014-03-11 20:50:00,327 null map = 0%, reduce = 0%
Ended Job = job_local2076881875_0001 with errors
Error during job, obtaining debugging information...
Execution failed with exit status: 2
Obtaining error information
Task failed!
Task ID:
Stage-1
Logs:
/tmp/michaelg/hive.log
FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask
And the log file contents is as follows:
2014-03-11 20:45:34,664 WARN conf.HiveConf (HiveConf.java:initialize(1142)) - DEPRECATED: Configuration property hive.metastore.local no longer has any effect. Make sure to provide a valid value for hive.metastore.uris if you are connecting to a remote metastore.
2014-03-11 20:45:35,503 WARN util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2014-03-11 20:45:35,943 WARN conf.HiveConf (HiveConf.java:initialize(1142)) - DEPRECATED: Configuration property hive.metastore.local no longer has any effect. Make sure to provide a valid value for hive.metastore.uris if you are connecting to a remote metastore.
2014-03-11 20:45:44,759 WARN bonecp.BoneCPConfig (BoneCPConfig.java:sanitize(1537)) - Max Connections < 1. Setting to 20
2014-03-11 20:45:47,437 WARN conf.HiveConf (HiveConf.java:initialize(1142)) - DEPRECATED: Configuration property hive.metastore.local no longer has any effect. Make sure to provide a valid value for hive.metastore.uris if you are connecting to a remote metastore.
2014-03-11 20:45:48,427 WARN bonecp.BoneCPConfig (BoneCPConfig.java:sanitize(1537)) - Max Connections < 1. Setting to 20
2014-03-11 20:45:48,458 WARN metastore.ObjectStore (ObjectStore.java:checkSchema(5640)) - Version information not found in metastore. hive.metastore.schema.verification is not enabled so recording the schema version 0.12.0
2014-03-11 20:49:45,094 WARN conf.HiveConf (HiveConf.java:initialize(1142)) - DEPRECATED: Configuration property hive.metastore.local no longer has any effect. Make sure to provide a valid value for hive.metastore.uris if you are connecting to a remote metastore.
2014-03-11 20:50:00,531 ERROR exec.Task (SessionState.java:printError(419)) - Execution failed with exit status: 2
2014-03-11 20:50:00,532 ERROR exec.Task (SessionState.java:printError(419)) - Obtaining error information
2014-03-11 20:50:00,532 ERROR exec.Task (SessionState.java:printError(419)) -
Task failed!
Task ID:
Stage-1
hive>
Logs:
2014-03-11 20:50:00,532 ERROR exec.Task (SessionState.java:printError(419)) - /tmp/michaelg/hive.log
2014-03-11 20:50:00,533 ERROR mr.ExecDriver (MapRedTask.java:execute(293)) - Execution failed with exit status: 2
2014-03-11 20:50:00,541 ERROR ql.Driver (SessionState.java:printError(419)) - FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask
--
This message was sent by Atlassian JIRA
(v6.2#6252)