[jira] [Created] (KYLIN-1447) Hive Duplicate Entry Exception while creating Intermediate Flat Hive Table as Step#1 in Kylin cube building

["Hao Chen (JIRA)" <ji...@apache.org>]

Hao Chen created KYLIN-1447:
-------------------------------

             Summary: Hive Duplicate Entry Exception while creating Intermediate Flat Hive Table as Step#1 in Kylin cube building
                 Key: KYLIN-1447
                 URL: https://issues.apache.org/jira/browse/KYLIN-1447
             Project: Kylin
          Issue Type: Bug
            Reporter: Hao Chen


h1. Error Log
{code}
Build Result of Job SOURCE_TABLE - 20160101000000_20160201000000 - BUILD - PST 2016-02-24 20:02:07
Build Result: ERROR
Job Engine: kylin-job-engine.company.com
Cube Name: SOURCE_TABLE
Source Records Count: 0
Start Time: Wed Feb 24 20:02:57 PST 2016
Duration: 0mins
MR Waiting: 0mins
Last Update Time: Wed Feb 24 20:03:42 PST 2016
Submitter: SOURCE_TABLE_USER
Error Log: OS command error exit with 1 -- hive -e "USE default;
DROP TABLE IF EXISTS kylin_intermediate_;

CREATE EXTERNAL TABLE IF NOT EXISTS kylin_intermediate_SOURCE_TABLE_20160101000000_20160201000000
...

ROW FORMAT DELIMITED FIELDS TERMINATED BY '\177'
STORED AS SEQUENCEFILE
LOCATION '/kylin_intermediate_SOURCE_TABLE_20160101000000_20160201000000';

SET mapred.job.queue.name=hddq-gdi-kylin;
SET dfs.replication=2;
SET dfs.block.size=32000000;
SET hive.exec.compress.output=true;
SET hive.auto.convert.join.noconditionaltask=true;
SET hive.auto.convert.join.noconditionaltask.size=300000000;
SET mapreduce.map.output.compress.codec=org.apache.hadoop.io.compress.SnappyCodec;
SET mapreduce.output.fileoutputformat.compress.codec=org.apache.hadoop.io.compress.SnappyCodec;
SET hive.merge.mapfiles=true;
SET hive.merge.mapredfiles=true;
SET mapred.output.compression.type=BLOCK;
SET hive.merge.size.per.task=256000000;
SET hive.support.concurrency=false;
SET mapreduce.job.split.metainfo.maxsize=-1;
INSERT OVERWRITE TABLE kylin_intermediate_SOURCE_TABLE_20160101000000_20160201000000 SELECT
...
"

Logging initialized using configuration in file: hive/conf/hive-log4j.properties
OK
Time taken: 0.598 seconds
OK
Time taken: 0.23 seconds
FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. MetaException(message:javax.jdo.JDODataStoreException: Insert of object "org.apache.hadoop.hive.metastore.model.MTable@3eff1c5f" using statement "INSERT INTO "TBLS" ("TBL_ID","VIEW_ORIGINAL_TEXT","CREATE_TIME","VIEW_EXPANDED_TEXT","RETENTION","SD_ID","LAST_ACCESS_TIME","DB_ID","TBL_NAME","OWNER","TBL_TYPE") VALUES (?,?,?,?,?,?,?,?,?,?,?)" failed : Duplicate entry 'kylin_intermediate_SOURCE_TABLE_20160101000000_20160201000000-' for key 'UNIQUETABLE'
NestedThrowables:
com.mysql.jdbc.exceptions.MySQLIntegrityConstraintViolationException: Duplicate entry 'kylin_intermediate_SOURCE_TABLE_20160101000000_20160201000000-' for key 'UNIQUETABLE')
{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)