You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kylin.apache.org by "nichunen (Jira)" <ji...@apache.org> on 2019/10/31 03:04:00 UTC
[jira] [Closed] (KYLIN-1447) Hive Duplicate Entry Exception while
creating Intermediate Flat Hive Table during step#1 of Kylin cube building
[ https://issues.apache.org/jira/browse/KYLIN-1447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
nichunen closed KYLIN-1447.
---------------------------
Resolution: Cannot Reproduce
> Hive Duplicate Entry Exception while creating Intermediate Flat Hive Table during step#1 of Kylin cube building
> ---------------------------------------------------------------------------------------------------------------
>
> Key: KYLIN-1447
> URL: https://issues.apache.org/jira/browse/KYLIN-1447
> Project: Kylin
> Issue Type: Bug
> Components: Job Engine
> Affects Versions: v1.4.0, v1.5.0
> Reporter: Hao Chen
> Priority: Major
>
> {code}
> Build Result of Job SOURCE_TABLE - 20160101000000_20160201000000 - BUILD - PST 2016-02-24 20:02:07
> Build Result: ERROR
> Job Engine: kylin-job-engine.company.com
> Cube Name: SOURCE_TABLE
> Source Records Count: 0
> Start Time: Wed Feb 24 20:02:57 PST 2016
> Duration: 0mins
> MR Waiting: 0mins
> Last Update Time: Wed Feb 24 20:03:42 PST 2016
> Submitter: SOURCE_TABLE_USER
> Error Log: OS command error exit with 1 -- hive -e "USE default;
> DROP TABLE IF EXISTS kylin_intermediate_;
> CREATE EXTERNAL TABLE IF NOT EXISTS kylin_intermediate_SOURCE_TABLE_20160101000000_20160201000000
> ...
> ROW FORMAT DELIMITED FIELDS TERMINATED BY '\177'
> STORED AS SEQUENCEFILE
> LOCATION '/kylin_intermediate_SOURCE_TABLE_20160101000000_20160201000000';
> SET mapred.job.queue.name=hddq-gdi-kylin;
> SET dfs.replication=2;
> SET dfs.block.size=32000000;
> SET hive.exec.compress.output=true;
> SET hive.auto.convert.join.noconditionaltask=true;
> SET hive.auto.convert.join.noconditionaltask.size=300000000;
> SET mapreduce.map.output.compress.codec=org.apache.hadoop.io.compress.SnappyCodec;
> SET mapreduce.output.fileoutputformat.compress.codec=org.apache.hadoop.io.compress.SnappyCodec;
> SET hive.merge.mapfiles=true;
> SET hive.merge.mapredfiles=true;
> SET mapred.output.compression.type=BLOCK;
> SET hive.merge.size.per.task=256000000;
> SET hive.support.concurrency=false;
> SET mapreduce.job.split.metainfo.maxsize=-1;
> INSERT OVERWRITE TABLE kylin_intermediate_SOURCE_TABLE_20160101000000_20160201000000 SELECT
> ...
> "
> Logging initialized using configuration in file: hive/conf/hive-log4j.properties
> OK
> Time taken: 0.598 seconds
> OK
> Time taken: 0.23 seconds
> FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. MetaException(message:javax.jdo.JDODataStoreException: Insert of object "org.apache.hadoop.hive.metastore.model.MTable@3eff1c5f" using statement "INSERT INTO "TBLS" ("TBL_ID","VIEW_ORIGINAL_TEXT","CREATE_TIME","VIEW_EXPANDED_TEXT","RETENTION","SD_ID","LAST_ACCESS_TIME","DB_ID","TBL_NAME","OWNER","TBL_TYPE") VALUES (?,?,?,?,?,?,?,?,?,?,?)" failed : Duplicate entry 'kylin_intermediate_SOURCE_TABLE_20160101000000_20160201000000-' for key 'UNIQUETABLE'
> NestedThrowables:
> com.mysql.jdbc.exceptions.MySQLIntegrityConstraintViolationException: Duplicate entry 'kylin_intermediate_SOURCE_TABLE_20160101000000_20160201000000-' for key 'UNIQUETABLE')
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)