You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Bing Li (JIRA)" <ji...@apache.org> on 2016/05/25 17:18:12 UTC
[jira] [Updated] (HIVE-13850) File name conflict when have multiple
INSERT INTO queries running in parallel
[ https://issues.apache.org/jira/browse/HIVE-13850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Bing Li updated HIVE-13850:
---------------------------
Affects Version/s: 1.2.1
> File name conflict when have multiple INSERT INTO queries running in parallel
> -----------------------------------------------------------------------------
>
> Key: HIVE-13850
> URL: https://issues.apache.org/jira/browse/HIVE-13850
> Project: Hive
> Issue Type: Bug
> Affects Versions: 1.2.1
> Reporter: Bing Li
> Assignee: Bing Li
>
> We have an application which connect to HiveServer2 via JDBC.
> In the application, it executes "INSERT INTO" query to the same table.
> If there are a lot of users running the application at the same time. Some of the INSERT could fail.
> In hive log,
> org.apache.hadoop.hive.ql.metadata.HiveException: copyFiles: error
> while moving files!!! Cannot move hdfs://node:8020/apps/hive/warehouse/met
> adata.db/scalding_stats/.hive-staging_hive_2016-05-10_18-46-
> 23_642_2056172497900766879-3321/-ext-10000/000000_0 to hdfs://node:8020/apps/hive
> /warehouse/metadata.db/scalding_stats/000000_0_copy_9014
> at org.apache.hadoop.hive.ql.metadata.Hive.copyFiles(Hive.java:
> 2719)
> at org.apache.hadoop.hive.ql.metadata.Hive.loadTable(Hive.java:
> 1645)
>
> In hadoop log,
> WARN hdfs.StateChange (FSDirRenameOp.java:
> unprotectedRenameTo(174)) - DIR* FSDirectory.unprotectedRenameTo:
> failed to rename /apps/hive/warehouse/metadata.db/scalding_stats/.hive-
> staging_hive_2016-05-10_18-46-23_642_2056172497900766879-3321/-ext-
> 10000/000000_0 to /apps/hive/warehouse/metadata.
> db/scalding_stats/000000_0_copy_9014 because destination exists
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)