You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Sankar Hariappan (Jira)" <ji...@apache.org> on 2021/05/18 11:41:00 UTC
[jira] [Updated] (HIVE-23058) Compaction task reattempt fails with
FileAlreadyExistsException
[ https://issues.apache.org/jira/browse/HIVE-23058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sankar Hariappan updated HIVE-23058:
------------------------------------
Fix Version/s: 4.0.0
> Compaction task reattempt fails with FileAlreadyExistsException
> ---------------------------------------------------------------
>
> Key: HIVE-23058
> URL: https://issues.apache.org/jira/browse/HIVE-23058
> Project: Hive
> Issue Type: Bug
> Components: Hive
> Affects Versions: 3.1.0
> Reporter: Riju Trivedi
> Assignee: Riju Trivedi
> Priority: Major
> Fix For: 4.0.0
>
> Attachments: HIVE-23058.2.patch, HIVE-23058.3.patch, HIVE_23058.1.patch, HIVE_23058.patch
>
>
> Issue occurs when compaction attempt is relaunched after first task attempt failure due to preemption by Scheduler or any other reason.
> Since _tmp directory was created by first attempt and was left uncleaned after task attempt failure. Second attempt of the the task fails with "FileAlreadyExistsException" exception.
> Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.fs.FileAlreadyExistsException): /warehouse/tablespace/managed/hive/default.db/compaction_test/_tmp_3670bbef-ba7a-4c10-918d-9a2ee17cbd22/base_0000186/bucket_00005 for client 10.xx.xx.xxx already exists
--
This message was sent by Atlassian Jira
(v8.3.4#803005)