You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Zoltan Haindrich (Jira)" <ji...@apache.org> on 2022/01/25 13:40:00 UTC
[jira] [Commented] (HIVE-25883) Enhance Compaction Cleaner to skip when there is nothing to do
[ https://issues.apache.org/jira/browse/HIVE-25883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17481814#comment-17481814 ]
Zoltan Haindrich commented on HIVE-25883:
-----------------------------------------
{code}
// aborted txn: 3881
// com:8020/warehouse/tablespace/managed/hive/test_835163/base_0003209_v0003877
// com:8020/warehouse/tablespace/managed/hive/test_835163/delta_0003561_0003561_000
// @,type:MAJOR,enqueueTime:0,start:0,properties:null,runAs:hive,tooManyAborts:false,
// hasOldAbort:false,highestWriteId:3309,errorMessage:null
{code}
> Enhance Compaction Cleaner to skip when there is nothing to do
> --------------------------------------------------------------
>
> Key: HIVE-25883
> URL: https://issues.apache.org/jira/browse/HIVE-25883
> Project: Hive
> Issue Type: Bug
> Reporter: Zoltan Haindrich
> Assignee: Zoltan Haindrich
> Priority: Major
> Labels: pull-request-available
> Fix For: 4.0.0
>
> Time Spent: 50m
> Remaining Estimate: 0h
>
> the cleaner works the following way:
> * it identifies obsolete directories (delta dirs ; which doesn't have open txns)
> * removes them and done
> if there are no obsolete directoris that is attributed to that there might be open txns so the request should be retried later.
> however if for some reason the directory was already cleaned - similarily it has no obsolete directories; and thus the request is retried for forever
--
This message was sent by Atlassian Jira
(v8.20.1#820001)