[jira] [Commented] (HIVE-27598) Enhance alter table compact to work for partitioned tables without specifying any partition

["Stamatis Zampetakis (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HIVE-27598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17828255#comment-17828255 ] 

Stamatis Zampetakis commented on HIVE-27598:
--------------------------------------------

The design issues mentioned above were addressed as part of HIVE-27848.

> Enhance alter table compact to work for partitioned tables without specifying any partition
> -------------------------------------------------------------------------------------------
>
>                 Key: HIVE-27598
>                 URL: https://issues.apache.org/jira/browse/HIVE-27598
>             Project: Hive
>          Issue Type: Improvement
>          Components: Hive
>            Reporter: Taraka Rama Rao Lethavadla
>            Assignee: Taraka Rama Rao Lethavadla
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 4.0.0-beta-1
>
>
> *current implementation:* the below command will throw error
>  
> {noformat}
> alter table PARTITIONED_T compact 'minor';{noformat}
> for a partitioned table
> {code:java}
> You must specify a partition to compact for partitioned tables{code}
> {*}Problem{*}: One of the problem could be ,let's say a table contains 1000s of partitions and for some issue like files permission automatic compaction will mark all or few partitions as failed and never pick for compaction. 
> After we see performance getting degraded, we find out that there is a problem in compaction due to some issue.
> Now to solve it, we have two approaches, adjust failure thresholds and restart HMS to pick the changes which is not going to work for someone who cannot restart HMS
> And the second approach is to execute alter table mentioning each partition
> {*}Solution{*}:
> In this Jira we are planning to allow alter table command for a partitioned table without specifying any partition name.
> Proposed solution is to list all the partitions and find partitions that are eligible to get compacted and put an entry for it in compaction queue



--
This message was sent by Atlassian Jira
(v8.20.10#820010)