You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Taraka Rama Rao Lethavadla (Jira)" <ji...@apache.org> on 2023/08/11 08:40:00 UTC
[jira] [Created] (HIVE-27598) Enhance alter table compact to work for partitioned tables without specifying any partition
Taraka Rama Rao Lethavadla created HIVE-27598:
-------------------------------------------------
Summary: Enhance alter table compact to work for partitioned tables without specifying any partition
Key: HIVE-27598
URL: https://issues.apache.org/jira/browse/HIVE-27598
Project: Hive
Issue Type: Improvement
Components: Hive
Reporter: Taraka Rama Rao Lethavadla
Assignee: Taraka Rama Rao Lethavadla
*current implementation:* the below command will throw error
{noformat}
alter table PARTITIONED_T compact 'minor';{noformat}
for a partitioned
{code:java}
You must specify a partition to compact for partitioned tables{code}
{*}Problem{*}: One of the problem could be ,let's say a table contains 1000s of partitions and for some issue like files permission automatic compaction will mark all or few partitions as failed and never pick for compaction.
After we see performance getting degraded, we find out that there is a problem in compaction due to some issue.
Now to solve it, we have two approaches, adjust failure thresholds and restart HMS to pick the changes which is not going to work for someone who cannot restart HMS
And the second approach is to execute alter table mentioning each partition
{*}Solution{*}:
In this Jira we are planning to allow alter table command for a partitioned table without specifying any partition name.
Proposed solution is to list all the partitions and find partitions that are eligible to get compacted and put an entry for it in compaction queue
--
This message was sent by Atlassian Jira
(v8.20.10#820010)