You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Marta Kuczora (Jira)" <ji...@apache.org> on 2025/07/10 08:11:00 UTC
[jira] [Resolved] (HIVE-29079) Filtering by partitions in the SHOW COMPACTIONS command is broken
[ https://issues.apache.org/jira/browse/HIVE-29079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Marta Kuczora resolved HIVE-29079.
----------------------------------
Fix Version/s: Not Applicable
Resolution: Not A Problem
Turned out the filtering is ok, just the test data I used was not correct.
> Filtering by partitions in the SHOW COMPACTIONS command is broken
> -----------------------------------------------------------------
>
> Key: HIVE-29079
> URL: https://issues.apache.org/jira/browse/HIVE-29079
> Project: Hive
> Issue Type: Bug
> Affects Versions: 4.0.1
> Reporter: Marta Kuczora
> Priority: Major
> Fix For: Not Applicable
>
>
> The SHOW COMPACTIONS command got extended with filtering in HIVE-13353. The implementation supports filtering by partition name as well. This worked fine after this change.
> However in the scope of HIVE-27481 this part of the code got refactored a bit, and unfortunately broke the filtering by partition.
> How to reproduce:
> * Create an ACID table with partitions and create some entries to the compaction queue.
> For example I have the following compactions for the table acid_3 which has 3 partitions:
> {code:java}
> 0: jdbc:hive2://localhost:10000> show compactions show_compact_db.acid_3;
> +---------------+------------------+----------+-----------+------------+---------------------+-------------+-----------+--------------+------------+-----------+--------------+---------------+----------------+--------------+-----------+--------+------------+-------------+------------------+
> | compactionid | dbname | tabname | partname | type | state | workerhost | workerid | enqueuetime | starttime | duration | hadoopjobid | errormessage | initiatorhost | initiatorid | poolname | txnid | nexttxnid | committime | hightestwriteid |
> +---------------+------------------+----------+-----------+------------+---------------------+-------------+-----------+--------------+------------+-----------+--------------+---------------+----------------+--------------+-----------+--------+------------+-------------+------------------+
> | 10 | show_compact_db | acid_3 | 2020 | MAJOR | initiated | 1234 | 1234 | 123456 | 123480 | --- | None | --- | --- | --- | pool1 | 1113 | 1112 | 0 | --- |
> | 11 | show_compact_db | acid_3 | 2020 | MAJOR | succeeded | 1234 | 1234 | 123456 | 123480 | --- | None | --- | --- | --- | pool2 | 1113 | 1112 | 0 | --- |
> | 12 | show_compact_db | acid_3 | 2020 | MINOR | succeeded | 1234 | 1234 | 123456 | 123480 | --- | None | --- | --- | --- | pool1 | 1113 | 1112 | 0 | --- |
> | 13 | show_compact_db | acid_3 | 2020 | REBALANCE | succeeded | 1234 | 1234 | 123456 | 123480 | --- | None | --- | --- | --- | pool2 | 1113 | 1112 | 0 | --- |
> | 14 | show_compact_db | acid_3 | 2021 | REBALANCE | succeeded | 1234 | 1234 | 123456 | 123480 | --- | None | --- | --- | --- | pool3 | 1113 | 1112 | 0 | --- |
> | 15 | show_compact_db | acid_3 | 2021 | MAJOR | succeeded | 1234 | 1234 | 123456 | 123480 | --- | None | --- | --- | --- | pool3 | 1113 | 1112 | 0 | --- |
> | 16 | show_compact_db | acid_3 | 2022 | MAJOR | working | 1234 | 1234 | 123456 | 123480 | --- | None | --- | --- | --- | pool1 | 1113 | 1112 | 0 | --- |
> | 17 | show_compact_db | acid_3 | 2022 | MINOR | working | 1234 | 1234 | 123456 | 123480 | --- | None | --- | --- | --- | pool1 | 1113 | 1112 | 0 | --- |
> | 18 | show_compact_db | acid_3 | 2022 | MAJOR | succeeded | 1234 | 1234 | 123456 | 123480 | --- | None | --- | --- | --- | pool1 | 1113 | 1112 | 0 | --- |
> | 19 | show_compact_db | acid_3 | 2022 | MAJOR | ready for cleaning | 1234 | 1234 | 123456 | 123480 | --- | None | --- | --- | --- | pool1 | 1113 | 1112 | 0 | --- |
> +---------------+------------------+----------+-----------+------------+---------------------+-------------+-----------+--------------+------------+-----------+--------------+---------------+----------------+--------------+-----------+--------+------------+-------------+------------------+ {code}
> * Run the SHOW COMPACTIONS command with filtering on partition. The result is:
> {code:java}
> 0: jdbc:hive2://localhost:10000> show compactions show_compact_db.acid_3 partition(year="2020");
> +---------------+---------+----------+-----------+-------+--------+-------------+-----------+--------------+------------+-----------+--------------+---------------+----------------+--------------+-----------+--------+------------+-------------+------------------+
> | compactionid | dbname | tabname | partname | type | state | workerhost | workerid | enqueuetime | starttime | duration | hadoopjobid | errormessage | initiatorhost | initiatorid | poolname | txnid | nexttxnid | committime | hightestwriteid |
> +---------------+---------+----------+-----------+-------+--------+-------------+-----------+--------------+------------+-----------+--------------+---------------+----------------+--------------+-----------+--------+------------+-------------+------------------+
> +---------------+---------+----------+-----------+-------+--------+-------------+-----------+--------------+------------+-----------+--------------+---------------+----------------+--------------+-----------+--------+------------+-------------+------------------+
> {code}
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)