You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Denys Kuzmenko (Jira)" <ji...@apache.org> on 2023/04/27 15:07:00 UTC
[jira] [Commented] (HIVE-27266) Retrieve only partNames if not need drop data in HMSHandler.dropPartitionsAndGetLocations
[ https://issues.apache.org/jira/browse/HIVE-27266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17717260#comment-17717260 ]
Denys Kuzmenko commented on HIVE-27266:
---------------------------------------
Merged to master.
[~wechar] thanks for the patch!
> Retrieve only partNames if not need drop data in HMSHandler.dropPartitionsAndGetLocations
> -----------------------------------------------------------------------------------------
>
> Key: HIVE-27266
> URL: https://issues.apache.org/jira/browse/HIVE-27266
> Project: Hive
> Issue Type: Improvement
> Components: Hive
> Affects Versions: 4.0.0-alpha-2
> Reporter: Wechar
> Assignee: Wechar
> Priority: Major
> Labels: pull-request-available
> Time Spent: 1h
> Remaining Estimate: 0h
>
> Followed HIVE-19783, we only need partNames instead of partName and location pairs if we do not need check location.
> We add a new benchmark *dropTableMetadataWithPartitions* to delete only metadata rather than the real table data.
> Test results like:
> * Before the patch:
> {code:bash}
> Operation Mean Med Min Max Err%
> dropTableMetaOnlyWithPartitions.10 23.70 21.87 19.36 31.73 14.48
> dropTableMetaOnlyWithPartitions.100 54.42 54.15 45.92 76.68 8.891
> dropTableMetaOnlyWithPartitions.1000 462.5 456.1 321.0 654.3 15.96
> {code}
> * After the patch:
> {code:bash}
> Operation Mean Med Min Max Err%
> dropTableMetaOnlyWithPartitions.10 21.49 21.24 19.30 27.90 6.661
> dropTableMetaOnlyWithPartitions.100 51.51 48.30 44.86 85.23 16.91
> dropTableMetaOnlyWithPartitions.1000 415.4 407.2 308.8 595.2 14.28
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)