You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Naveen Gangam (Jira)" <ji...@apache.org> on 2024/12/17 17:29:00 UTC
[jira] [Commented] (HIVE-25324) Add option to disable PartitionManagementTask
[ https://issues.apache.org/jira/browse/HIVE-25324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17906480#comment-17906480 ]
Naveen Gangam commented on HIVE-25324:
--------------------------------------
[~dengzh] should we do this? We current have some means to achieve the same by setting the database.pattern to a non-existent db but I do understand the ask that this is not the default.
Can we look into some other config where this task does not automatically enabled for all DBs/Tables but its an opt-in at the DB level. So the service runs by default but only scans to see if there are DBs that we have it enabled for.
Would something like this make sense? Thanks
> Add option to disable PartitionManagementTask
> ---------------------------------------------
>
> Key: HIVE-25324
> URL: https://issues.apache.org/jira/browse/HIVE-25324
> Project: Hive
> Issue Type: Improvement
> Components: Metastore
> Reporter: Rajesh Balamohan
> Assignee: Zhihua Deng
> Priority: Major
> Labels: pull-request-available
> Time Spent: 1h
> Remaining Estimate: 0h
>
> When large number of tables (e.g 2000) and databases are present, PartitionManagementTask scans all tables and partitions causing pressure on HMS.
> Currently there is no way to disable PartitionManagementTask as well. Round about option is to provide pattern via "metastore.partition.management.database.pattern / metastore.partition.management.table.pattern".
> It will be good to provide an option to disable it completely.{color:#807d6e}
> {color}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)