You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ozone.apache.org by "Hongbing Wang (Jira)" <ji...@apache.org> on 2023/08/14 10:14:00 UTC
[jira] [Updated] (HDDS-9166) Fix OZONE_OM_UPGRADE_QUOTA_RECALCULATE_ENABLE default value
[ https://issues.apache.org/jira/browse/HDDS-9166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hongbing Wang updated HDDS-9166:
--------------------------------
Description:
The default value in `QuotaRepairUpgradeAction` class is not the same in ozone-site.xml, which is confusing.
In fact, `QuotaRepairTask` will be very time consuming during my upgrade om, the time taken is as follows:
{code:java}
// test 1
2023-07-05 16:15:36,432 [pool-37-thread-1] INFO org.apache.hadoop.ozone.om.service.QuotaRepairTask: Recalculate Key usages completed, count 259337075 time 1873737ms
// test 2
2023-08-13 17:35:45,622 [pool-37-thread-2] INFO org.apache.hadoop.ozone.om.service.QuotaRepairTask: Recalculate File usages completed, count 19752234 time 440393ms
{code}
||key count ||time token ||
| 259337075 | 31min 12sec |
| 19752234 | 7min 20sec |
I prefer that 'ozone.om.upgrade.quota.recalculate.enabled' default to false.
> Fix OZONE_OM_UPGRADE_QUOTA_RECALCULATE_ENABLE default value
> -----------------------------------------------------------
>
> Key: HDDS-9166
> URL: https://issues.apache.org/jira/browse/HDDS-9166
> Project: Apache Ozone
> Issue Type: Improvement
> Components: OM
> Affects Versions: 1.4.0
> Reporter: Hongbing Wang
> Assignee: Hongbing Wang
> Priority: Major
>
> The default value in `QuotaRepairUpgradeAction` class is not the same in ozone-site.xml, which is confusing.
> In fact, `QuotaRepairTask` will be very time consuming during my upgrade om, the time taken is as follows:
> {code:java}
> // test 1
> 2023-07-05 16:15:36,432 [pool-37-thread-1] INFO org.apache.hadoop.ozone.om.service.QuotaRepairTask: Recalculate Key usages completed, count 259337075 time 1873737ms
> // test 2
> 2023-08-13 17:35:45,622 [pool-37-thread-2] INFO org.apache.hadoop.ozone.om.service.QuotaRepairTask: Recalculate File usages completed, count 19752234 time 440393ms
> {code}
> ||key count ||time token ||
> | 259337075 | 31min 12sec |
> | 19752234 | 7min 20sec |
> I prefer that 'ozone.om.upgrade.quota.recalculate.enabled' default to false.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org