You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ozone.apache.org by "Hongbing Wang (Jira)" <ji...@apache.org> on 2024/01/22 12:36:00 UTC
[jira] [Commented] (HDDS-10184) Fix ManagedStatistics not closed properly
[ https://issues.apache.org/jira/browse/HDDS-10184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17809415#comment-17809415 ]
Hongbing Wang commented on HDDS-10184:
--------------------------------------
I found rocksDB is not freeing up space after deleting sst file, this maybe related to ManagedStatistics not closed properly.
> Fix ManagedStatistics not closed properly
> -----------------------------------------
>
> Key: HDDS-10184
> URL: https://issues.apache.org/jira/browse/HDDS-10184
> Project: Apache Ozone
> Issue Type: Bug
> Components: OM, Ozone Datanode
> Affects Versions: 1.4.0, 1.5.0
> Reporter: Hongbing Wang
> Assignee: Hongbing Wang
> Priority: Major
> Labels: pull-request-available
>
> When set config:
> {code:xml}
> <property>
> <name>ozone.metastore.rocksdb.statistics</name>
> <value>ALL</value>
> </property> {code}
> OM ManagedStatistics not closed properly:
> {code:java}
> 2024-01-22 18:34:22,137 [LeakDetector-ManagedRocksObject0] WARN org.apache.hadoop.hdds.utils.db.managed.ManagedRocksObjectUtils: ManagedStatistics is not closed properly
> StackTrace for unclosed instance: org.apache.hadoop.hdds.utils.db.managed.ManagedStatistics.<init>(ManagedStatistics.java:30)
> org.apache.hadoop.hdds.utils.db.DBStoreBuilder.getDefaultDBOptions(DBStoreBuilder.java:418)
> org.apache.hadoop.hdds.utils.db.DBStoreBuilder.build(DBStoreBuilder.java:209)
> org.apache.hadoop.ozone.om.OmMetadataManagerImpl.loadDB(OmMetadataManagerImpl.java:607)
> org.apache.hadoop.ozone.om.OmMetadataManagerImpl.loadDB(OmMetadataManagerImpl.java:570)
> org.apache.hadoop.ozone.om.OmMetadataManagerImpl.start(OmMetadataManagerImpl.java:560)
> org.apache.hadoop.ozone.om.OmMetadataManagerImpl.<init>(OmMetadataManagerImpl.java:342)
> org.apache.hadoop.ozone.om.OzoneManager.instantiateServices(OzoneManager.java:803)
> org.apache.hadoop.ozone.om.OzoneManager.<init>(OzoneManager.java:683)
> org.apache.hadoop.ozone.om.OzoneManager.createOm(OzoneManager.java:768)
> org.apache.hadoop.ozone.om.OzoneManagerStarter$OMStarterHelper.start(OzoneManagerStarter.java:189)
> org.apache.hadoop.ozone.om.OzoneManagerStarter.startOm(OzoneManagerStarter.java:86) {code}
> DN ManagedStatistics not closed properly:
> {code:java}
> 2024-01-22 19:51:22,414 [LeakDetector-ManagedRocksObject0] WARN org.apache.hadoop.hdds.utils.db.managed.ManagedRocksObjectUtils: ManagedStatistics is not closed properly
> StackTrace for unclosed instance: org.apache.hadoop.hdds.utils.db.managed.ManagedStatistics.<init>(ManagedStatistics.java:30)
> org.apache.hadoop.ozone.container.metadata.AbstractDatanodeStore.start(AbstractDatanodeStore.java:121)
> org.apache.hadoop.ozone.container.metadata.AbstractDatanodeStore.<init>(AbstractDatanodeStore.java:99)
> org.apache.hadoop.ozone.container.metadata.DatanodeStoreSchemaThreeImpl.<init>(DatanodeStoreSchemaThreeImpl.java:66)
> org.apache.hadoop.ozone.container.keyvalue.helpers.BlockUtils.getUncachedDatanodeStore(BlockUtils.java:85)
> org.apache.hadoop.ozone.container.common.utils.HddsVolumeUtil.initPerDiskDBStore(HddsVolumeUtil.java:74)
> org.apache.hadoop.ozone.container.common.volume.HddsVolume.loadDbStore(HddsVolume.java:365)
> org.apache.hadoop.ozone.container.common.utils.HddsVolumeUtil.loadVolume(HddsVolumeUtil.java:111)
> org.apache.hadoop.ozone.container.common.utils.HddsVolumeUtil.lambda$loadAllHddsVolumeDbStore$0(HddsVolumeUtil.java:97)
> java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1626)
> java.util.concurrent.CompletableFuture$AsyncRun.exec(CompletableFuture.java:1618)
> java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289)
> java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056)
> java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1692)
> java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:157) {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org