You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hbase.apache.org by "Vladislav Timchenko (Jira)" <ji...@apache.org> on 2024/06/26 07:11:00 UTC

[jira] [Resolved] (HBASE-28664) [HBASE] The Archives folder in the HBASE root directory starts to grow uncontrollably under load

     [ https://issues.apache.org/jira/browse/HBASE-28664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Vladislav Timchenko resolved HBASE-28664.
-----------------------------------------
    Resolution: Fixed

> [HBASE] The Archives folder in the HBASE root directory starts to grow uncontrollably under load
> ------------------------------------------------------------------------------------------------
>
>                 Key: HBASE-28664
>                 URL: https://issues.apache.org/jira/browse/HBASE-28664
>             Project: HBase
>          Issue Type: Bug
>            Reporter: Vladislav Timchenko
>            Priority: Minor
>
> If there are empty .snapshotinfo and data.manifest in .hbase-snapshot dir, we got a lot of this warns on master server
> {code:java}
> WARN  [snapshot-hfile-cleaner-cache-refresher] snapshot.SnapshotFileCache: Failed to refresh snapshot hfile cache!
> org.apache.hadoop.hbase.snapshot.CorruptedSnapshotException: Couldn't read snapshot info from:hdfs://host/apps/hbase/data/.hbase-snapshot/test/.snapshotinfo{code}
> {color:#172b4d}how to reproduce:{color}
>  * {color:#172b4d}create a folder (for example snap2) at the path /apps/base/data/.base-snapshot {color}
>  * {color:#172b4d}create two empty files there: .snapshotinfo data.manifest {color}
>  * {color:#172b4d}give a load, for example like this: hbase lt -write 1:10:100 -num_keys 1000000 -read 100:30 -num_tablets 20 -data_block_encoding NONE -tn load_test_tool {color}
>  * {color:#172b4d}wait... {color}
>  * {color:#172b4d}the /apps/base/data/archive folder will start to grow (approximately to the size of /apps/base/data/data) {color}
>  * {color:#172b4d}if you delete the previously created snap2 folder, the size of /aps/base/data/archive will return to its original state{color}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)