You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Vladislav Timchenko (Jira)" <ji...@apache.org> on 2024/06/14 08:14:00 UTC
[jira] [Updated] (HBASE-28664) [HBASE] The Archives folder in the HBASE root directory starts to grow uncontrollably under load
[ https://issues.apache.org/jira/browse/HBASE-28664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vladislav Timchenko updated HBASE-28664:
----------------------------------------
Description:
If there are empty .snapshotinfo and data.manifest in .hbase-snapshot dir, we got a lot of this warns on master server
{code:java}
WARN [snapshot-hfile-cleaner-cache-refresher] snapshot.SnapshotFileCache: Failed to refresh snapshot hfile cache!
org.apache.hadoop.hbase.snapshot.CorruptedSnapshotException: Couldn't read snapshot info from:hdfs://host/apps/hbase/data/.hbase-snapshot/test/.snapshotinfo{code}
{color:#172b4d}how to reproduce:{color}
* {color:#172b4d}create a folder (for example snap2) at the path /apps/base/data/.base-snapshot {color}
* {color:#172b4d}create two empty files there: .snapshotinfo data.manifest {color}
* {color:#172b4d}give a load, for example like this: hbase lt -write 1:10:100 -num_keys 1000000 -read 100:30 -num_tablets 20 -data_block_encoding NONE -tn load_test_tool {color}
* {color:#172b4d}wait... {color}
* {color:#172b4d}the /apps/base/data/archive folder will start to grow (approximately to the size of /apps/base/data/data) {color}
* {color:#172b4d}if you delete the previously created snap2 folder, the size of /aps/base/data/archive will return to its original state{color}
was:
If there are empty .snapshotinfo and data.manifest in .hbase-snapshot dir, we got a lot of this warns on master server
WARN [snapshot-hfile-cleaner-cache-refresher] snapshot.SnapshotFileCache: Failed to refresh snapshot hfile cache!
org.apache.hadoop.hbase.snapshot.CorruptedSnapshotException: Couldn't read snapshot info from:hdfs://host/apps/hbase/data/.hbase-snapshot/test/.snapshotinfo
{color:#172b4d}how to reproduce:{color}
* {color:#172b4d}create a folder (for example snap2) at the path /apps/base/data/.base-snapshot {color}
* {color:#172b4d}create two empty files there: .snapshotinfo data.manifest {color}
* {color:#172b4d}give a load, for example like this: hbase lt -write 1:10:100 -num_keys 1000000 -read 100:30 -num_tablets 20 -data_block_encoding NONE -tn load_test_tool {color}
* {color:#172b4d}wait... {color}
* {color:#172b4d}the /apps/base/data/archive folder will start to grow (approximately to the size of /apps/base/data/data) {color}
* {color:#172b4d}if you delete the previously created snap2 folder, the size of /aps/base/data/archive will return to its original state{color}
> [HBASE] The Archives folder in the HBASE root directory starts to grow uncontrollably under load
> ------------------------------------------------------------------------------------------------
>
> Key: HBASE-28664
> URL: https://issues.apache.org/jira/browse/HBASE-28664
> Project: HBase
> Issue Type: Bug
> Reporter: Vladislav Timchenko
> Priority: Minor
>
> If there are empty .snapshotinfo and data.manifest in .hbase-snapshot dir, we got a lot of this warns on master server
> {code:java}
> WARN [snapshot-hfile-cleaner-cache-refresher] snapshot.SnapshotFileCache: Failed to refresh snapshot hfile cache!
> org.apache.hadoop.hbase.snapshot.CorruptedSnapshotException: Couldn't read snapshot info from:hdfs://host/apps/hbase/data/.hbase-snapshot/test/.snapshotinfo{code}
> {color:#172b4d}how to reproduce:{color}
> * {color:#172b4d}create a folder (for example snap2) at the path /apps/base/data/.base-snapshot {color}
> * {color:#172b4d}create two empty files there: .snapshotinfo data.manifest {color}
> * {color:#172b4d}give a load, for example like this: hbase lt -write 1:10:100 -num_keys 1000000 -read 100:30 -num_tablets 20 -data_block_encoding NONE -tn load_test_tool {color}
> * {color:#172b4d}wait... {color}
> * {color:#172b4d}the /apps/base/data/archive folder will start to grow (approximately to the size of /apps/base/data/data) {color}
> * {color:#172b4d}if you delete the previously created snap2 folder, the size of /aps/base/data/archive will return to its original state{color}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)