You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Nick Dimiduk (JIRA)" <ji...@apache.org> on 2014/02/12 00:16:19 UTC
[jira] [Updated] (HBASE-10500) Some tools OOM when BucketCache is
enabled
[ https://issues.apache.org/jira/browse/HBASE-10500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Nick Dimiduk updated HBASE-10500:
---------------------------------
Component/s: (was: hbck)
HFile
Description:
Running {{hbck --repair}} or {{LoadIncrementalHFiles}} when BucketCache is enabled in offheap mode can cause OOM. This is apparently because {{bin/hbase}} does not include $HBASE_REGIONSERVER_OPTS for these tools. This results in HRegion or HFileReaders initialized with a CacheConfig that doesn't have the necessary Direct Memory.
Possible solutions include:
- disable blockcache in the config used by hbck when running its repairs
- include HBASE_REGIONSERVER_OPTS in the HBaseFSCK startup arguments
I'm leaning toward the former because it's possible that hbck is run on a host with different hardware profile as the RS.
was:
Running {{hbck --repair}} when BucketCache is enabled in offheap mode can cause OOM. This is apparently because {{bin/hbase}} does not include $HBASE_REGIONSERVER_OPTS for hbck. It instantiates an HRegion instance as part of HDFSIntegrityFixer.handleHoleInRegionChain. That HRegion initializes its CacheConfig, which doesn't have the necessary Direct Memory.
Possible solutions include:
- disable blockcache in the config used by hbck when running its repairs
- include HBASE_REGIONSERVER_OPTS in the HBaseFSCK startup arguments
I'm leaning toward the former because it's possible that hbck is run on a host with different hardware profile as the RS.
Summary: Some tools OOM when BucketCache is enabled (was: hbck and OOM when BucketCache is enabled)
> Some tools OOM when BucketCache is enabled
> ------------------------------------------
>
> Key: HBASE-10500
> URL: https://issues.apache.org/jira/browse/HBASE-10500
> Project: HBase
> Issue Type: Bug
> Components: HFile
> Affects Versions: 0.98.0, 0.96.0, 0.99.0
> Reporter: Nick Dimiduk
> Assignee: Nick Dimiduk
> Attachments: HBASE-10500.00.patch
>
>
> Running {{hbck --repair}} or {{LoadIncrementalHFiles}} when BucketCache is enabled in offheap mode can cause OOM. This is apparently because {{bin/hbase}} does not include $HBASE_REGIONSERVER_OPTS for these tools. This results in HRegion or HFileReaders initialized with a CacheConfig that doesn't have the necessary Direct Memory.
> Possible solutions include:
> - disable blockcache in the config used by hbck when running its repairs
> - include HBASE_REGIONSERVER_OPTS in the HBaseFSCK startup arguments
> I'm leaning toward the former because it's possible that hbck is run on a host with different hardware profile as the RS.
--
This message was sent by Atlassian JIRA
(v6.1.5#6160)