You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hbase.apache.org by "Lars George (JIRA)" <ji...@apache.org> on 2009/08/14 18:25:14 UTC
[jira] Updated: (HBASE-1766) Add advanced features to HFile.main()
to be able to analyze storefile problems
[ https://issues.apache.org/jira/browse/HBASE-1766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Lars George updated HBASE-1766:
-------------------------------
Attachment: HBASE-1766.patch
Patch extends main() to have those options:
{code}
$ /usr/local/hbase/bin/hbase org.apache.hadoop.hbase.io.hfile.HFile
usage: HFile [-f <arg>] [-v] [-r <arg>] [-a] [-p] [-m] [-k]
-a,--checkfamily enable family check
-f,--file <arg> file to scan
-k,--checkkey enable key order check
-m,--printmeta print meta data of file
-p,--printkv print key/value pairs
-r,--region <arg> region to scan
-v,--verbose verbose output
{code}
It allows to scan all files of a region in one fell swoop. Also reports various issues if requested. For example if keys (rows) are out of order and also if column families are mismatching.
Example:
{code}
$ /usr/local/hbase/bin/hbase org.apache.hadoop.hbase.io.hfile.HFile -r "storedata,10ee02a22b05dfd,1247877829376" -a -k
Number of region files found -> 160
Start scan of files...
WARNING, filename does not match kv family,
filename -> hdfs://foo.bar.net:9000/hbase/storedata/1872850629/assoc/6750107734870830278
keyvalue -> \x00\x0F10ee02b27f9426a\x06origin9222130889769974505_cm_default\x00\x00\x01\x22\xA1\x8B\xBCQ\x04
WARNING, previous kv has different family compared to current key
filename -> hdfs://foo.bar.net:9000/hbase/storedata/1872850629/assoc/6750107734870830278
previous -> \x00\x0F10ee02b26ac93e7\x05assoc9222124272300324701_bz\x00\x00\x01\x22\xD5\x1E6\xAA\x04
current -> \x00\x0F10ee02b27f9426a\x06origin9222130889769974505_cm_default\x00\x00\x01\x22\xA1\x8B\xBCQ\x04
WARNING, previous kv has different family compared to current key
filename -> hdfs://foo.bar.net:9000/hbase/storedata/1872850629/assoc/6750107734870830278
previous -> \x00\x0F10ee02b27f9426a\x06origin9222130889769974505_cm_default\x00\x00\x01\x22\xA1\x8B\xBCQ\x04
current -> \x00\x0F10ee02b296d017f\x05assoc9222130848644929908_na\x00\x00\x01\x22l\x22X\x90\x04
WARNING, filename does not match kv family,
filename -> hdfs://foo.bar.collective-media.net:9000/hbase/storedata/1872850629/network/2478457462667232065
keyvalue -> \x00\x0F10ee02b27f9426a\x06origin9222130889769974505_cm_default\x00\x00\x01\x22\xA1\x8B\xBCQ\x04
Done.
{code}
> Add advanced features to HFile.main() to be able to analyze storefile problems
> ------------------------------------------------------------------------------
>
> Key: HBASE-1766
> URL: https://issues.apache.org/jira/browse/HBASE-1766
> Project: Hadoop HBase
> Issue Type: Improvement
> Components: io
> Reporter: Lars George
> Assignee: Lars George
> Priority: Minor
> Fix For: 0.20.1
>
> Attachments: HBASE-1766.patch
>
>
> I have various regions that report the following error:
> ERROR org.apache.hadoop.hbase.regionserver.CompactSplitThread: Compaction failed for region storedata,10edd32a3fa217e,1247877829376
> java.lang.RuntimeException: ScanWildcardColumnTracker.checkColumn ran into a column actually smaller than the previous column!
> at org.apache.hadoop.hbase.regionserver.ScanWildcardColumnTracker.checkColumn(ScanWildcardColumnTracker.java:89)
> at org.apache.hadoop.hbase.regionserver.ScanQueryMatcher.match(ScanQueryMatcher.java:162)
> They are most likely remnants of HBASE-1715 and its linked issues?
> Add more features to HFile.main() to be able to figure the files that are broken (as the error above only reports the region) and how.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.