You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "stack (JIRA)" <ji...@apache.org> on 2007/08/17 20:00:39 UTC
[jira] Created: (HADOOP-1730) [hbase] unexpected null value causes
META scanner to exit (silently)
[hbase] unexpected null value causes META scanner to exit (silently)
--------------------------------------------------------------------
Key: HADOOP-1730
URL: https://issues.apache.org/jira/browse/HADOOP-1730
Project: Hadoop
Issue Type: Bug
Components: contrib/hbase
Reporter: stack
Assignee: stack
META scanner exits silently if a cell value is unexpectedly empty.
At least the out log had this:
{code}
Exception in thread "HMaster.metaScanner" java.lang.IllegalArgumentException: Can't build a writable with empty bytes array
at org.apache.hadoop.hbase.util.Writables.getWritable(Writables.java:77)
at org.apache.hadoop.hbase.HMaster$BaseScanner.scanRegion(HMaster.java:267)
at org.apache.hadoop.hbase.HMaster$MetaScanner.scanOneMetaRegion(HMaster.java:597)
at org.apache.hadoop.hbase.HMaster$MetaScanner.maintenanceScan(HMaster.java:654)
at org.apache.hadoop.hbase.HMaster$BaseScanner.run(HMaster.java:172)
at java.lang.Thread.run(Thread.java:619)
{code}
Need to add at a minimum logging of meta scanner exits with the why.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1730) [hbase] unexpected null value causes
META scanner to exit (silently)
Posted by "Jim Kellerman (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jim Kellerman updated HADOOP-1730:
----------------------------------
Fix Version/s: 0.15.0
Affects Version/s: 0.15.0
Status: Patch Available (was: Open)
Apparently this got dropped from Hudson's queue. Resubmitting.
> [hbase] unexpected null value causes META scanner to exit (silently)
> --------------------------------------------------------------------
>
> Key: HADOOP-1730
> URL: https://issues.apache.org/jira/browse/HADOOP-1730
> Project: Hadoop
> Issue Type: Bug
> Components: contrib/hbase
> Affects Versions: 0.15.0
> Reporter: stack
> Assignee: stack
> Fix For: 0.15.0
>
> Attachments: nullsplit.patch
>
>
> META scanner exits silently if a cell value is unexpectedly empty.
> At least the out log had this:
> {code}
> Exception in thread "HMaster.metaScanner" java.lang.IllegalArgumentException: Can't build a writable with empty bytes array
> at org.apache.hadoop.hbase.util.Writables.getWritable(Writables.java:77)
> at org.apache.hadoop.hbase.HMaster$BaseScanner.scanRegion(HMaster.java:267)
> at org.apache.hadoop.hbase.HMaster$MetaScanner.scanOneMetaRegion(HMaster.java:597)
> at org.apache.hadoop.hbase.HMaster$MetaScanner.maintenanceScan(HMaster.java:654)
> at org.apache.hadoop.hbase.HMaster$BaseScanner.run(HMaster.java:172)
> at java.lang.Thread.run(Thread.java:619)
> {code}
> Need to add at a minimum logging of meta scanner exits with the why.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1730) [hbase] unexpected null value causes
META scanner to exit (silently)
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
stack updated HADOOP-1730:
--------------------------
Attachment: nullsplit.patch
Here's a fix.
{code}
HADOOP-1730 unexpected null value causes META scanner to exit (silently)
Added handling for legal null value scanning META table and added
logging of unexpected exceptions that arise scanning.
M src/contrib/hbase/src/test/org/apache/hadoop/hbase/TestSplit.java
Refactored to do a staged removal of daughter references.
(compact, recalibrate): Added.
(getSplitParent): Refactored as getSplitParentInfo.
M src/contrib/hbase/src/java/org/apache/hadoop/hbase/HConnectionManager.java
Added formatting of the find table result string so shorter
(when 30-odd regions fills page with its output).
M src/contrib/hbase/src/java/org/apache/hadoop/hbase/HTable.java
Formatting to clean eclipse warnings.
M src/contrib/hbase/src/java/org/apache/hadoop/hbase/HMaster.java
The split column in a parent meta table entry can be null (Happens
if a daughter split no longer has references -- it removes its
entry from parent). Add handling and clean up around split
management code. Added logging of unexpected exceptions
scanning a region.
M src/contrib/hbase/src/java/org/apache/hadoop/hbase/HRegion.java
Added fix for NPE when client asks for scanner but passes
non-existent columns.
M src/contrib/hbase/src/java/org/apache/hadoop/hbase/util/Writables.java
(getHRegionInfo, getHRegionInfoOrNull): Added.
{code}
> [hbase] unexpected null value causes META scanner to exit (silently)
> --------------------------------------------------------------------
>
> Key: HADOOP-1730
> URL: https://issues.apache.org/jira/browse/HADOOP-1730
> Project: Hadoop
> Issue Type: Bug
> Components: contrib/hbase
> Reporter: stack
> Assignee: stack
> Attachments: nullsplit.patch
>
>
> META scanner exits silently if a cell value is unexpectedly empty.
> At least the out log had this:
> {code}
> Exception in thread "HMaster.metaScanner" java.lang.IllegalArgumentException: Can't build a writable with empty bytes array
> at org.apache.hadoop.hbase.util.Writables.getWritable(Writables.java:77)
> at org.apache.hadoop.hbase.HMaster$BaseScanner.scanRegion(HMaster.java:267)
> at org.apache.hadoop.hbase.HMaster$MetaScanner.scanOneMetaRegion(HMaster.java:597)
> at org.apache.hadoop.hbase.HMaster$MetaScanner.maintenanceScan(HMaster.java:654)
> at org.apache.hadoop.hbase.HMaster$BaseScanner.run(HMaster.java:172)
> at java.lang.Thread.run(Thread.java:619)
> {code}
> Need to add at a minimum logging of meta scanner exits with the why.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1730) [hbase] unexpected null value causes
META scanner to exit (silently)
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
stack updated HADOOP-1730:
--------------------------
Resolution: Fixed
Status: Resolved (was: Patch Available)
Committed. Built and passed all tests locally on three different machines (including old, single-processor linux box). Does not add new javadoc warnings beyond those of hadoop-1735.
> [hbase] unexpected null value causes META scanner to exit (silently)
> --------------------------------------------------------------------
>
> Key: HADOOP-1730
> URL: https://issues.apache.org/jira/browse/HADOOP-1730
> Project: Hadoop
> Issue Type: Bug
> Components: contrib/hbase
> Affects Versions: 0.15.0
> Reporter: stack
> Assignee: stack
> Fix For: 0.15.0
>
> Attachments: nullsplit.patch
>
>
> META scanner exits silently if a cell value is unexpectedly empty.
> At least the out log had this:
> {code}
> Exception in thread "HMaster.metaScanner" java.lang.IllegalArgumentException: Can't build a writable with empty bytes array
> at org.apache.hadoop.hbase.util.Writables.getWritable(Writables.java:77)
> at org.apache.hadoop.hbase.HMaster$BaseScanner.scanRegion(HMaster.java:267)
> at org.apache.hadoop.hbase.HMaster$MetaScanner.scanOneMetaRegion(HMaster.java:597)
> at org.apache.hadoop.hbase.HMaster$MetaScanner.maintenanceScan(HMaster.java:654)
> at org.apache.hadoop.hbase.HMaster$BaseScanner.run(HMaster.java:172)
> at java.lang.Thread.run(Thread.java:619)
> {code}
> Need to add at a minimum logging of meta scanner exits with the why.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.