You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "stack (JIRA)" <ji...@apache.org> on 2007/08/17 20:00:39 UTC

[jira] Created: (HADOOP-1730) [hbase] unexpected null value causes META scanner to exit (silently)

[hbase] unexpected null value causes META scanner to exit (silently)
--------------------------------------------------------------------

                 Key: HADOOP-1730
                 URL: https://issues.apache.org/jira/browse/HADOOP-1730
             Project: Hadoop
          Issue Type: Bug
          Components: contrib/hbase
            Reporter: stack
            Assignee: stack


META scanner exits silently if a cell value is unexpectedly empty.

At least the out log had this:

{code}
Exception in thread "HMaster.metaScanner" java.lang.IllegalArgumentException: Can't build a writable with empty bytes array
    at org.apache.hadoop.hbase.util.Writables.getWritable(Writables.java:77)
    at org.apache.hadoop.hbase.HMaster$BaseScanner.scanRegion(HMaster.java:267)
    at org.apache.hadoop.hbase.HMaster$MetaScanner.scanOneMetaRegion(HMaster.java:597)
    at org.apache.hadoop.hbase.HMaster$MetaScanner.maintenanceScan(HMaster.java:654)
    at org.apache.hadoop.hbase.HMaster$BaseScanner.run(HMaster.java:172)
    at java.lang.Thread.run(Thread.java:619)
{code}

Need to add at a minimum logging of meta scanner exits with the why.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-1730) [hbase] unexpected null value causes META scanner to exit (silently)

Posted by "Jim Kellerman (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-1730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jim Kellerman updated HADOOP-1730:
----------------------------------

        Fix Version/s: 0.15.0
    Affects Version/s: 0.15.0
               Status: Patch Available  (was: Open)

Apparently this got dropped from Hudson's queue. Resubmitting.

> [hbase] unexpected null value causes META scanner to exit (silently)
> --------------------------------------------------------------------
>
>                 Key: HADOOP-1730
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1730
>             Project: Hadoop
>          Issue Type: Bug
>          Components: contrib/hbase
>    Affects Versions: 0.15.0
>            Reporter: stack
>            Assignee: stack
>             Fix For: 0.15.0
>
>         Attachments: nullsplit.patch
>
>
> META scanner exits silently if a cell value is unexpectedly empty.
> At least the out log had this:
> {code}
> Exception in thread "HMaster.metaScanner" java.lang.IllegalArgumentException: Can't build a writable with empty bytes array
>     at org.apache.hadoop.hbase.util.Writables.getWritable(Writables.java:77)
>     at org.apache.hadoop.hbase.HMaster$BaseScanner.scanRegion(HMaster.java:267)
>     at org.apache.hadoop.hbase.HMaster$MetaScanner.scanOneMetaRegion(HMaster.java:597)
>     at org.apache.hadoop.hbase.HMaster$MetaScanner.maintenanceScan(HMaster.java:654)
>     at org.apache.hadoop.hbase.HMaster$BaseScanner.run(HMaster.java:172)
>     at java.lang.Thread.run(Thread.java:619)
> {code}
> Need to add at a minimum logging of meta scanner exits with the why.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-1730) [hbase] unexpected null value causes META scanner to exit (silently)

Posted by "stack (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-1730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

stack updated HADOOP-1730:
--------------------------

    Attachment: nullsplit.patch

Here's a fix.

{code}
HADOOP-1730 unexpected null value causes META scanner to exit (silently)

Added handling for legal null value scanning META table and added
logging of unexpected exceptions that arise scanning.

M src/contrib/hbase/src/test/org/apache/hadoop/hbase/TestSplit.java
    Refactored to do a staged removal of daughter references.
    (compact, recalibrate): Added.
    (getSplitParent): Refactored as getSplitParentInfo.
M  src/contrib/hbase/src/java/org/apache/hadoop/hbase/HConnectionManager.java
    Added formatting of the find table result string so shorter
    (when 30-odd regions fills page with its output).
M  src/contrib/hbase/src/java/org/apache/hadoop/hbase/HTable.java
    Formatting to clean eclipse warnings.
M src/contrib/hbase/src/java/org/apache/hadoop/hbase/HMaster.java
    The split column in a parent meta table entry can be null (Happens
    if a daughter split no longer has references -- it removes its
    entry from parent).  Add handling and clean up around split
    management code.  Added logging of unexpected exceptions
    scanning a region.
M  src/contrib/hbase/src/java/org/apache/hadoop/hbase/HRegion.java
    Added fix for NPE when client asks for scanner but passes
    non-existent columns.
M src/contrib/hbase/src/java/org/apache/hadoop/hbase/util/Writables.java
    (getHRegionInfo, getHRegionInfoOrNull): Added.
{code}

> [hbase] unexpected null value causes META scanner to exit (silently)
> --------------------------------------------------------------------
>
>                 Key: HADOOP-1730
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1730
>             Project: Hadoop
>          Issue Type: Bug
>          Components: contrib/hbase
>            Reporter: stack
>            Assignee: stack
>         Attachments: nullsplit.patch
>
>
> META scanner exits silently if a cell value is unexpectedly empty.
> At least the out log had this:
> {code}
> Exception in thread "HMaster.metaScanner" java.lang.IllegalArgumentException: Can't build a writable with empty bytes array
>     at org.apache.hadoop.hbase.util.Writables.getWritable(Writables.java:77)
>     at org.apache.hadoop.hbase.HMaster$BaseScanner.scanRegion(HMaster.java:267)
>     at org.apache.hadoop.hbase.HMaster$MetaScanner.scanOneMetaRegion(HMaster.java:597)
>     at org.apache.hadoop.hbase.HMaster$MetaScanner.maintenanceScan(HMaster.java:654)
>     at org.apache.hadoop.hbase.HMaster$BaseScanner.run(HMaster.java:172)
>     at java.lang.Thread.run(Thread.java:619)
> {code}
> Need to add at a minimum logging of meta scanner exits with the why.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-1730) [hbase] unexpected null value causes META scanner to exit (silently)

Posted by "stack (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-1730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

stack updated HADOOP-1730:
--------------------------

    Resolution: Fixed
        Status: Resolved  (was: Patch Available)

Committed.  Built and passed all tests locally on three different machines (including old, single-processor linux box).  Does not add new javadoc warnings beyond those of hadoop-1735.

> [hbase] unexpected null value causes META scanner to exit (silently)
> --------------------------------------------------------------------
>
>                 Key: HADOOP-1730
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1730
>             Project: Hadoop
>          Issue Type: Bug
>          Components: contrib/hbase
>    Affects Versions: 0.15.0
>            Reporter: stack
>            Assignee: stack
>             Fix For: 0.15.0
>
>         Attachments: nullsplit.patch
>
>
> META scanner exits silently if a cell value is unexpectedly empty.
> At least the out log had this:
> {code}
> Exception in thread "HMaster.metaScanner" java.lang.IllegalArgumentException: Can't build a writable with empty bytes array
>     at org.apache.hadoop.hbase.util.Writables.getWritable(Writables.java:77)
>     at org.apache.hadoop.hbase.HMaster$BaseScanner.scanRegion(HMaster.java:267)
>     at org.apache.hadoop.hbase.HMaster$MetaScanner.scanOneMetaRegion(HMaster.java:597)
>     at org.apache.hadoop.hbase.HMaster$MetaScanner.maintenanceScan(HMaster.java:654)
>     at org.apache.hadoop.hbase.HMaster$BaseScanner.run(HMaster.java:172)
>     at java.lang.Thread.run(Thread.java:619)
> {code}
> Need to add at a minimum logging of meta scanner exits with the why.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.