You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hbase.apache.org by "Andrew Purtell (JIRA)" <ji...@apache.org> on 2009/04/05 04:19:13 UTC

[jira] Created: (HBASE-1309) HFile$Writer.checkValue: IOException: Value cannot be null or empty

HFile$Writer.checkValue: IOException: Value cannot be null or empty
-------------------------------------------------------------------

                 Key: HBASE-1309
                 URL: https://issues.apache.org/jira/browse/HBASE-1309
             Project: Hadoop HBase
          Issue Type: Bug
    Affects Versions: 0.20.0
            Reporter: Andrew Purtell


2009-04-05 02:12:56,497 FATAL org.apache.hadoop.hbase.regionserver.MemcacheFlusher: Replay of hlog required. Forcing server shutdown
org.apache.hadoop.hbase.DroppedSnapshotException: region: content,,1238896745127
	at org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:878)
	at org.apache.hadoop.hbase.regionserver.HRegion.flushcache(HRegion.java:771)
	at org.apache.hadoop.hbase.regionserver.MemcacheFlusher.flushRegion(MemcacheFlusher.java:229)
	at org.apache.hadoop.hbase.regionserver.MemcacheFlusher.run(MemcacheFlusher.java:139)
Caused by: java.io.IOException: Value cannot be null or empty
	at org.apache.hadoop.hbase.io.hfile.HFile$Writer.checkValue(HFile.java:485)
	at org.apache.hadoop.hbase.io.hfile.HFile$Writer.append(HFile.java:447)
	at org.apache.hadoop.hbase.regionserver.Store.internalFlushCache(Store.java:501)
	at org.apache.hadoop.hbase.regionserver.Store.flushCache(Store.java:463)
	at org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:863)
	... 3 more


-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Re: [jira] Updated: (HBASE-1309) HFile catches key in Memcache with empty value

Posted by Andrew Purtell <ap...@apache.org>.
Hi Ryan,

Can you reply on the JIRA?

   - Andy

> From: Ryan Rawson <ry...@gmail.com>
> Subject: Re: [jira] Updated: (HBASE-1309) HFile catches key in Memcache with  empty value
> To: hbase-dev@hadoop.apache.org
> Date: Sunday, April 5, 2009, 2:43 AM
> I think it might be legit to store an empty value, empty key
> = not gonna
> happen.
> 
> but if the key has enough data in it, eg: a delete
> tombstone, the value
> might be not interesting, so why store a placeholder?
> 
> what particular circumstance is this happening under?  I
> dont want to 'fix'
> hfile by allowing empty/null values only to mask a
> different error that you
> are getting...
> 
> 
> 
> On Sat, Apr 4, 2009 at 8:31 PM, Andrew Purtell (JIRA)
> <ji...@apache.org>wrote:
> 
> >
> >     [
> >
> https://issues.apache.org/jira/browse/HBASE-1309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel]
> >
> > Andrew Purtell updated HBASE-1309:
> > ----------------------------------
> >
> >    Summary: HFile catches key in Memcache with empty
> value  (was:
> > HFile$Writer.checkValue: IOException: Value cannot be
> null or empty)
> >
> > Changed issue title after some initial digging in the
> code.
> >
> > Null values is one thing. Should empty values just be
> ignored rather than
> > cause exceptions?
> >
> > > HFile catches key in Memcache with empty value
> > > ----------------------------------------------
> > >
> > >                 Key: HBASE-1309
> > >                 URL:
> https://issues.apache.org/jira/browse/HBASE-1309
> > >             Project: Hadoop HBase
> > >          Issue Type: Bug
> > >    Affects Versions: 0.20.0
> > >            Reporter: Andrew Purtell
> > >         Attachments:
> hbase-hadoop-regionserver-nashua.zip
> > >
> > >
> > > 2009-04-05 02:12:56,497 FATAL
> > org.apache.hadoop.hbase.regionserver.MemcacheFlusher:
> Replay of hlog
> > required. Forcing server shutdown
> > > org.apache.hadoop.hbase.DroppedSnapshotException:
> region:
> > content,,1238896745127
> > >       at
> >
> org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:878)
> > >       at
> >
> org.apache.hadoop.hbase.regionserver.HRegion.flushcache(HRegion.java:771)
> > >       at
> >
> org.apache.hadoop.hbase.regionserver.MemcacheFlusher.flushRegion(MemcacheFlusher.java:229)
> > >       at
> >
> org.apache.hadoop.hbase.regionserver.MemcacheFlusher.run(MemcacheFlusher.java:139)
> > > Caused by: java.io.IOException: Value cannot be
> null or empty
> > >       at
> >
> org.apache.hadoop.hbase.io.hfile.HFile$Writer.checkValue(HFile.java:485)
> > >       at
> >
> org.apache.hadoop.hbase.io.hfile.HFile$Writer.append(HFile.java:447)
> > >       at
> >
> org.apache.hadoop.hbase.regionserver.Store.internalFlushCache(Store.java:501)
> > >       at
> >
> org.apache.hadoop.hbase.regionserver.Store.flushCache(Store.java:463)
> > >       at
> >
> org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:863)
> > >       ... 3 more
> >
> > --
> > This message is automatically generated by JIRA.
> > -
> > You can reply to this email to add a comment to the
> issue online.
> >
> >


      

Re: [jira] Updated: (HBASE-1309) HFile catches key in Memcache with empty value

Posted by Ryan Rawson <ry...@gmail.com>.
I think it might be legit to store an empty value, empty key = not gonna
happen.

but if the key has enough data in it, eg: a delete tombstone, the value
might be not interesting, so why store a placeholder?

what particular circumstance is this happening under?  I dont want to 'fix'
hfile by allowing empty/null values only to mask a different error that you
are getting...



On Sat, Apr 4, 2009 at 8:31 PM, Andrew Purtell (JIRA) <ji...@apache.org>wrote:

>
>     [
> https://issues.apache.org/jira/browse/HBASE-1309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel]
>
> Andrew Purtell updated HBASE-1309:
> ----------------------------------
>
>    Summary: HFile catches key in Memcache with empty value  (was:
> HFile$Writer.checkValue: IOException: Value cannot be null or empty)
>
> Changed issue title after some initial digging in the code.
>
> Null values is one thing. Should empty values just be ignored rather than
> cause exceptions?
>
> > HFile catches key in Memcache with empty value
> > ----------------------------------------------
> >
> >                 Key: HBASE-1309
> >                 URL: https://issues.apache.org/jira/browse/HBASE-1309
> >             Project: Hadoop HBase
> >          Issue Type: Bug
> >    Affects Versions: 0.20.0
> >            Reporter: Andrew Purtell
> >         Attachments: hbase-hadoop-regionserver-nashua.zip
> >
> >
> > 2009-04-05 02:12:56,497 FATAL
> org.apache.hadoop.hbase.regionserver.MemcacheFlusher: Replay of hlog
> required. Forcing server shutdown
> > org.apache.hadoop.hbase.DroppedSnapshotException: region:
> content,,1238896745127
> >       at
> org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:878)
> >       at
> org.apache.hadoop.hbase.regionserver.HRegion.flushcache(HRegion.java:771)
> >       at
> org.apache.hadoop.hbase.regionserver.MemcacheFlusher.flushRegion(MemcacheFlusher.java:229)
> >       at
> org.apache.hadoop.hbase.regionserver.MemcacheFlusher.run(MemcacheFlusher.java:139)
> > Caused by: java.io.IOException: Value cannot be null or empty
> >       at
> org.apache.hadoop.hbase.io.hfile.HFile$Writer.checkValue(HFile.java:485)
> >       at
> org.apache.hadoop.hbase.io.hfile.HFile$Writer.append(HFile.java:447)
> >       at
> org.apache.hadoop.hbase.regionserver.Store.internalFlushCache(Store.java:501)
> >       at
> org.apache.hadoop.hbase.regionserver.Store.flushCache(Store.java:463)
> >       at
> org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:863)
> >       ... 3 more
>
> --
> This message is automatically generated by JIRA.
> -
> You can reply to this email to add a comment to the issue online.
>
>

[jira] Commented: (HBASE-1309) HFile catches key in Memcache with empty value

Posted by "Andrew Purtell (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-1309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12695896#action_12695896 ] 

Andrew Purtell commented on HBASE-1309:
---------------------------------------

A more basic case is booleans as existence tests on keys. 

> HFile catches key in Memcache with empty value
> ----------------------------------------------
>
>                 Key: HBASE-1309
>                 URL: https://issues.apache.org/jira/browse/HBASE-1309
>             Project: Hadoop HBase
>          Issue Type: Bug
>    Affects Versions: 0.20.0
>            Reporter: Andrew Purtell
>         Attachments: hbase-hadoop-regionserver-nashua.zip
>
>
> 2009-04-05 02:12:56,497 FATAL org.apache.hadoop.hbase.regionserver.MemcacheFlusher: Replay of hlog required. Forcing server shutdown
> org.apache.hadoop.hbase.DroppedSnapshotException: region: content,,1238896745127
> 	at org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:878)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.flushcache(HRegion.java:771)
> 	at org.apache.hadoop.hbase.regionserver.MemcacheFlusher.flushRegion(MemcacheFlusher.java:229)
> 	at org.apache.hadoop.hbase.regionserver.MemcacheFlusher.run(MemcacheFlusher.java:139)
> Caused by: java.io.IOException: Value cannot be null or empty
> 	at org.apache.hadoop.hbase.io.hfile.HFile$Writer.checkValue(HFile.java:485)
> 	at org.apache.hadoop.hbase.io.hfile.HFile$Writer.append(HFile.java:447)
> 	at org.apache.hadoop.hbase.regionserver.Store.internalFlushCache(Store.java:501)
> 	at org.apache.hadoop.hbase.regionserver.Store.flushCache(Store.java:463)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:863)
> 	... 3 more

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HBASE-1309) HFile catches key in Memcache with empty value

Posted by "Andrew Purtell (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-1309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12695891#action_12695891 ] 

Andrew Purtell commented on HBASE-1309:
---------------------------------------

>From Ryan on hbase-dev@:

> I think it might be legit to store an empty value,
> empty key = not gonna happen.
>
> but if the key has enough data in it, eg: a delete tombstone, the value
> might be not interesting, so why store a placeholder?
>
> what particular circumstance is this happening under?  I dont want to 'fix'
> hfile by allowing empty/null values only to mask a different error that you
> are getting...

> HFile catches key in Memcache with empty value
> ----------------------------------------------
>
>                 Key: HBASE-1309
>                 URL: https://issues.apache.org/jira/browse/HBASE-1309
>             Project: Hadoop HBase
>          Issue Type: Bug
>    Affects Versions: 0.20.0
>            Reporter: Andrew Purtell
>         Attachments: hbase-hadoop-regionserver-nashua.zip
>
>
> 2009-04-05 02:12:56,497 FATAL org.apache.hadoop.hbase.regionserver.MemcacheFlusher: Replay of hlog required. Forcing server shutdown
> org.apache.hadoop.hbase.DroppedSnapshotException: region: content,,1238896745127
> 	at org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:878)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.flushcache(HRegion.java:771)
> 	at org.apache.hadoop.hbase.regionserver.MemcacheFlusher.flushRegion(MemcacheFlusher.java:229)
> 	at org.apache.hadoop.hbase.regionserver.MemcacheFlusher.run(MemcacheFlusher.java:139)
> Caused by: java.io.IOException: Value cannot be null or empty
> 	at org.apache.hadoop.hbase.io.hfile.HFile$Writer.checkValue(HFile.java:485)
> 	at org.apache.hadoop.hbase.io.hfile.HFile$Writer.append(HFile.java:447)
> 	at org.apache.hadoop.hbase.regionserver.Store.internalFlushCache(Store.java:501)
> 	at org.apache.hadoop.hbase.regionserver.Store.flushCache(Store.java:463)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:863)
> 	... 3 more

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Resolved: (HBASE-1309) HFile rejects key in Memcache with empty value

Posted by "Andrew Purtell (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-1309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Andrew Purtell resolved HBASE-1309.
-----------------------------------

    Resolution: Fixed

> HFile rejects key in Memcache with empty value
> ----------------------------------------------
>
>                 Key: HBASE-1309
>                 URL: https://issues.apache.org/jira/browse/HBASE-1309
>             Project: Hadoop HBase
>          Issue Type: Bug
>    Affects Versions: 0.20.0
>            Reporter: Andrew Purtell
>             Fix For: 0.20.0
>
>         Attachments: HBASE-1309.patch, hbase-hadoop-regionserver-nashua.zip
>
>
> 2009-04-05 02:12:56,497 FATAL org.apache.hadoop.hbase.regionserver.MemcacheFlusher: Replay of hlog required. Forcing server shutdown
> org.apache.hadoop.hbase.DroppedSnapshotException: region: content,,1238896745127
> 	at org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:878)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.flushcache(HRegion.java:771)
> 	at org.apache.hadoop.hbase.regionserver.MemcacheFlusher.flushRegion(MemcacheFlusher.java:229)
> 	at org.apache.hadoop.hbase.regionserver.MemcacheFlusher.run(MemcacheFlusher.java:139)
> Caused by: java.io.IOException: Value cannot be null or empty
> 	at org.apache.hadoop.hbase.io.hfile.HFile$Writer.checkValue(HFile.java:485)
> 	at org.apache.hadoop.hbase.io.hfile.HFile$Writer.append(HFile.java:447)
> 	at org.apache.hadoop.hbase.regionserver.Store.internalFlushCache(Store.java:501)
> 	at org.apache.hadoop.hbase.regionserver.Store.flushCache(Store.java:463)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:863)
> 	... 3 more

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HBASE-1309) HFile rejects key in Memcache with empty value

Posted by "Andrew Purtell (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-1309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Andrew Purtell updated HBASE-1309:
----------------------------------

    Fix Version/s: 0.20.0
          Summary: HFile rejects key in Memcache with empty value  (was: HFile catches key in Memcache with empty value)

Committed to trunk. Passes all local tests. Tested under concurrent write/scan load.

> HFile rejects key in Memcache with empty value
> ----------------------------------------------
>
>                 Key: HBASE-1309
>                 URL: https://issues.apache.org/jira/browse/HBASE-1309
>             Project: Hadoop HBase
>          Issue Type: Bug
>    Affects Versions: 0.20.0
>            Reporter: Andrew Purtell
>             Fix For: 0.20.0
>
>         Attachments: HBASE-1309.patch, hbase-hadoop-regionserver-nashua.zip
>
>
> 2009-04-05 02:12:56,497 FATAL org.apache.hadoop.hbase.regionserver.MemcacheFlusher: Replay of hlog required. Forcing server shutdown
> org.apache.hadoop.hbase.DroppedSnapshotException: region: content,,1238896745127
> 	at org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:878)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.flushcache(HRegion.java:771)
> 	at org.apache.hadoop.hbase.regionserver.MemcacheFlusher.flushRegion(MemcacheFlusher.java:229)
> 	at org.apache.hadoop.hbase.regionserver.MemcacheFlusher.run(MemcacheFlusher.java:139)
> Caused by: java.io.IOException: Value cannot be null or empty
> 	at org.apache.hadoop.hbase.io.hfile.HFile$Writer.checkValue(HFile.java:485)
> 	at org.apache.hadoop.hbase.io.hfile.HFile$Writer.append(HFile.java:447)
> 	at org.apache.hadoop.hbase.regionserver.Store.internalFlushCache(Store.java:501)
> 	at org.apache.hadoop.hbase.regionserver.Store.flushCache(Store.java:463)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:863)
> 	... 3 more

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Issue Comment Edited: (HBASE-1309) HFile catches key in Memcache with empty value

Posted by "Andrew Purtell (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-1309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12696250#action_12696250 ] 

Andrew Purtell edited comment on HBASE-1309 at 4/6/09 2:10 PM:
---------------------------------------------------------------

If there are no objections I'm going to apply the patch attached to this issue.

      was (Author: apurtell):
    If there are no objects I'm going to apply the patch attached to this issue.
  
> HFile catches key in Memcache with empty value
> ----------------------------------------------
>
>                 Key: HBASE-1309
>                 URL: https://issues.apache.org/jira/browse/HBASE-1309
>             Project: Hadoop HBase
>          Issue Type: Bug
>    Affects Versions: 0.20.0
>            Reporter: Andrew Purtell
>         Attachments: HBASE-1309.patch, hbase-hadoop-regionserver-nashua.zip
>
>
> 2009-04-05 02:12:56,497 FATAL org.apache.hadoop.hbase.regionserver.MemcacheFlusher: Replay of hlog required. Forcing server shutdown
> org.apache.hadoop.hbase.DroppedSnapshotException: region: content,,1238896745127
> 	at org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:878)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.flushcache(HRegion.java:771)
> 	at org.apache.hadoop.hbase.regionserver.MemcacheFlusher.flushRegion(MemcacheFlusher.java:229)
> 	at org.apache.hadoop.hbase.regionserver.MemcacheFlusher.run(MemcacheFlusher.java:139)
> Caused by: java.io.IOException: Value cannot be null or empty
> 	at org.apache.hadoop.hbase.io.hfile.HFile$Writer.checkValue(HFile.java:485)
> 	at org.apache.hadoop.hbase.io.hfile.HFile$Writer.append(HFile.java:447)
> 	at org.apache.hadoop.hbase.regionserver.Store.internalFlushCache(Store.java:501)
> 	at org.apache.hadoop.hbase.regionserver.Store.flushCache(Store.java:463)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:863)
> 	... 3 more

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HBASE-1309) HFile$Writer.checkValue: IOException: Value cannot be null or empty

Posted by "Andrew Purtell (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-1309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Andrew Purtell updated HBASE-1309:
----------------------------------

    Attachment: hbase-hadoop-regionserver-nashua.zip

> HFile$Writer.checkValue: IOException: Value cannot be null or empty
> -------------------------------------------------------------------
>
>                 Key: HBASE-1309
>                 URL: https://issues.apache.org/jira/browse/HBASE-1309
>             Project: Hadoop HBase
>          Issue Type: Bug
>    Affects Versions: 0.20.0
>            Reporter: Andrew Purtell
>         Attachments: hbase-hadoop-regionserver-nashua.zip
>
>
> 2009-04-05 02:12:56,497 FATAL org.apache.hadoop.hbase.regionserver.MemcacheFlusher: Replay of hlog required. Forcing server shutdown
> org.apache.hadoop.hbase.DroppedSnapshotException: region: content,,1238896745127
> 	at org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:878)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.flushcache(HRegion.java:771)
> 	at org.apache.hadoop.hbase.regionserver.MemcacheFlusher.flushRegion(MemcacheFlusher.java:229)
> 	at org.apache.hadoop.hbase.regionserver.MemcacheFlusher.run(MemcacheFlusher.java:139)
> Caused by: java.io.IOException: Value cannot be null or empty
> 	at org.apache.hadoop.hbase.io.hfile.HFile$Writer.checkValue(HFile.java:485)
> 	at org.apache.hadoop.hbase.io.hfile.HFile$Writer.append(HFile.java:447)
> 	at org.apache.hadoop.hbase.regionserver.Store.internalFlushCache(Store.java:501)
> 	at org.apache.hadoop.hbase.regionserver.Store.flushCache(Store.java:463)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:863)
> 	... 3 more

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HBASE-1309) HFile catches key in Memcache with empty value

Posted by "Andrew Purtell (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-1309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12696250#action_12696250 ] 

Andrew Purtell commented on HBASE-1309:
---------------------------------------

If there are no objects I'm going to apply the patch attached to this issue.

> HFile catches key in Memcache with empty value
> ----------------------------------------------
>
>                 Key: HBASE-1309
>                 URL: https://issues.apache.org/jira/browse/HBASE-1309
>             Project: Hadoop HBase
>          Issue Type: Bug
>    Affects Versions: 0.20.0
>            Reporter: Andrew Purtell
>         Attachments: HBASE-1309.patch, hbase-hadoop-regionserver-nashua.zip
>
>
> 2009-04-05 02:12:56,497 FATAL org.apache.hadoop.hbase.regionserver.MemcacheFlusher: Replay of hlog required. Forcing server shutdown
> org.apache.hadoop.hbase.DroppedSnapshotException: region: content,,1238896745127
> 	at org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:878)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.flushcache(HRegion.java:771)
> 	at org.apache.hadoop.hbase.regionserver.MemcacheFlusher.flushRegion(MemcacheFlusher.java:229)
> 	at org.apache.hadoop.hbase.regionserver.MemcacheFlusher.run(MemcacheFlusher.java:139)
> Caused by: java.io.IOException: Value cannot be null or empty
> 	at org.apache.hadoop.hbase.io.hfile.HFile$Writer.checkValue(HFile.java:485)
> 	at org.apache.hadoop.hbase.io.hfile.HFile$Writer.append(HFile.java:447)
> 	at org.apache.hadoop.hbase.regionserver.Store.internalFlushCache(Store.java:501)
> 	at org.apache.hadoop.hbase.regionserver.Store.flushCache(Store.java:463)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:863)
> 	... 3 more

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HBASE-1309) HFile catches key in Memcache with empty value

Posted by "Andrew Purtell (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-1309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12695894#action_12695894 ] 

Andrew Purtell commented on HBASE-1309:
---------------------------------------

In my opinion HBase should not dictate to users what they can or cannot store into the system.

I did not say anything about empty keys, which of course makes no sense. 

The particular circumstance in this place is a crawling application that stores content indexed by SHA-1 hash but also includes a family 'url:' which stores, for each unique object according to hash, the list of URLs where it was encountered. The URLs are stored as column qualifiers to produce a list of unique values with no need for scanning for duplicate elimination etc. There is no need to store data also because all the data is already in the key. 

> HFile catches key in Memcache with empty value
> ----------------------------------------------
>
>                 Key: HBASE-1309
>                 URL: https://issues.apache.org/jira/browse/HBASE-1309
>             Project: Hadoop HBase
>          Issue Type: Bug
>    Affects Versions: 0.20.0
>            Reporter: Andrew Purtell
>         Attachments: hbase-hadoop-regionserver-nashua.zip
>
>
> 2009-04-05 02:12:56,497 FATAL org.apache.hadoop.hbase.regionserver.MemcacheFlusher: Replay of hlog required. Forcing server shutdown
> org.apache.hadoop.hbase.DroppedSnapshotException: region: content,,1238896745127
> 	at org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:878)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.flushcache(HRegion.java:771)
> 	at org.apache.hadoop.hbase.regionserver.MemcacheFlusher.flushRegion(MemcacheFlusher.java:229)
> 	at org.apache.hadoop.hbase.regionserver.MemcacheFlusher.run(MemcacheFlusher.java:139)
> Caused by: java.io.IOException: Value cannot be null or empty
> 	at org.apache.hadoop.hbase.io.hfile.HFile$Writer.checkValue(HFile.java:485)
> 	at org.apache.hadoop.hbase.io.hfile.HFile$Writer.append(HFile.java:447)
> 	at org.apache.hadoop.hbase.regionserver.Store.internalFlushCache(Store.java:501)
> 	at org.apache.hadoop.hbase.regionserver.Store.flushCache(Store.java:463)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:863)
> 	... 3 more

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HBASE-1309) HFile catches key in Memcache with empty value

Posted by "Andrew Purtell (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-1309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Andrew Purtell updated HBASE-1309:
----------------------------------

    Attachment: HBASE-1309.patch

> HFile catches key in Memcache with empty value
> ----------------------------------------------
>
>                 Key: HBASE-1309
>                 URL: https://issues.apache.org/jira/browse/HBASE-1309
>             Project: Hadoop HBase
>          Issue Type: Bug
>    Affects Versions: 0.20.0
>            Reporter: Andrew Purtell
>         Attachments: HBASE-1309.patch, hbase-hadoop-regionserver-nashua.zip
>
>
> 2009-04-05 02:12:56,497 FATAL org.apache.hadoop.hbase.regionserver.MemcacheFlusher: Replay of hlog required. Forcing server shutdown
> org.apache.hadoop.hbase.DroppedSnapshotException: region: content,,1238896745127
> 	at org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:878)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.flushcache(HRegion.java:771)
> 	at org.apache.hadoop.hbase.regionserver.MemcacheFlusher.flushRegion(MemcacheFlusher.java:229)
> 	at org.apache.hadoop.hbase.regionserver.MemcacheFlusher.run(MemcacheFlusher.java:139)
> Caused by: java.io.IOException: Value cannot be null or empty
> 	at org.apache.hadoop.hbase.io.hfile.HFile$Writer.checkValue(HFile.java:485)
> 	at org.apache.hadoop.hbase.io.hfile.HFile$Writer.append(HFile.java:447)
> 	at org.apache.hadoop.hbase.regionserver.Store.internalFlushCache(Store.java:501)
> 	at org.apache.hadoop.hbase.regionserver.Store.flushCache(Store.java:463)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:863)
> 	... 3 more

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Issue Comment Edited: (HBASE-1309) HFile catches key in Memcache with empty value

Posted by "Andrew Purtell (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-1309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12695807#action_12695807 ] 

Andrew Purtell edited comment on HBASE-1309 at 4/4/09 9:32 PM:
---------------------------------------------------------------

Changed issue title after some initial digging in the code. 

Null values is one thing. Should empty values just be ignored rather than cause exceptions? Actually empty values are valid also: Apps may only want to test for presence of a key.

      was (Author: apurtell):
    Changed issue title after some initial digging in the code. 

Null values is one thing. Should empty values just be ignored rather than cause exceptions? 
  
> HFile catches key in Memcache with empty value
> ----------------------------------------------
>
>                 Key: HBASE-1309
>                 URL: https://issues.apache.org/jira/browse/HBASE-1309
>             Project: Hadoop HBase
>          Issue Type: Bug
>    Affects Versions: 0.20.0
>            Reporter: Andrew Purtell
>         Attachments: hbase-hadoop-regionserver-nashua.zip
>
>
> 2009-04-05 02:12:56,497 FATAL org.apache.hadoop.hbase.regionserver.MemcacheFlusher: Replay of hlog required. Forcing server shutdown
> org.apache.hadoop.hbase.DroppedSnapshotException: region: content,,1238896745127
> 	at org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:878)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.flushcache(HRegion.java:771)
> 	at org.apache.hadoop.hbase.regionserver.MemcacheFlusher.flushRegion(MemcacheFlusher.java:229)
> 	at org.apache.hadoop.hbase.regionserver.MemcacheFlusher.run(MemcacheFlusher.java:139)
> Caused by: java.io.IOException: Value cannot be null or empty
> 	at org.apache.hadoop.hbase.io.hfile.HFile$Writer.checkValue(HFile.java:485)
> 	at org.apache.hadoop.hbase.io.hfile.HFile$Writer.append(HFile.java:447)
> 	at org.apache.hadoop.hbase.regionserver.Store.internalFlushCache(Store.java:501)
> 	at org.apache.hadoop.hbase.regionserver.Store.flushCache(Store.java:463)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:863)
> 	... 3 more

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HBASE-1309) HFile catches key in Memcache with empty value

Posted by "Andrew Purtell (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-1309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Andrew Purtell updated HBASE-1309:
----------------------------------

    Summary: HFile catches key in Memcache with empty value  (was: HFile$Writer.checkValue: IOException: Value cannot be null or empty)

Changed issue title after some initial digging in the code. 

Null values is one thing. Should empty values just be ignored rather than cause exceptions? 

> HFile catches key in Memcache with empty value
> ----------------------------------------------
>
>                 Key: HBASE-1309
>                 URL: https://issues.apache.org/jira/browse/HBASE-1309
>             Project: Hadoop HBase
>          Issue Type: Bug
>    Affects Versions: 0.20.0
>            Reporter: Andrew Purtell
>         Attachments: hbase-hadoop-regionserver-nashua.zip
>
>
> 2009-04-05 02:12:56,497 FATAL org.apache.hadoop.hbase.regionserver.MemcacheFlusher: Replay of hlog required. Forcing server shutdown
> org.apache.hadoop.hbase.DroppedSnapshotException: region: content,,1238896745127
> 	at org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:878)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.flushcache(HRegion.java:771)
> 	at org.apache.hadoop.hbase.regionserver.MemcacheFlusher.flushRegion(MemcacheFlusher.java:229)
> 	at org.apache.hadoop.hbase.regionserver.MemcacheFlusher.run(MemcacheFlusher.java:139)
> Caused by: java.io.IOException: Value cannot be null or empty
> 	at org.apache.hadoop.hbase.io.hfile.HFile$Writer.checkValue(HFile.java:485)
> 	at org.apache.hadoop.hbase.io.hfile.HFile$Writer.append(HFile.java:447)
> 	at org.apache.hadoop.hbase.regionserver.Store.internalFlushCache(Store.java:501)
> 	at org.apache.hadoop.hbase.regionserver.Store.flushCache(Store.java:463)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:863)
> 	... 3 more

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.