You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hbase.apache.org by Ryan Rawson <ry...@gmail.com> on 2009/04/05 11:43:30 UTC

Re: [jira] Updated: (HBASE-1309) HFile catches key in Memcache with empty value

I think it might be legit to store an empty value, empty key = not gonna
happen.

but if the key has enough data in it, eg: a delete tombstone, the value
might be not interesting, so why store a placeholder?

what particular circumstance is this happening under?  I dont want to 'fix'
hfile by allowing empty/null values only to mask a different error that you
are getting...



On Sat, Apr 4, 2009 at 8:31 PM, Andrew Purtell (JIRA) <ji...@apache.org>wrote:

>
>     [
> https://issues.apache.org/jira/browse/HBASE-1309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel]
>
> Andrew Purtell updated HBASE-1309:
> ----------------------------------
>
>    Summary: HFile catches key in Memcache with empty value  (was:
> HFile$Writer.checkValue: IOException: Value cannot be null or empty)
>
> Changed issue title after some initial digging in the code.
>
> Null values is one thing. Should empty values just be ignored rather than
> cause exceptions?
>
> > HFile catches key in Memcache with empty value
> > ----------------------------------------------
> >
> >                 Key: HBASE-1309
> >                 URL: https://issues.apache.org/jira/browse/HBASE-1309
> >             Project: Hadoop HBase
> >          Issue Type: Bug
> >    Affects Versions: 0.20.0
> >            Reporter: Andrew Purtell
> >         Attachments: hbase-hadoop-regionserver-nashua.zip
> >
> >
> > 2009-04-05 02:12:56,497 FATAL
> org.apache.hadoop.hbase.regionserver.MemcacheFlusher: Replay of hlog
> required. Forcing server shutdown
> > org.apache.hadoop.hbase.DroppedSnapshotException: region:
> content,,1238896745127
> >       at
> org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:878)
> >       at
> org.apache.hadoop.hbase.regionserver.HRegion.flushcache(HRegion.java:771)
> >       at
> org.apache.hadoop.hbase.regionserver.MemcacheFlusher.flushRegion(MemcacheFlusher.java:229)
> >       at
> org.apache.hadoop.hbase.regionserver.MemcacheFlusher.run(MemcacheFlusher.java:139)
> > Caused by: java.io.IOException: Value cannot be null or empty
> >       at
> org.apache.hadoop.hbase.io.hfile.HFile$Writer.checkValue(HFile.java:485)
> >       at
> org.apache.hadoop.hbase.io.hfile.HFile$Writer.append(HFile.java:447)
> >       at
> org.apache.hadoop.hbase.regionserver.Store.internalFlushCache(Store.java:501)
> >       at
> org.apache.hadoop.hbase.regionserver.Store.flushCache(Store.java:463)
> >       at
> org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:863)
> >       ... 3 more
>
> --
> This message is automatically generated by JIRA.
> -
> You can reply to this email to add a comment to the issue online.
>
>

Re: [jira] Updated: (HBASE-1309) HFile catches key in Memcache with empty value

Posted by Andrew Purtell <ap...@apache.org>.
Hi Ryan,

Can you reply on the JIRA?

   - Andy

> From: Ryan Rawson <ry...@gmail.com>
> Subject: Re: [jira] Updated: (HBASE-1309) HFile catches key in Memcache with  empty value
> To: hbase-dev@hadoop.apache.org
> Date: Sunday, April 5, 2009, 2:43 AM
> I think it might be legit to store an empty value, empty key
> = not gonna
> happen.
> 
> but if the key has enough data in it, eg: a delete
> tombstone, the value
> might be not interesting, so why store a placeholder?
> 
> what particular circumstance is this happening under?  I
> dont want to 'fix'
> hfile by allowing empty/null values only to mask a
> different error that you
> are getting...
> 
> 
> 
> On Sat, Apr 4, 2009 at 8:31 PM, Andrew Purtell (JIRA)
> <ji...@apache.org>wrote:
> 
> >
> >     [
> >
> https://issues.apache.org/jira/browse/HBASE-1309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel]
> >
> > Andrew Purtell updated HBASE-1309:
> > ----------------------------------
> >
> >    Summary: HFile catches key in Memcache with empty
> value  (was:
> > HFile$Writer.checkValue: IOException: Value cannot be
> null or empty)
> >
> > Changed issue title after some initial digging in the
> code.
> >
> > Null values is one thing. Should empty values just be
> ignored rather than
> > cause exceptions?
> >
> > > HFile catches key in Memcache with empty value
> > > ----------------------------------------------
> > >
> > >                 Key: HBASE-1309
> > >                 URL:
> https://issues.apache.org/jira/browse/HBASE-1309
> > >             Project: Hadoop HBase
> > >          Issue Type: Bug
> > >    Affects Versions: 0.20.0
> > >            Reporter: Andrew Purtell
> > >         Attachments:
> hbase-hadoop-regionserver-nashua.zip
> > >
> > >
> > > 2009-04-05 02:12:56,497 FATAL
> > org.apache.hadoop.hbase.regionserver.MemcacheFlusher:
> Replay of hlog
> > required. Forcing server shutdown
> > > org.apache.hadoop.hbase.DroppedSnapshotException:
> region:
> > content,,1238896745127
> > >       at
> >
> org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:878)
> > >       at
> >
> org.apache.hadoop.hbase.regionserver.HRegion.flushcache(HRegion.java:771)
> > >       at
> >
> org.apache.hadoop.hbase.regionserver.MemcacheFlusher.flushRegion(MemcacheFlusher.java:229)
> > >       at
> >
> org.apache.hadoop.hbase.regionserver.MemcacheFlusher.run(MemcacheFlusher.java:139)
> > > Caused by: java.io.IOException: Value cannot be
> null or empty
> > >       at
> >
> org.apache.hadoop.hbase.io.hfile.HFile$Writer.checkValue(HFile.java:485)
> > >       at
> >
> org.apache.hadoop.hbase.io.hfile.HFile$Writer.append(HFile.java:447)
> > >       at
> >
> org.apache.hadoop.hbase.regionserver.Store.internalFlushCache(Store.java:501)
> > >       at
> >
> org.apache.hadoop.hbase.regionserver.Store.flushCache(Store.java:463)
> > >       at
> >
> org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:863)
> > >       ... 3 more
> >
> > --
> > This message is automatically generated by JIRA.
> > -
> > You can reply to this email to add a comment to the
> issue online.
> >
> >