You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by Bai Shen <ba...@gmail.com> on 2012/08/02 16:26:22 UTC

KeyValue size too large

I'm running Nutch 2 which uses HBase for storage.  It is attempting to
store files bigger than 10MB into HBase.  This causes the KeyValue size too
large exception.

However, I've set the hbase.client.keyvalue.maxsize to 0, -1, and 100MB.
None of those have had an effect.  AFAIK, it's finding my hbase-site file
because it's correctly reading the hbase.rootdir property.

I've checked the spelling of both the name and the xml, and they're all
correct.  What else should I look at?

Thanks.

Re: KeyValue size too large

Posted by Bai Shen <ba...@gmail.com>.
That was what I was missing.  I moved it and that fixed it.

Thanks.

On Thu, Aug 2, 2012 at 2:42 PM, Jean-Daniel Cryans <jd...@apache.org>wrote:

> It sounds like you are overlooking something, are you sure the client
> is really picking the hbase-site.xml you think it is?
>
> Also I don't get your reference to the hbase.rootdir, the client
> doesn't use it and hbase.client.keyvalue.maxsize is client-side only.
>
> J-D
>
> On Thu, Aug 2, 2012 at 7:26 AM, Bai Shen <ba...@gmail.com> wrote:
> > I'm running Nutch 2 which uses HBase for storage.  It is attempting to
> > store files bigger than 10MB into HBase.  This causes the KeyValue size
> too
> > large exception.
> >
> > However, I've set the hbase.client.keyvalue.maxsize to 0, -1, and 100MB.
> > None of those have had an effect.  AFAIK, it's finding my hbase-site file
> > because it's correctly reading the hbase.rootdir property.
> >
> > I've checked the spelling of both the name and the xml, and they're all
> > correct.  What else should I look at?
> >
> > Thanks.
>

Re: KeyValue size too large

Posted by Jean-Daniel Cryans <jd...@apache.org>.
It sounds like you are overlooking something, are you sure the client
is really picking the hbase-site.xml you think it is?

Also I don't get your reference to the hbase.rootdir, the client
doesn't use it and hbase.client.keyvalue.maxsize is client-side only.

J-D

On Thu, Aug 2, 2012 at 7:26 AM, Bai Shen <ba...@gmail.com> wrote:
> I'm running Nutch 2 which uses HBase for storage.  It is attempting to
> store files bigger than 10MB into HBase.  This causes the KeyValue size too
> large exception.
>
> However, I've set the hbase.client.keyvalue.maxsize to 0, -1, and 100MB.
> None of those have had an effect.  AFAIK, it's finding my hbase-site file
> because it's correctly reading the hbase.rootdir property.
>
> I've checked the spelling of both the name and the xml, and they're all
> correct.  What else should I look at?
>
> Thanks.