You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hbase.apache.org by Jean-Marc Spaggiari <je...@spaggiari.org> on 2018/02/23 19:04:44 UTC
client.HBaseAdmin No serialized HRegionInfo
Hi guys,
In HBase 2.0.0-beta-1, getting this:
2018-02-23 14:01:55,499 WARN [main] client.HBaseAdmin
(HBaseAdmin.java:visit(1948)) - No serialized HRegionInfo in
keyvalues={page_proposed,,1384198043055.c15b13946fa4318a0a956e067d59ebd4./info:server/1384198854149/Put/vlen=11/seqid=0,
page_proposed,,1384198043055.c15b13946fa4318a0a956e067d59ebd4./info:serverstartcode/1384198854149/Put/vlen=8/seqid=0}
I'm not getting that on other versions. And I'm not sure what it means...
Any idea?
Thanks,
JMS
Re: client.HBaseAdmin No serialized HRegionInfo
Posted by Jean-Marc Spaggiari <je...@spaggiari.org>.
Oh! It might explain ;)
Thanks Sir. Will fix that manually then...
JMS
Le 23 févr. 2018 15 h 04, "Stack" <st...@duboce.net> a écrit :
On Fri, Feb 23, 2018 at 11:10 AM, Ted Yu <yu...@gmail.com> wrote:
> Can you check whether region c15b13946fa4318a0a956e067d59ebd4 is healthy
> (via hbck) ?
>
>
hbck does not work against hbase2 [1].
S
1.
https://docs.google.com/document/d/1WCsVlnHjJeKUcl7wHwqb4z9iEu_
ktczrlKHK8N4SZzs/edit#heading=h.3jy69yxm0gxm
> You may find some clue in master log.
>
> Cheers
>
>
>
> On Fri, Feb 23, 2018 at 11:04 AM, Jean-Marc Spaggiari <
> jean-marc@spaggiari.org> wrote:
>
> > Hi guys,
> >
> > In HBase 2.0.0-beta-1, getting this:
> >
> > 2018-02-23 14:01:55,499 WARN [main] client.HBaseAdmin
> > (HBaseAdmin.java:visit(1948)) - No serialized HRegionInfo in
> > keyvalues={page_proposed,,1384198043055.c15b13946fa4318a0a956e067d59eb
> > d4./info:server/1384198854149/Put/vlen=11/seqid=0,
> > page_proposed,,1384198043055.c15b13946fa4318a0a956e067d59eb
> > d4./info:serverstartcode/1384198854149/Put/vlen=8/seqid=0}
> >
> >
> > I'm not getting that on other versions. And I'm not sure what it
means...
> >
> > Any idea?
> >
> > Thanks,
> >
> > JMS
> >
>
Re: client.HBaseAdmin No serialized HRegionInfo
Posted by Stack <st...@duboce.net>.
On Fri, Feb 23, 2018 at 11:10 AM, Ted Yu <yu...@gmail.com> wrote:
> Can you check whether region c15b13946fa4318a0a956e067d59ebd4 is healthy
> (via hbck) ?
>
>
hbck does not work against hbase2 [1].
S
1.
https://docs.google.com/document/d/1WCsVlnHjJeKUcl7wHwqb4z9iEu_ktczrlKHK8N4SZzs/edit#heading=h.3jy69yxm0gxm
> You may find some clue in master log.
>
> Cheers
>
>
>
> On Fri, Feb 23, 2018 at 11:04 AM, Jean-Marc Spaggiari <
> jean-marc@spaggiari.org> wrote:
>
> > Hi guys,
> >
> > In HBase 2.0.0-beta-1, getting this:
> >
> > 2018-02-23 14:01:55,499 WARN [main] client.HBaseAdmin
> > (HBaseAdmin.java:visit(1948)) - No serialized HRegionInfo in
> > keyvalues={page_proposed,,1384198043055.c15b13946fa4318a0a956e067d59eb
> > d4./info:server/1384198854149/Put/vlen=11/seqid=0,
> > page_proposed,,1384198043055.c15b13946fa4318a0a956e067d59eb
> > d4./info:serverstartcode/1384198854149/Put/vlen=8/seqid=0}
> >
> >
> > I'm not getting that on other versions. And I'm not sure what it means...
> >
> > Any idea?
> >
> > Thanks,
> >
> > JMS
> >
>
Re: client.HBaseAdmin No serialized HRegionInfo
Posted by Jean-Marc Spaggiari <je...@spaggiari.org>.
Tried -fixMeta and -repair and nothing seems to make any difference... Not
even sure it's taken into consideration... Strange...
2018-02-23 14:37 GMT-05:00 Jean-Marc Spaggiari <je...@spaggiari.org>:
> BTW, the "Empty REGIONINFO_QUALIFIER found in hbase:meta" should tell
> more details about the "issue"...
>
> 2018-02-23 14:29 GMT-05:00 Jean-Marc Spaggiari <je...@spaggiari.org>:
>
>> 1 inconsistencies detected.
>> Status: INCONSISTENT
>>
>> But this table is fine:
>> Table page_proposed is okay.
>> Number of regions: 16
>> Deployed on: node1.distparser.com,16020,1519412120531
>> node3.distparser.com,16020,1519412121079 node4.distparser.com,16020,1519412125106
>> node5.distparser.com,16020,1519412125539 node6.distparser.com,16020,1519412120498
>> node7.distparser.com,16020,1519412124131 node8.distparser.com,16020,151
>> 9412120794
>>
>> The inconsistency is due to this:
>> 2018-02-23 14:25:18,393 INFO [main] util.HBaseFsck: Loading regionsinfo
>> from the hbase:meta table
>> ERROR: Empty REGIONINFO_QUALIFIER found in hbase:meta
>>
>> Number of empty REGIONINFO_QUALIFIER rows in hbase:meta: 1
>>
>> What is interesting is this:
>> hbase@node2:~/hbase-2.0.0-beta-1$ hdfs dfs -ls
>> /hbase/data/default/page_proposed/c15b13946fa4318a0a956e067d59ebd4
>> ls: `/hbase/data/default/page_proposed/c15b13946fa4318a0a956e067d59ebd4':
>> No such file or directory
>>
>> So sounds like this is referenced into the META but not into HDFS. Should
>> not HBCK report that instead of saying the table is Okay?
>>
>> JMS
>>
>>
>> 2018-02-23 14:10 GMT-05:00 Ted Yu <yu...@gmail.com>:
>>
>>> Can you check whether region c15b13946fa4318a0a956e067d59ebd4 is healthy
>>> (via hbck) ?
>>>
>>> You may find some clue in master log.
>>>
>>> Cheers
>>>
>>>
>>>
>>> On Fri, Feb 23, 2018 at 11:04 AM, Jean-Marc Spaggiari <
>>> jean-marc@spaggiari.org> wrote:
>>>
>>> > Hi guys,
>>> >
>>> > In HBase 2.0.0-beta-1, getting this:
>>> >
>>> > 2018-02-23 14:01:55,499 WARN [main] client.HBaseAdmin
>>> > (HBaseAdmin.java:visit(1948)) - No serialized HRegionInfo in
>>> > keyvalues={page_proposed,,1384198043055.c15b13946fa4318a0a956e067d59eb
>>> > d4./info:server/1384198854149/Put/vlen=11/seqid=0,
>>> > page_proposed,,1384198043055.c15b13946fa4318a0a956e067d59eb
>>> > d4./info:serverstartcode/1384198854149/Put/vlen=8/seqid=0}
>>> >
>>> >
>>> > I'm not getting that on other versions. And I'm not sure what it
>>> means...
>>> >
>>> > Any idea?
>>> >
>>> > Thanks,
>>> >
>>> > JMS
>>> >
>>>
>>
>>
>
Re: client.HBaseAdmin No serialized HRegionInfo
Posted by Jean-Marc Spaggiari <je...@spaggiari.org>.
BTW, the "Empty REGIONINFO_QUALIFIER found in hbase:meta" should tell more
details about the "issue"...
2018-02-23 14:29 GMT-05:00 Jean-Marc Spaggiari <je...@spaggiari.org>:
> 1 inconsistencies detected.
> Status: INCONSISTENT
>
> But this table is fine:
> Table page_proposed is okay.
> Number of regions: 16
> Deployed on: node1.distparser.com,16020,1519412120531
> node3.distparser.com,16020,1519412121079 node4.distparser.com,16020,1519412125106
> node5.distparser.com,16020,1519412125539 node6.distparser.com,16020,1519412120498
> node7.distparser.com,16020,1519412124131 node8.distparser.com,16020,
> 1519412120794
>
> The inconsistency is due to this:
> 2018-02-23 14:25:18,393 INFO [main] util.HBaseFsck: Loading regionsinfo
> from the hbase:meta table
> ERROR: Empty REGIONINFO_QUALIFIER found in hbase:meta
>
> Number of empty REGIONINFO_QUALIFIER rows in hbase:meta: 1
>
> What is interesting is this:
> hbase@node2:~/hbase-2.0.0-beta-1$ hdfs dfs -ls /hbase/data/default/page_
> proposed/c15b13946fa4318a0a956e067d59ebd4
> ls: `/hbase/data/default/page_proposed/c15b13946fa4318a0a956e067d59ebd4':
> No such file or directory
>
> So sounds like this is referenced into the META but not into HDFS. Should
> not HBCK report that instead of saying the table is Okay?
>
> JMS
>
>
> 2018-02-23 14:10 GMT-05:00 Ted Yu <yu...@gmail.com>:
>
>> Can you check whether region c15b13946fa4318a0a956e067d59ebd4 is healthy
>> (via hbck) ?
>>
>> You may find some clue in master log.
>>
>> Cheers
>>
>>
>>
>> On Fri, Feb 23, 2018 at 11:04 AM, Jean-Marc Spaggiari <
>> jean-marc@spaggiari.org> wrote:
>>
>> > Hi guys,
>> >
>> > In HBase 2.0.0-beta-1, getting this:
>> >
>> > 2018-02-23 14:01:55,499 WARN [main] client.HBaseAdmin
>> > (HBaseAdmin.java:visit(1948)) - No serialized HRegionInfo in
>> > keyvalues={page_proposed,,1384198043055.c15b13946fa4318a0a956e067d59eb
>> > d4./info:server/1384198854149/Put/vlen=11/seqid=0,
>> > page_proposed,,1384198043055.c15b13946fa4318a0a956e067d59eb
>> > d4./info:serverstartcode/1384198854149/Put/vlen=8/seqid=0}
>> >
>> >
>> > I'm not getting that on other versions. And I'm not sure what it
>> means...
>> >
>> > Any idea?
>> >
>> > Thanks,
>> >
>> > JMS
>> >
>>
>
>
Re: client.HBaseAdmin No serialized HRegionInfo
Posted by Jean-Marc Spaggiari <je...@spaggiari.org>.
1 inconsistencies detected.
Status: INCONSISTENT
But this table is fine:
Table page_proposed is okay.
Number of regions: 16
Deployed on: node1.distparser.com,16020,1519412120531
node3.distparser.com,16020,1519412121079
node4.distparser.com,16020,1519412125106
node5.distparser.com,16020,1519412125539
node6.distparser.com,16020,1519412120498
node7.distparser.com,16020,1519412124131 node8.distparser.com
,16020,1519412120794
The inconsistency is due to this:
2018-02-23 14:25:18,393 INFO [main] util.HBaseFsck: Loading regionsinfo
from the hbase:meta table
ERROR: Empty REGIONINFO_QUALIFIER found in hbase:meta
Number of empty REGIONINFO_QUALIFIER rows in hbase:meta: 1
What is interesting is this:
hbase@node2:~/hbase-2.0.0-beta-1$ hdfs dfs -ls
/hbase/data/default/page_proposed/c15b13946fa4318a0a956e067d59ebd4
ls: `/hbase/data/default/page_proposed/c15b13946fa4318a0a956e067d59ebd4':
No such file or directory
So sounds like this is referenced into the META but not into HDFS. Should
not HBCK report that instead of saying the table is Okay?
JMS
2018-02-23 14:10 GMT-05:00 Ted Yu <yu...@gmail.com>:
> Can you check whether region c15b13946fa4318a0a956e067d59ebd4 is healthy
> (via hbck) ?
>
> You may find some clue in master log.
>
> Cheers
>
>
>
> On Fri, Feb 23, 2018 at 11:04 AM, Jean-Marc Spaggiari <
> jean-marc@spaggiari.org> wrote:
>
> > Hi guys,
> >
> > In HBase 2.0.0-beta-1, getting this:
> >
> > 2018-02-23 14:01:55,499 WARN [main] client.HBaseAdmin
> > (HBaseAdmin.java:visit(1948)) - No serialized HRegionInfo in
> > keyvalues={page_proposed,,1384198043055.c15b13946fa4318a0a956e067d59eb
> > d4./info:server/1384198854149/Put/vlen=11/seqid=0,
> > page_proposed,,1384198043055.c15b13946fa4318a0a956e067d59eb
> > d4./info:serverstartcode/1384198854149/Put/vlen=8/seqid=0}
> >
> >
> > I'm not getting that on other versions. And I'm not sure what it means...
> >
> > Any idea?
> >
> > Thanks,
> >
> > JMS
> >
>
Re: client.HBaseAdmin No serialized HRegionInfo
Posted by Ted Yu <yu...@gmail.com>.
Can you check whether region c15b13946fa4318a0a956e067d59ebd4 is healthy
(via hbck) ?
You may find some clue in master log.
Cheers
On Fri, Feb 23, 2018 at 11:04 AM, Jean-Marc Spaggiari <
jean-marc@spaggiari.org> wrote:
> Hi guys,
>
> In HBase 2.0.0-beta-1, getting this:
>
> 2018-02-23 14:01:55,499 WARN [main] client.HBaseAdmin
> (HBaseAdmin.java:visit(1948)) - No serialized HRegionInfo in
> keyvalues={page_proposed,,1384198043055.c15b13946fa4318a0a956e067d59eb
> d4./info:server/1384198854149/Put/vlen=11/seqid=0,
> page_proposed,,1384198043055.c15b13946fa4318a0a956e067d59eb
> d4./info:serverstartcode/1384198854149/Put/vlen=8/seqid=0}
>
>
> I'm not getting that on other versions. And I'm not sure what it means...
>
> Any idea?
>
> Thanks,
>
> JMS
>
Re: client.HBaseAdmin No serialized HRegionInfo
Posted by Jean-Marc Spaggiari <je...@spaggiari.org>.
To be 100% honest, I really like the admin throwing an error! It triggers
the attention.
I did a distscp from CDH 5.12 to a brand new HBase 2.0 cluster. I'm not
100% sure if I have the same issue on the source side.
Just ran HBCK on the source and I have the same issue. So at least it's
consistent. Just HBaseAdmin that is triggering this new message. I like it
;)
JMS
2018-02-23 15:11 GMT-05:00 Stack <st...@duboce.net>:
> On Fri, Feb 23, 2018 at 11:04 AM, Jean-Marc Spaggiari <
> jean-marc@spaggiari.org> wrote:
>
> > Hi guys,
> >
> > In HBase 2.0.0-beta-1, getting this:
> >
> > 2018-02-23 14:01:55,499 WARN [main] client.HBaseAdmin
> > (HBaseAdmin.java:visit(1948)) - No serialized HRegionInfo in
> > keyvalues={page_proposed,,1384198043055.c15b13946fa4318a0a956e067d59eb
> > d4./info:server/1384198854149/Put/vlen=11/seqid=0,
> > page_proposed,,1384198043055.c15b13946fa4318a0a956e067d59eb
> > d4./info:serverstartcode/1384198854149/Put/vlen=8/seqid=0}
> >
> >
> > I'm not getting that on other versions. And I'm not sure what it means...
> >
> > Any idea?
> >
> >
> The Admin client is getting detail from hbase:meta. It found a row where
> there was no serialized regioninfo and is WARNing you of this. This should
> never happen. It is dumping out all it did find in the meta table.
>
> Why no regioninfo in hbase:meta? This a fresh hbase2 or are you starting an
> hbase2 over an old hbase1 dataset? If latter, could it have been null
> before the update?
>
> Thanks,
> S
>
>
>
> > Thanks,
> >
> > JMS
> >
>
Re: client.HBaseAdmin No serialized HRegionInfo
Posted by Stack <st...@duboce.net>.
On Fri, Feb 23, 2018 at 11:04 AM, Jean-Marc Spaggiari <
jean-marc@spaggiari.org> wrote:
> Hi guys,
>
> In HBase 2.0.0-beta-1, getting this:
>
> 2018-02-23 14:01:55,499 WARN [main] client.HBaseAdmin
> (HBaseAdmin.java:visit(1948)) - No serialized HRegionInfo in
> keyvalues={page_proposed,,1384198043055.c15b13946fa4318a0a956e067d59eb
> d4./info:server/1384198854149/Put/vlen=11/seqid=0,
> page_proposed,,1384198043055.c15b13946fa4318a0a956e067d59eb
> d4./info:serverstartcode/1384198854149/Put/vlen=8/seqid=0}
>
>
> I'm not getting that on other versions. And I'm not sure what it means...
>
> Any idea?
>
>
The Admin client is getting detail from hbase:meta. It found a row where
there was no serialized regioninfo and is WARNing you of this. This should
never happen. It is dumping out all it did find in the meta table.
Why no regioninfo in hbase:meta? This a fresh hbase2 or are you starting an
hbase2 over an old hbase1 dataset? If latter, could it have been null
before the update?
Thanks,
S
> Thanks,
>
> JMS
>