You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by Jean-Marc Spaggiari <je...@spaggiari.org> on 2013/01/24 22:38:45 UTC

HRegionInfo was null or empty

Hi,

I'm getting this error (multiple corrurances) while running a MR which
is populating an empty table. MR is run against the 'entry' table
where I get each line and store the CRC into 'entry_crc' table.

2013-01-24 12:49:01,664 WARN
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation:
Encountered problems when prefetch META table:
java.io.IOException: HRegionInfo was null or empty in Meta for
entry_crc, row=entry_crc,\x00\x00\x00\x00\xBF\xB0\xE4>bluejacketsxtra.dispatch.com,99999999999999
	at org.apache.hadoop.hbase.client.MetaScanner.metaScan(MetaScanner.java:170)
	at org.apache.hadoop.hbase.client.MetaScanner.access$000(MetaScanner.java:54)
	at org.apache.hadoop.hbase.client.MetaScanner$1.connect(MetaScanner.java:133)
	at org.apache.hadoop.hbase.client.MetaScanner$1.connect(MetaScanner.java:130)
	at org.apache.hadoop.hbase.client.HConnectionManager.execute(HConnectionManager.java:365)
	at org.apache.hadoop.hbase.client.MetaScanner.metaScan(MetaScanner.java:130)
	at org.apache.hadoop.hbase.client.MetaScanner.metaScan(MetaScanner.java:105)
	at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.prefetchRegionCache(HConnectionManager.java:933)
	at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegionInMeta(HConnectionManager.java:988)
	at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:875)
	at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.relocateRegion(HConnectionManager.java:846)
	at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getRegionLocation(HConnectionManager.java:746)
	at org.apache.hadoop.hbase.client.ServerCallable.connect(ServerCallable.java:82)
	at org.apache.hadoop.hbase.client.ServerCallable.withRetries(ServerCallable.java:162)
	at org.apache.hadoop.hbase.client.HTable.checkAndPut(HTable.java:873)
	at org.spaggiari.mapreduce.GenerateCRC$GenerateCRCMapper.map(GenerateCRC.java:122)
	at org.spaggiari.mapreduce.GenerateCRC$GenerateCRCMapper.map(GenerateCRC.java:1)
	at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)
	at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)
	at org.apache.hadoop.mapred.Child.main(Child.java:249)

I'm wondering if this is normal or not. I saw it once, so I cleaned
the table and restarted the job, but I'm seeing it again. So it seems
it's reproductible. But it's also only a WARN. Not an error...

Show I simply ignore this? Or should I dig a bit?

JM

Re: HRegionInfo was null or empty

Posted by Jean-Marc Spaggiari <je...@spaggiari.org>.
Perfect, thanks. I will.

JM

2013/1/24, Ted Yu <yu...@gmail.com>:
> bq. Encountered problems when prefetch META table:
>
> You can ignore the warning.
>
> Cheers
>
> On Thu, Jan 24, 2013 at 1:38 PM, Jean-Marc Spaggiari <
> jean-marc@spaggiari.org> wrote:
>
>> Hi,
>>
>> I'm getting this error (multiple corrurances) while running a MR which
>> is populating an empty table. MR is run against the 'entry' table
>> where I get each line and store the CRC into 'entry_crc' table.
>>
>> 2013-01-24 12:49:01,664 WARN
>>
>> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation:
>> Encountered problems when prefetch META table:
>> java.io.IOException: HRegionInfo was null or empty in Meta for
>> entry_crc, row=entry_crc,\x00\x00\x00\x00\xBF\xB0\xE4>
>> bluejacketsxtra.dispatch.com,99999999999999
>>         at
>> org.apache.hadoop.hbase.client.MetaScanner.metaScan(MetaScanner.java:170)
>>         at
>> org.apache.hadoop.hbase.client.MetaScanner.access$000(MetaScanner.java:54)
>>         at
>> org.apache.hadoop.hbase.client.MetaScanner$1.connect(MetaScanner.java:133)
>>         at
>> org.apache.hadoop.hbase.client.MetaScanner$1.connect(MetaScanner.java:130)
>>         at
>> org.apache.hadoop.hbase.client.HConnectionManager.execute(HConnectionManager.java:365)
>>         at
>> org.apache.hadoop.hbase.client.MetaScanner.metaScan(MetaScanner.java:130)
>>         at
>> org.apache.hadoop.hbase.client.MetaScanner.metaScan(MetaScanner.java:105)
>>         at
>> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.prefetchRegionCache(HConnectionManager.java:933)
>>         at
>> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegionInMeta(HConnectionManager.java:988)
>>         at
>> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:875)
>>         at
>> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.relocateRegion(HConnectionManager.java:846)
>>         at
>> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getRegionLocation(HConnectionManager.java:746)
>>         at
>> org.apache.hadoop.hbase.client.ServerCallable.connect(ServerCallable.java:82)
>>         at
>> org.apache.hadoop.hbase.client.ServerCallable.withRetries(ServerCallable.java:162)
>>         at
>> org.apache.hadoop.hbase.client.HTable.checkAndPut(HTable.java:873)
>>         at
>> org.spaggiari.mapreduce.GenerateCRC$GenerateCRCMapper.map(GenerateCRC.java:122)
>>         at
>> org.spaggiari.mapreduce.GenerateCRC$GenerateCRCMapper.map(GenerateCRC.java:1)
>>         at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
>>         at
>> org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)
>>         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)
>>         at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
>>         at java.security.AccessController.doPrivileged(Native Method)
>>         at javax.security.auth.Subject.doAs(Subject.java:415)
>>         at
>> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)
>>         at org.apache.hadoop.mapred.Child.main(Child.java:249)
>>
>> I'm wondering if this is normal or not. I saw it once, so I cleaned
>> the table and restarted the job, but I'm seeing it again. So it seems
>> it's reproductible. But it's also only a WARN. Not an error...
>>
>> Show I simply ignore this? Or should I dig a bit?
>>
>> JM
>>
>

Re: HRegionInfo was null or empty

Posted by Ted Yu <yu...@gmail.com>.
bq. Encountered problems when prefetch META table:

You can ignore the warning.

Cheers

On Thu, Jan 24, 2013 at 1:38 PM, Jean-Marc Spaggiari <
jean-marc@spaggiari.org> wrote:

> Hi,
>
> I'm getting this error (multiple corrurances) while running a MR which
> is populating an empty table. MR is run against the 'entry' table
> where I get each line and store the CRC into 'entry_crc' table.
>
> 2013-01-24 12:49:01,664 WARN
>
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation:
> Encountered problems when prefetch META table:
> java.io.IOException: HRegionInfo was null or empty in Meta for
> entry_crc, row=entry_crc,\x00\x00\x00\x00\xBF\xB0\xE4>
> bluejacketsxtra.dispatch.com,99999999999999
>         at
> org.apache.hadoop.hbase.client.MetaScanner.metaScan(MetaScanner.java:170)
>         at
> org.apache.hadoop.hbase.client.MetaScanner.access$000(MetaScanner.java:54)
>         at
> org.apache.hadoop.hbase.client.MetaScanner$1.connect(MetaScanner.java:133)
>         at
> org.apache.hadoop.hbase.client.MetaScanner$1.connect(MetaScanner.java:130)
>         at
> org.apache.hadoop.hbase.client.HConnectionManager.execute(HConnectionManager.java:365)
>         at
> org.apache.hadoop.hbase.client.MetaScanner.metaScan(MetaScanner.java:130)
>         at
> org.apache.hadoop.hbase.client.MetaScanner.metaScan(MetaScanner.java:105)
>         at
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.prefetchRegionCache(HConnectionManager.java:933)
>         at
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegionInMeta(HConnectionManager.java:988)
>         at
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:875)
>         at
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.relocateRegion(HConnectionManager.java:846)
>         at
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getRegionLocation(HConnectionManager.java:746)
>         at
> org.apache.hadoop.hbase.client.ServerCallable.connect(ServerCallable.java:82)
>         at
> org.apache.hadoop.hbase.client.ServerCallable.withRetries(ServerCallable.java:162)
>         at
> org.apache.hadoop.hbase.client.HTable.checkAndPut(HTable.java:873)
>         at
> org.spaggiari.mapreduce.GenerateCRC$GenerateCRCMapper.map(GenerateCRC.java:122)
>         at
> org.spaggiari.mapreduce.GenerateCRC$GenerateCRCMapper.map(GenerateCRC.java:1)
>         at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
>         at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)
>         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)
>         at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at javax.security.auth.Subject.doAs(Subject.java:415)
>         at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)
>         at org.apache.hadoop.mapred.Child.main(Child.java:249)
>
> I'm wondering if this is normal or not. I saw it once, so I cleaned
> the table and restarted the job, but I'm seeing it again. So it seems
> it's reproductible. But it's also only a WARN. Not an error...
>
> Show I simply ignore this? Or should I dig a bit?
>
> JM
>