You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by sriram <vs...@gmail.com> on 2014/04/04 01:24:00 UTC
Skip unresponsive regions in scan
Hi,
Is it possible to skip unresponsive regions in hbase table export import? I
am trying to migrate my table from hbase 0.90.5 to hbase 0.94.6. For that I
am using hbase export tool. As it internally spins up a Map reduce program
for this, it fails when few regions are not responding back.
Is it possible to save the partial data and skip the unresponsive regions
and do the import of the partial data? I have tried giving timestamp range
as well. Still facing same problem.
I am getting exceptions as mentioned in
https://issues.apache.org/jira/browse/HBASE-5322
Thanks,
Sriram
Exception Trace:
----------------
org.apache.hadoop.hbase.client.RetriesExhaustedException: Trying to contact
region server
machine :60020 for region
table,6a9c37173adefa7f,1374790424571.c4713d144d1fa6bdfc937b570ebc14e2., row
'6a9c37173adefa7f', but failed after 10 attempts.
Exceptions:
java.io.IOException: java.io.IOException: Could not seek
StoreFileScanner[HFileScanner for reader
reader=hdfs://machine/hbase/table/c4713d144d1fa6bdfc937b570ebc14e2/column/4884593935967971789,
compression=lzo, inMemory=false,
firstKey=6a9c37173adefa7f/qa:INDEX_TIME/1325912843301/Put,
lastKey=6a9d1c2ef3b5dc3e/qa:QA_COUNT/1381345482919/Put, avgKeyLen=36,
avgValueLen=291, entries=12052, length=2516134, cur=null]
at
org.apache.hadoop.hbase.regionserver.StoreFileScanner.seek(StoreFileScanner.java:104)
at org.apache.hadoop.hbase.regionserver.StoreScanner.(StoreScanner.java:77)
at org.apache.hadoop.hbase.regionserver.Store.getScanner(Store.java:1398)
at
org.apache.hadoop.hbase.regionserver.HRegion$RegionScanner.(HRegion.java:2388)
at
org.apache.hadoop.hbase.regionserver.HRegion.instantiateInternalScanner(HRegion.java:1136)
at
org.apache.hadoop.hbase.regionserver.HRegion.getScanner(HRegion.java:1128)
at
org.apache.hadoop.hbase.regionserver.HRegion.getScanner(HRegion.java:1112)
at
org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1811)
at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:570)
at
org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1039)
Caused by: java.io.IOException: Premeture EOF from inputStream
at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:104)
at
org.apache.hadoop.hbase.io.hfile.HFile$Reader.decompress(HFile.java:1094)
at org.apache.hadoop.hbase.io.hfile.HFile$Reader.readBlock(HFile.java:1036)
at
org.apache.hadoop.hbase.io.hfile.HFile$Reader$Scanner.seekTo(HFile.java:1433)
at
org.apache.hadoop.hbase.regionserver.StoreFileScanner.seekAtOrAfter(StoreFileScanner.java:139)
at
org.apache.hadoop.hbase.regionserver.StoreFileScanner.seek(StoreFileScanner.java:96)
... 12 more
java.io.IOException: java.io.IOException: Could not seek
StoreFileScanner[HFileScanner for reader
reader=hdfs://machine/hbase/table/c4713d144d1fa6bdfc937b570ebc14e2/column/4884593935967971789,
compression=lzo, inMemory=false,
firstKey=6a9c37173adefa7f/qa:INDEX_TIME/1325912843301/Put,
lastKey=6a9d1c2ef3b5dc3e/qa:QA_COUNT/1381345482919/Put, avgKeyLen=36,
avgValueLen=291, entries=12052, length=2516134, cur=null]
at
org.apache.hadoop.hbase.regionserver.StoreFileScanner.seek(StoreFileScanner.java:104)
at org.apache.hadoop.hbase.regionserver.StoreScanner.(StoreScanner.java:77)
at org.apache.hadoop.hbase.regionserver.Store.getScanner(Store.java:1398)
at
org.apache.hadoop.hbase.regionserver.HRegion$RegionScanner.(HRegion.java:2388)
at
org.apache.hadoop.hbase.regionserver.HRegion.instantiateInternalScanner(HRegion.java:1136)
at
org.apache.hadoop.hbase.regionserver.HRegion.getScanner(HRegion.java:1128)
at
org.apache.hadoop.hbase.regionserver.HRegion.getScanner(HRegion.java:1112)
at
org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1811)
at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:570)
at
org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1039)
Caused by: java.io.IOException: Premeture EOF from inputStream
at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:104)
at
org.apache.hadoop.hbase.io.hfile.HFile$Reader.decompress(HFile.java:1094)
at org.apache.hadoop.hbase.io.hfile.HFile$Reader.readBlock(HFile.java:1036)
at
org.apache.hadoop.hbase.io.hfile.HFile$Reader$Scanner.seekTo(HFile.java:1433)
at
org.apache.hadoop.hbase.regionserver.StoreFileScanner.seekAtOrAfter(StoreFileScanner.java:139)
at
org.apache.hadoop.hbase.regionserver.StoreFileScanner.seek(StoreFileScanner.java:96)
... 12 more
--
View this message in context: http://apache-hbase.679495.n3.nabble.com/Skip-unresponsive-regions-in-scan-tp4057843.html
Sent from the HBase User mailing list archive at Nabble.com.
Re: Skip unresponsive regions in scan
Posted by sriram <vs...@gmail.com>.
Hi Ted,
Thanks for your reply. I ran the check and it is not showing any problems.
>From the error, I feel it looks more like region server issue. Any inputs?
Thanks,
V.Sriram
--
View this message in context: http://apache-hbase.679495.n3.nabble.com/Skip-unresponsive-regions-in-scan-tp4057843p4057860.html
Sent from the HBase User mailing list archive at Nabble.com.
Re: Skip unresponsive regions in scan
Posted by Ted Yu <yu...@gmail.com>.
bq. reader=hdfs://machine/hbase/table/c4713d144d1fa6bdfc937b570ebc14
e2/column/4884593935967971789,
Can you use HFile tool to check whether there is data corruption in the
file ?
Cheers
On Thu, Apr 3, 2014 at 4:24 PM, sriram <vs...@gmail.com> wrote:
> Hi,
>
> Is it possible to skip unresponsive regions in hbase table export import? I
> am trying to migrate my table from hbase 0.90.5 to hbase 0.94.6. For that I
> am using hbase export tool. As it internally spins up a Map reduce program
> for this, it fails when few regions are not responding back.
>
> Is it possible to save the partial data and skip the unresponsive regions
> and do the import of the partial data? I have tried giving timestamp range
> as well. Still facing same problem.
>
> I am getting exceptions as mentioned in
> https://issues.apache.org/jira/browse/HBASE-5322
>
> Thanks,
> Sriram
>
> Exception Trace:
> ----------------
> org.apache.hadoop.hbase.client.RetriesExhaustedException: Trying to contact
> region server
> machine :60020 for region
> table,6a9c37173adefa7f,1374790424571.c4713d144d1fa6bdfc937b570ebc14e2., row
> '6a9c37173adefa7f', but failed after 10 attempts.
> Exceptions:
> java.io.IOException: java.io.IOException: Could not seek
> StoreFileScanner[HFileScanner for reader
>
> reader=hdfs://machine/hbase/table/c4713d144d1fa6bdfc937b570ebc14e2/column/4884593935967971789,
> compression=lzo, inMemory=false,
> firstKey=6a9c37173adefa7f/qa:INDEX_TIME/1325912843301/Put,
> lastKey=6a9d1c2ef3b5dc3e/qa:QA_COUNT/1381345482919/Put, avgKeyLen=36,
> avgValueLen=291, entries=12052, length=2516134, cur=null]
> at
>
> org.apache.hadoop.hbase.regionserver.StoreFileScanner.seek(StoreFileScanner.java:104)
> at
> org.apache.hadoop.hbase.regionserver.StoreScanner.(StoreScanner.java:77)
> at
> org.apache.hadoop.hbase.regionserver.Store.getScanner(Store.java:1398)
> at
>
> org.apache.hadoop.hbase.regionserver.HRegion$RegionScanner.(HRegion.java:2388)
> at
>
> org.apache.hadoop.hbase.regionserver.HRegion.instantiateInternalScanner(HRegion.java:1136)
> at
> org.apache.hadoop.hbase.regionserver.HRegion.getScanner(HRegion.java:1128)
> at
> org.apache.hadoop.hbase.regionserver.HRegion.getScanner(HRegion.java:1112)
> at
>
> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1811)
> at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source)
> at
>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at
> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:570)
> at
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1039)
> Caused by: java.io.IOException: Premeture EOF from inputStream
> at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:104)
> at
> org.apache.hadoop.hbase.io.hfile.HFile$Reader.decompress(HFile.java:1094)
> at
> org.apache.hadoop.hbase.io.hfile.HFile$Reader.readBlock(HFile.java:1036)
> at
>
> org.apache.hadoop.hbase.io.hfile.HFile$Reader$Scanner.seekTo(HFile.java:1433)
> at
>
> org.apache.hadoop.hbase.regionserver.StoreFileScanner.seekAtOrAfter(StoreFileScanner.java:139)
> at
>
> org.apache.hadoop.hbase.regionserver.StoreFileScanner.seek(StoreFileScanner.java:96)
> ... 12 more
>
> java.io.IOException: java.io.IOException: Could not seek
> StoreFileScanner[HFileScanner for reader
>
> reader=hdfs://machine/hbase/table/c4713d144d1fa6bdfc937b570ebc14e2/column/4884593935967971789,
> compression=lzo, inMemory=false,
> firstKey=6a9c37173adefa7f/qa:INDEX_TIME/1325912843301/Put,
> lastKey=6a9d1c2ef3b5dc3e/qa:QA_COUNT/1381345482919/Put, avgKeyLen=36,
> avgValueLen=291, entries=12052, length=2516134, cur=null]
> at
>
> org.apache.hadoop.hbase.regionserver.StoreFileScanner.seek(StoreFileScanner.java:104)
> at
> org.apache.hadoop.hbase.regionserver.StoreScanner.(StoreScanner.java:77)
> at
> org.apache.hadoop.hbase.regionserver.Store.getScanner(Store.java:1398)
> at
>
> org.apache.hadoop.hbase.regionserver.HRegion$RegionScanner.(HRegion.java:2388)
> at
>
> org.apache.hadoop.hbase.regionserver.HRegion.instantiateInternalScanner(HRegion.java:1136)
> at
> org.apache.hadoop.hbase.regionserver.HRegion.getScanner(HRegion.java:1128)
> at
> org.apache.hadoop.hbase.regionserver.HRegion.getScanner(HRegion.java:1112)
> at
>
> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1811)
> at sun.reflect.GeneratedMethodAccessor12.invoke(Unknown Source)
> at
>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at
> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:570)
> at
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1039)
> Caused by: java.io.IOException: Premeture EOF from inputStream
> at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:104)
> at
> org.apache.hadoop.hbase.io.hfile.HFile$Reader.decompress(HFile.java:1094)
> at
> org.apache.hadoop.hbase.io.hfile.HFile$Reader.readBlock(HFile.java:1036)
> at
>
> org.apache.hadoop.hbase.io.hfile.HFile$Reader$Scanner.seekTo(HFile.java:1433)
> at
>
> org.apache.hadoop.hbase.regionserver.StoreFileScanner.seekAtOrAfter(StoreFileScanner.java:139)
> at
>
> org.apache.hadoop.hbase.regionserver.StoreFileScanner.seek(StoreFileScanner.java:96)
> ... 12 more
>
>
>
> --
> View this message in context:
> http://apache-hbase.679495.n3.nabble.com/Skip-unresponsive-regions-in-scan-tp4057843.html
> Sent from the HBase User mailing list archive at Nabble.com.
>