You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by tamil <th...@gmail.com> on 2013/01/02 11:25:01 UTC

Issue on hbase table import to hdfs

Hi,

When I tried to import the hbase table to hdfs using MR code, it ended with
below error.
I am using hbase-0.92.2 and hadoop-0.20.2.
In my code, I used TableMapper<ImmutableBytesWritable, Result> mapper to
read the data.
Any fix/suggestion for this issue would be appreciated.

Job log:
13/01/02 09:24:42 INFO mapred.JobClient: Running job: job_201212311508_13510
13/01/02 09:24:43 INFO mapred.JobClient:  map 0% reduce 0%
13/01/02 09:25:49 INFO mapred.JobClient:  map 9% reduce 0%
13/01/02 09:26:03 INFO mapred.JobClient:  map 18% reduce 0%
13/01/02 09:26:09 INFO mapred.JobClient:  map 27% reduce 0%
13/01/02 09:26:20 INFO mapred.JobClient:  map 36% reduce 0%
13/01/02 09:26:39 INFO mapred.JobClient:  map 45% reduce 0%
13/01/02 09:26:49 INFO mapred.JobClient:  map 54% reduce 0%
13/01/02 09:26:57 INFO mapred.JobClient: Task Id :
attempt_201212311508_13510_m_000006_0, Status : FAILED on node
hst-gti-grid080.scur.colo
org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed after
attempts=10, exceptions:
Wed Jan 02 09:26:14 UTC 2013,
org.apache.hadoop.hbase.client.ScannerCallable@4bc348d3,
java.io.IOException: java.io.IOException:
java.lang.StringIndexOutOfBoundsException: String index out of range: -12
        at
org.apache.hadoop.hbase.regionserver.HRegionServer.convertThrowableToIOE(HRegionServer.java:1083)
        at
org.apache.hadoop.hbase.regionserver.HRegionServer.convertThrowableToIOE(HRegionServer.java:1072)
        at
org.apache.hadoop.hbase.regionserver.HRegionServer.next(HRegionServer.java:2189)
        at sun.reflect.GeneratedMethodAccessor96.invoke(Unknown Source)
        at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at
org.apache.hadoop.hbase.ipc.WritableRpcEngine$Server.call(WritableRpcEngine.java:364)
        at
org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1336)
Caused by: java.lang.StringIndexOutOfBoundsException: String index out of
range: -12
        at java.lang.String.checkBounds(String.java:397)
        at java.lang.String.<init>(String.java:442)
        at org.apache.hadoop.hbase.util.Bytes.toStringBinary(Bytes.java:342)
        at org.apache.hadoop.hbase.KeyValue.keyToString(KeyValue.java:655)
        at org.apache.hadoop.hbase.KeyValue.toString(KeyValue.java:609)
        at java.lang.String.valueOf(String.java:2826)
        at java.lang.StringBuilder.append(StringBuilder.java:115)
        at
org.apache.hadoop.hbase.regionserver.StoreScanner.next(StoreScanner.java:266)
        at
org.apache.hadoop.hbase.regionserver.KeyValueHeap.next(KeyValueHeap.java:138)
        at
org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextInternal(HRegion.java:3025)
        at
org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.next(HRegion.java:2972)
        at
org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.next(HRegion.java:2989)
        at
org.apache.hadoop.hbase.regionserver.HRegionServer.next(HRegionServer.java:2162)

Wed Jan 02 09:26:15 UTC 2013,
org.apache.hadoop.hbase.client.ScannerCallable@4bc348d3,
java.io.IOException: java.io.IOException:
java.lang.IllegalArgumentException: offset (66510) + length (2) exceed the
capacity of the array: 66511
        at
org.apache.hadoop.hbase.regionserver.HRegionServer.convertThrowableToIOE(HRegionServer.java:1083)
        at
org.apache.hadoop.hbase.regionserver.HRegionServer.convertThrowableToIOE(HRegionServer.java:1072)
        at
org.apache.hadoop.hbase.regionserver.HRegionServer.next(HRegionServer.java:2189)
        at sun.reflect.GeneratedMethodAccessor96.invoke(Unknown Source)
        at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at
org.apache.hadoop.hbase.ipc.WritableRpcEngine$Server.call(WritableRpcEngine.java:364)
        at
org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1336)



--
View this message in context: http://apache-hbase.679495.n3.nabble.com/Issue-on-hbase-table-import-to-hdfs-tp4035986.html
Sent from the HBase User mailing list archive at Nabble.com.

Re: Issue on hbase table import to hdfs

Posted by Mohammad Tariq <do...@gmail.com>.
Hello there,

        As you can see from the trace, you are trying to use '-12' as a
valid index for the string, which is wrong. I have the same question as Ram
sir. Also, could you please show us the code you have written?

Best Regards,
Tariq
+91-9741563634
https://mtariq.jux.com/


On Wed, Jan 2, 2013 at 10:06 PM, ramkrishna vasudevan <
ramkrishna.s.vasudevan@gmail.com> wrote:

> What type of data you are trying to import?
>
> On Wed, Jan 2, 2013 at 3:55 PM, tamil <th...@gmail.com> wrote:
>
> > Hi,
> >
> > When I tried to import the hbase table to hdfs using MR code, it ended
> with
> > below error.
> > I am using hbase-0.92.2 and hadoop-0.20.2.
> > In my code, I used TableMapper<ImmutableBytesWritable, Result> mapper to
> > read the data.
> > Any fix/suggestion for this issue would be appreciated.
> >
> > Job log:
> > 13/01/02 09:24:42 INFO mapred.JobClient: Running job:
> > job_201212311508_13510
> > 13/01/02 09:24:43 INFO mapred.JobClient:  map 0% reduce 0%
> > 13/01/02 09:25:49 INFO mapred.JobClient:  map 9% reduce 0%
> > 13/01/02 09:26:03 INFO mapred.JobClient:  map 18% reduce 0%
> > 13/01/02 09:26:09 INFO mapred.JobClient:  map 27% reduce 0%
> > 13/01/02 09:26:20 INFO mapred.JobClient:  map 36% reduce 0%
> > 13/01/02 09:26:39 INFO mapred.JobClient:  map 45% reduce 0%
> > 13/01/02 09:26:49 INFO mapred.JobClient:  map 54% reduce 0%
> > 13/01/02 09:26:57 INFO mapred.JobClient: Task Id :
> > attempt_201212311508_13510_m_000006_0, Status : FAILED on node
> > hst-gti-grid080.scur.colo
> > org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed after
> > attempts=10, exceptions:
> > Wed Jan 02 09:26:14 UTC 2013,
> > org.apache.hadoop.hbase.client.ScannerCallable@4bc348d3,
> > java.io.IOException: java.io.IOException:
> > java.lang.StringIndexOutOfBoundsException: String index out of range: -12
> >         at
> >
> >
> org.apache.hadoop.hbase.regionserver.HRegionServer.convertThrowableToIOE(HRegionServer.java:1083)
> >         at
> >
> >
> org.apache.hadoop.hbase.regionserver.HRegionServer.convertThrowableToIOE(HRegionServer.java:1072)
> >         at
> >
> >
> org.apache.hadoop.hbase.regionserver.HRegionServer.next(HRegionServer.java:2189)
> >         at sun.reflect.GeneratedMethodAccessor96.invoke(Unknown Source)
> >         at
> >
> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> >         at java.lang.reflect.Method.invoke(Method.java:597)
> >         at
> >
> >
> org.apache.hadoop.hbase.ipc.WritableRpcEngine$Server.call(WritableRpcEngine.java:364)
> >         at
> >
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1336)
> > Caused by: java.lang.StringIndexOutOfBoundsException: String index out of
> > range: -12
> >         at java.lang.String.checkBounds(String.java:397)
> >         at java.lang.String.<init>(String.java:442)
> >         at
> > org.apache.hadoop.hbase.util.Bytes.toStringBinary(Bytes.java:342)
> >         at
> org.apache.hadoop.hbase.KeyValue.keyToString(KeyValue.java:655)
> >         at org.apache.hadoop.hbase.KeyValue.toString(KeyValue.java:609)
> >         at java.lang.String.valueOf(String.java:2826)
> >         at java.lang.StringBuilder.append(StringBuilder.java:115)
> >         at
> >
> >
> org.apache.hadoop.hbase.regionserver.StoreScanner.next(StoreScanner.java:266)
> >         at
> >
> >
> org.apache.hadoop.hbase.regionserver.KeyValueHeap.next(KeyValueHeap.java:138)
> >         at
> >
> >
> org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextInternal(HRegion.java:3025)
> >         at
> >
> >
> org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.next(HRegion.java:2972)
> >         at
> >
> >
> org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.next(HRegion.java:2989)
> >         at
> >
> >
> org.apache.hadoop.hbase.regionserver.HRegionServer.next(HRegionServer.java:2162)
> >
> > Wed Jan 02 09:26:15 UTC 2013,
> > org.apache.hadoop.hbase.client.ScannerCallable@4bc348d3,
> > java.io.IOException: java.io.IOException:
> > java.lang.IllegalArgumentException: offset (66510) + length (2) exceed
> the
> > capacity of the array: 66511
> >         at
> >
> >
> org.apache.hadoop.hbase.regionserver.HRegionServer.convertThrowableToIOE(HRegionServer.java:1083)
> >         at
> >
> >
> org.apache.hadoop.hbase.regionserver.HRegionServer.convertThrowableToIOE(HRegionServer.java:1072)
> >         at
> >
> >
> org.apache.hadoop.hbase.regionserver.HRegionServer.next(HRegionServer.java:2189)
> >         at sun.reflect.GeneratedMethodAccessor96.invoke(Unknown Source)
> >         at
> >
> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> >         at java.lang.reflect.Method.invoke(Method.java:597)
> >         at
> >
> >
> org.apache.hadoop.hbase.ipc.WritableRpcEngine$Server.call(WritableRpcEngine.java:364)
> >         at
> >
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1336)
> >
> >
> >
> > --
> > View this message in context:
> >
> http://apache-hbase.679495.n3.nabble.com/Issue-on-hbase-table-import-to-hdfs-tp4035986.html
> > Sent from the HBase User mailing list archive at Nabble.com.
> >
>

Re: Issue on hbase table import to hdfs

Posted by ramkrishna vasudevan <ra...@gmail.com>.
What type of data you are trying to import?

On Wed, Jan 2, 2013 at 3:55 PM, tamil <th...@gmail.com> wrote:

> Hi,
>
> When I tried to import the hbase table to hdfs using MR code, it ended with
> below error.
> I am using hbase-0.92.2 and hadoop-0.20.2.
> In my code, I used TableMapper<ImmutableBytesWritable, Result> mapper to
> read the data.
> Any fix/suggestion for this issue would be appreciated.
>
> Job log:
> 13/01/02 09:24:42 INFO mapred.JobClient: Running job:
> job_201212311508_13510
> 13/01/02 09:24:43 INFO mapred.JobClient:  map 0% reduce 0%
> 13/01/02 09:25:49 INFO mapred.JobClient:  map 9% reduce 0%
> 13/01/02 09:26:03 INFO mapred.JobClient:  map 18% reduce 0%
> 13/01/02 09:26:09 INFO mapred.JobClient:  map 27% reduce 0%
> 13/01/02 09:26:20 INFO mapred.JobClient:  map 36% reduce 0%
> 13/01/02 09:26:39 INFO mapred.JobClient:  map 45% reduce 0%
> 13/01/02 09:26:49 INFO mapred.JobClient:  map 54% reduce 0%
> 13/01/02 09:26:57 INFO mapred.JobClient: Task Id :
> attempt_201212311508_13510_m_000006_0, Status : FAILED on node
> hst-gti-grid080.scur.colo
> org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed after
> attempts=10, exceptions:
> Wed Jan 02 09:26:14 UTC 2013,
> org.apache.hadoop.hbase.client.ScannerCallable@4bc348d3,
> java.io.IOException: java.io.IOException:
> java.lang.StringIndexOutOfBoundsException: String index out of range: -12
>         at
>
> org.apache.hadoop.hbase.regionserver.HRegionServer.convertThrowableToIOE(HRegionServer.java:1083)
>         at
>
> org.apache.hadoop.hbase.regionserver.HRegionServer.convertThrowableToIOE(HRegionServer.java:1072)
>         at
>
> org.apache.hadoop.hbase.regionserver.HRegionServer.next(HRegionServer.java:2189)
>         at sun.reflect.GeneratedMethodAccessor96.invoke(Unknown Source)
>         at
>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>         at java.lang.reflect.Method.invoke(Method.java:597)
>         at
>
> org.apache.hadoop.hbase.ipc.WritableRpcEngine$Server.call(WritableRpcEngine.java:364)
>         at
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1336)
> Caused by: java.lang.StringIndexOutOfBoundsException: String index out of
> range: -12
>         at java.lang.String.checkBounds(String.java:397)
>         at java.lang.String.<init>(String.java:442)
>         at
> org.apache.hadoop.hbase.util.Bytes.toStringBinary(Bytes.java:342)
>         at org.apache.hadoop.hbase.KeyValue.keyToString(KeyValue.java:655)
>         at org.apache.hadoop.hbase.KeyValue.toString(KeyValue.java:609)
>         at java.lang.String.valueOf(String.java:2826)
>         at java.lang.StringBuilder.append(StringBuilder.java:115)
>         at
>
> org.apache.hadoop.hbase.regionserver.StoreScanner.next(StoreScanner.java:266)
>         at
>
> org.apache.hadoop.hbase.regionserver.KeyValueHeap.next(KeyValueHeap.java:138)
>         at
>
> org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextInternal(HRegion.java:3025)
>         at
>
> org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.next(HRegion.java:2972)
>         at
>
> org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.next(HRegion.java:2989)
>         at
>
> org.apache.hadoop.hbase.regionserver.HRegionServer.next(HRegionServer.java:2162)
>
> Wed Jan 02 09:26:15 UTC 2013,
> org.apache.hadoop.hbase.client.ScannerCallable@4bc348d3,
> java.io.IOException: java.io.IOException:
> java.lang.IllegalArgumentException: offset (66510) + length (2) exceed the
> capacity of the array: 66511
>         at
>
> org.apache.hadoop.hbase.regionserver.HRegionServer.convertThrowableToIOE(HRegionServer.java:1083)
>         at
>
> org.apache.hadoop.hbase.regionserver.HRegionServer.convertThrowableToIOE(HRegionServer.java:1072)
>         at
>
> org.apache.hadoop.hbase.regionserver.HRegionServer.next(HRegionServer.java:2189)
>         at sun.reflect.GeneratedMethodAccessor96.invoke(Unknown Source)
>         at
>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>         at java.lang.reflect.Method.invoke(Method.java:597)
>         at
>
> org.apache.hadoop.hbase.ipc.WritableRpcEngine$Server.call(WritableRpcEngine.java:364)
>         at
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1336)
>
>
>
> --
> View this message in context:
> http://apache-hbase.679495.n3.nabble.com/Issue-on-hbase-table-import-to-hdfs-tp4035986.html
> Sent from the HBase User mailing list archive at Nabble.com.
>