You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by Julian Wissmann <ju...@sdace.de> on 2012/08/13 20:57:13 UTC

Coprocessor NPE

Hi,

I'm pretty new to hbase and currently evaluate it for use in a project I'm
working on.
I use hbase from Cloudera CDH4, which is 0.92.1.

I'm trying to calculate an average via a coprocessor with this code:

            Scan scan = new Scan((metricID + "," +
basetime_begin).getBytes(), (metricID + "," + basetime_end).getBytes());
    scan.addFamily(family.getBytes());
    AggregationClient ag = new AggregationClient(config);
    long rowCount = ag.rowCount(Bytes.toBytes(tableName), null, scan);
    System.out.println("row count is " + rowCount);

When I do, I get the following error:

12/08/13 20:52:39 WARN client.HConnectionManager$HConnectionImplementation:
Error executing for row sensor.77.atom,946681200000

java.util.concurrent.ExecutionException:
org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed after
attempts=10, exceptions:

Mon Aug 13 20:51:59 CEST 2012,
org.apache.hadoop.hbase.ipc.ExecRPCInvoker$1@4f2b6c89, java.io.IOException:
java.io.IOException: java.lang.NullPointerException

Mon Aug 13 20:52:00 CEST 2012,
org.apache.hadoop.hbase.ipc.ExecRPCInvoker$1@4f2b6c89, java.io.IOException:
java.io.IOException: java.lang.NullPointerException

Mon Aug 13 20:52:01 CEST 2012,
org.apache.hadoop.hbase.ipc.ExecRPCInvoker$1@4f2b6c89, java.io.IOException:
java.io.IOException: java.lang.NullPointerException

Mon Aug 13 20:52:02 CEST 2012,
org.apache.hadoop.hbase.ipc.ExecRPCInvoker$1@4f2b6c89, java.io.IOException:
java.io.IOException: java.lang.NullPointerException

Mon Aug 13 20:52:04 CEST 2012,
org.apache.hadoop.hbase.ipc.ExecRPCInvoker$1@4f2b6c89, java.io.IOException:
java.io.IOException: java.lang.NullPointerException

Mon Aug 13 20:52:06 CEST 2012,
org.apache.hadoop.hbase.ipc.ExecRPCInvoker$1@4f2b6c89, java.io.IOException:
java.io.IOException: java.lang.NullPointerException

Mon Aug 13 20:52:10 CEST 2012,
org.apache.hadoop.hbase.ipc.ExecRPCInvoker$1@4f2b6c89, java.io.IOException:
java.io.IOException: java.lang.NullPointerException

Mon Aug 13 20:52:14 CEST 2012,
org.apache.hadoop.hbase.ipc.ExecRPCInvoker$1@4f2b6c89, java.io.IOException:
java.io.IOException: java.lang.NullPointerException

Mon Aug 13 20:52:23 CEST 2012,
org.apache.hadoop.hbase.ipc.ExecRPCInvoker$1@4f2b6c89, java.io.IOException:
java.io.IOException: java.lang.NullPointerException

Mon Aug 13 20:52:39 CEST 2012,
org.apache.hadoop.hbase.ipc.ExecRPCInvoker$1@4f2b6c89, java.io.IOException:
java.io.IOException: java.lang.NullPointerException


        at
java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:222)
        at java.util.concurrent.FutureTask.get(FutureTask.java:83)

        at
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.processExecs(HConnectionManager.java:1434)

        at
org.apache.hadoop.hbase.client.HTable.coprocessorExec(HTable.java:1263)

        at
org.apache.hadoop.hbase.client.coprocessor.AggregationClient.getAvgArgs(AggregationClient.java:303)


        at
org.apache.hadoop.hbase.client.coprocessor.AggregationClient.avg(AggregationClient.java:334)


        at helpers.HbaseReaderv2.getWeekAvg(HbaseReaderv2.java:156)

        at helpers.HbaseReaderv2.main(HbaseReaderv2.java:47)

Caused by: org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed
after attempts=10, exceptions:

Mon Aug 13 20:51:59 CEST 2012,
org.apache.hadoop.hbase.ipc.ExecRPCInvoker$1@4f2b6c89, java.io.IOException:
java.io.IOException: java.lang.NullPointerException

Mon Aug 13 20:52:00 CEST 2012,
org.apache.hadoop.hbase.ipc.ExecRPCInvoker$1@4f2b6c89, java.io.IOException:
java.io.IOException: java.lang.NullPointerException
Mon Aug 13 20:52:01 CEST 2012,
org.apache.hadoop.hbase.ipc.ExecRPCInvoker$1@4f2b6c89, java.io.IOException:
java.io.IOException: java.lang.NullPointerException
Mon Aug 13 20:52:02 CEST 2012,
org.apache.hadoop.hbase.ipc.ExecRPCInvoker$1@4f2b6c89, java.io.IOException:
java.io.IOException: java.lang.NullPointerException
Mon Aug 13 20:52:04 CEST 2012,
org.apache.hadoop.hbase.ipc.ExecRPCInvoker$1@4f2b6c89, java.io.IOException:
java.io.IOException: java.lang.NullPointerException
Mon Aug 13 20:52:06 CEST 2012,
org.apache.hadoop.hbase.ipc.ExecRPCInvoker$1@4f2b6c89, java.io.IOException:
java.io.IOException: java.lang.NullPointerException
Mon Aug 13 20:52:10 CEST 2012,
org.apache.hadoop.hbase.ipc.ExecRPCInvoker$1@4f2b6c89, java.io.IOException:
java.io.IOException: java.lang.NullPointerException
Mon Aug 13 20:52:14 CEST 2012,
org.apache.hadoop.hbase.ipc.ExecRPCInvoker$1@4f2b6c89, java.io.IOException:
java.io.IOException: java.lang.NullPointerException
Mon Aug 13 20:52:23 CEST 2012,
org.apache.hadoop.hbase.ipc.ExecRPCInvoker$1@4f2b6c89, java.io.IOException:
java.io.IOException: java.lang.NullPointerException
Mon Aug 13 20:52:39 CEST 2012,
org.apache.hadoop.hbase.ipc.ExecRPCInvoker$1@4f2b6c89, java.io.IOException:
java.io.IOException: java.lang.NullPointerException

        at
org.apache.hadoop.hbase.client.ServerCallable.withRetries(ServerCallable.java:183)
        at
org.apache.hadoop.hbase.ipc.ExecRPCInvoker.invoke(ExecRPCInvoker.java:79)
        at $Proxy7.getAvg(Unknown Source)
        at
org.apache.hadoop.hbase.client.coprocessor.AggregationClient$5.call(AggregationClient.java:309)
        at
org.apache.hadoop.hbase.client.coprocessor.AggregationClient$5.call(AggregationClient.java:305)
        at
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation$4.call(HConnectionManager.java:1422)
        at
java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
        at java.util.concurrent.FutureTask.run(FutureTask.java:138)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
        at java.lang.Thread.run(Thread.java:662)

In the regionserver log, I get the following output ten times:

2012-08-13 20:51:59,779 ERROR
org.apache.hadoop.hbase.regionserver.HRegionServer:
java.io.IOException: java.lang.NullPointerException
        at
org.apache.hadoop.hbase.coprocessor.AggregateImplementation.getAvg(AggregateImplementation.java:188)
        at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source)
        at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at
org.apache.hadoop.hbase.regionserver.HRegion.exec(HRegion.java:4119)
        at
org.apache.hadoop.hbase.regionserver.HRegionServer.execCoprocessor(HRegionServer.java:3159)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at
org.apache.hadoop.hbase.ipc.WritableRpcEngine$Server.call(WritableRpcEngine.java:364)
        at
org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1336)


Am I doing something wrong, here or is this actually a bug in hbase, that
is causing this to go wrong.

Regards,

Julian

Re: Coprocessor NPE

Posted by Ted Yu <yu...@gmail.com>.
Maybe related to https://issues.apache.org/jira/browse/HBASE-5821 which
would be in 0.92.3

Cheers

On Wed, Aug 15, 2012 at 3:23 PM, Stack <st...@duboce.net> wrote:

> On Mon, Aug 13, 2012 at 11:57 AM, Julian Wissmann
> <ju...@sdace.de> wrote:
> > In the regionserver log, I get the following output ten times:
> >
> > 2012-08-13 20:51:59,779 ERROR
> > org.apache.hadoop.hbase.regionserver.HRegionServer:
> > java.io.IOException: java.lang.NullPointerException
> >         at
> >
> org.apache.hadoop.hbase.coprocessor.AggregateImplementation.getAvg(AggregateImplementation.java:188)
> >         at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source)
> >         at
>
> ...
>
> > Am I doing something wrong, here or is this actually a bug in hbase, that
> > is causing this to go wrong.
> >
>
> Looks like a bug.  Taking a quick look, I don't see how rowCount ends
> up in getAvg (over in 0.92 code base).
> St.Ack
>

Re: Coprocessor NPE

Posted by Stack <st...@duboce.net>.
On Mon, Aug 13, 2012 at 11:57 AM, Julian Wissmann
<ju...@sdace.de> wrote:
> In the regionserver log, I get the following output ten times:
>
> 2012-08-13 20:51:59,779 ERROR
> org.apache.hadoop.hbase.regionserver.HRegionServer:
> java.io.IOException: java.lang.NullPointerException
>         at
> org.apache.hadoop.hbase.coprocessor.AggregateImplementation.getAvg(AggregateImplementation.java:188)
>         at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source)
>         at

...

> Am I doing something wrong, here or is this actually a bug in hbase, that
> is causing this to go wrong.
>

Looks like a bug.  Taking a quick look, I don't see how rowCount ends
up in getAvg (over in 0.92 code base).
St.Ack