You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@phoenix.apache.org by Li Li <fa...@gmail.com> on 2014/03/13 02:27:12 UTC

Exception and deadlock?

the error log is:

14-03-11 00:07:07,507 WARN ActiveMQ Session Task-65
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation
Failed all from
region=VC.URL_LINK,\x07\x00\x00,1394082196117.654b4a1786c0b823f8353a9fe825b42b.,
hostname=dctest-hbase6, port=60020
java.util.concurrent.ExecutionException:
java.net.SocketTimeoutException: Call to
dctest-hbase6/192.168.11.156:60020 failed on socket timeout exception:
java.net.SocketTimeoutException: 600000 millis timeout while waiting
for channel to be ready for read. ch :
java.nio.channels.SocketChannel[connected local=/192.168.11.181:41740
remote=dctest-hbase6/192.168.11.156:60020]
        at java.util.concurrent.FutureTask.report(FutureTask.java:122)
        at java.util.concurrent.FutureTask.get(FutureTask.java:188)
        at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.processBatchCallback(HConnectionManager.java:1711)
        at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.processBatch(HConnectionManager.java:1563)
        at org.apache.hadoop.hbase.client.HTable.batch(HTable.java:775)
        at org.apache.phoenix.execute.MutationState.commit(MutationState.java:376)
        at org.apache.phoenix.jdbc.PhoenixConnection.commit(PhoenixConnection.java:295)

Caused by: java.net.SocketTimeoutException: Call to
dctest-hbase6/192.168.11.156:60020 failed on socket timeout exception:
java.net.SocketTimeoutException: 600000 millis timeout while waiting
for channel to be ready for read. ch :
java.nio.channels.SocketChannel[connected local=/192.168.11.181:41740
remote=dctest-hbase6/192.168.11.156:60020]
        at org.apache.hadoop.hbase.ipc.HBaseClient.wrapException(HBaseClient.java:1035)
        at org.apache.hadoop.hbase.ipc.HBaseClient.call(HBaseClient.java:1008)
        at org.apache.hadoop.hbase.ipc.WritableRpcEngine$Invoker.invoke(WritableRpcEngine.java:86)
        at com.sun.proxy.$Proxy6.multi(Unknown Source)
        at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation$3$1.call(HConnectionManager.java:1540)
        at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation$3$1.call(HConnectionManager.java:1538)
        at org.apache.hadoop.hbase.client.ServerCallable.withoutRetries(ServerCallable.java:228)
        at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation$3.call(HConnectionManager.java:1547)
        at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation$3.call(HConnectionManager.java:1535)
        at java.util.concurrent.FutureTask.run(FutureTask.java:262)
        ... 3 more
Caused by: java.net.SocketTimeoutException: 600000 millis timeout
while waiting for channel to be ready for read. ch :
java.nio.channels.SocketChannel[connected local=/192.168.11.181:41740
remote=dctest-hbase6/192.168.11.156:60020]
        at org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:164)
        at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:155)
        at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:128)
        at java.io.FilterInputStream.read(FilterInputStream.java:133)
        at org.apache.hadoop.hbase.ipc.HBaseClient$Connection$PingInputStream.read(HBaseClient.java:373)
        at java.io.BufferedInputStream.fill(BufferedInputStream.java:235)
        at java.io.BufferedInputStream.read(BufferedInputStream.java:254)
        at java.io.DataInputStream.readInt(DataInputStream.java:387)
        at org.apache.hadoop.hbase.ipc.HBaseClient$Connection.receiveResponse(HBaseClient.java:652)
        at org.apache.hadoop.hbase.ipc.HBaseClient$Connection.run(HBaseClient.java:586)

jstack result is very large, so I put it in the attachment.

Re: Exception and deadlock?

Posted by Li Li <fa...@gmail.com>.
the hbase is downloaded from http://people.apache.org/~mujtaba/phoenix-2.2.3RC1/

On Thu, Mar 13, 2014 at 9:27 AM, Li Li <fa...@gmail.com> wrote:
> the error log is:
>
> 14-03-11 00:07:07,507 WARN ActiveMQ Session Task-65
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation
> Failed all from
> region=VC.URL_LINK,\x07\x00\x00,1394082196117.654b4a1786c0b823f8353a9fe825b42b.,
> hostname=dctest-hbase6, port=60020
> java.util.concurrent.ExecutionException:
> java.net.SocketTimeoutException: Call to
> dctest-hbase6/192.168.11.156:60020 failed on socket timeout exception:
> java.net.SocketTimeoutException: 600000 millis timeout while waiting
> for channel to be ready for read. ch :
> java.nio.channels.SocketChannel[connected local=/192.168.11.181:41740
> remote=dctest-hbase6/192.168.11.156:60020]
>         at java.util.concurrent.FutureTask.report(FutureTask.java:122)
>         at java.util.concurrent.FutureTask.get(FutureTask.java:188)
>         at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.processBatchCallback(HConnectionManager.java:1711)
>         at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.processBatch(HConnectionManager.java:1563)
>         at org.apache.hadoop.hbase.client.HTable.batch(HTable.java:775)
>         at org.apache.phoenix.execute.MutationState.commit(MutationState.java:376)
>         at org.apache.phoenix.jdbc.PhoenixConnection.commit(PhoenixConnection.java:295)
>
> Caused by: java.net.SocketTimeoutException: Call to
> dctest-hbase6/192.168.11.156:60020 failed on socket timeout exception:
> java.net.SocketTimeoutException: 600000 millis timeout while waiting
> for channel to be ready for read. ch :
> java.nio.channels.SocketChannel[connected local=/192.168.11.181:41740
> remote=dctest-hbase6/192.168.11.156:60020]
>         at org.apache.hadoop.hbase.ipc.HBaseClient.wrapException(HBaseClient.java:1035)
>         at org.apache.hadoop.hbase.ipc.HBaseClient.call(HBaseClient.java:1008)
>         at org.apache.hadoop.hbase.ipc.WritableRpcEngine$Invoker.invoke(WritableRpcEngine.java:86)
>         at com.sun.proxy.$Proxy6.multi(Unknown Source)
>         at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation$3$1.call(HConnectionManager.java:1540)
>         at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation$3$1.call(HConnectionManager.java:1538)
>         at org.apache.hadoop.hbase.client.ServerCallable.withoutRetries(ServerCallable.java:228)
>         at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation$3.call(HConnectionManager.java:1547)
>         at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation$3.call(HConnectionManager.java:1535)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:262)
>         ... 3 more
> Caused by: java.net.SocketTimeoutException: 600000 millis timeout
> while waiting for channel to be ready for read. ch :
> java.nio.channels.SocketChannel[connected local=/192.168.11.181:41740
> remote=dctest-hbase6/192.168.11.156:60020]
>         at org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:164)
>         at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:155)
>         at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:128)
>         at java.io.FilterInputStream.read(FilterInputStream.java:133)
>         at org.apache.hadoop.hbase.ipc.HBaseClient$Connection$PingInputStream.read(HBaseClient.java:373)
>         at java.io.BufferedInputStream.fill(BufferedInputStream.java:235)
>         at java.io.BufferedInputStream.read(BufferedInputStream.java:254)
>         at java.io.DataInputStream.readInt(DataInputStream.java:387)
>         at org.apache.hadoop.hbase.ipc.HBaseClient$Connection.receiveResponse(HBaseClient.java:652)
>         at org.apache.hadoop.hbase.ipc.HBaseClient$Connection.run(HBaseClient.java:586)
>
> jstack result is very large, so I put it in the attachment.