You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@trafodion.apache.org by "Alice Chen (JIRA)" <ji...@apache.org> on 2015/07/22 20:20:20 UTC

[jira] [Created] (TRAFODION-1188) LP Bug: 1445680 - trafci crashing when running a query: Call to bronto07.usa.hp.com/15.250.49.13:60020 failed because java.net.SocketTimeoutException

Alice Chen created TRAFODION-1188:
-------------------------------------

             Summary: LP Bug: 1445680 - trafci crashing when running a query: Call to bronto07.usa.hp.com/15.250.49.13:60020 failed because java.net.SocketTimeoutException
                 Key: TRAFODION-1188
                 URL: https://issues.apache.org/jira/browse/TRAFODION-1188
             Project: Apache Trafodion
          Issue Type: Bug
            Reporter: Apache Trafodion


trafci crashing when running a query: Call to bronto07.usa.hp.com/15.250.49.13:60020 failed because java.net.SocketTimeoutException

TRAFCI crashed when running a query to count the rows in a table that had 40 million record. this was the output:
--- 10 row(s) selected.

SQL>select count(*) from EVENT_TEXT_TABLE;


*** ERROR[8448] Unable to access Hbase interface. Call to ExpHbaseInterface::coProcAggr returned error HBASE_ACCESS_ERROR(-705). Cause:
org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed after attempts=35, exceptions:
Fri Apr 17 20:49:43 UTC 2015, org.apache.hadoop.hbase.client.RpcRetryingCaller@4771af2c, java.net.SocketTimeoutException: Call to bronto07.usa.hp.com/15.250.49.13:60020 failed because java.net.SocketTimeoutException: 60000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/15.250.49.15:43484 remote=bronto07.usa.hp.com/15.250.49.13:60020]
Fri Apr 17 20:51:41 UTC 2015, org.apache.hadoop.hbase.client.RpcRetryingCaller@4771af2c, java.net.SocketTimeoutException: Call to bronto07.usa.hp.com/15.250.49.13:60020 failed because java.net.SocketTimeoutException: 60000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/15.250.49.15:43855 remote=bronto07.usa.hp.com/15.250.49.13:60020]
Fri Apr 17 20:52:42 UTC 2015, org.apache.hadoop.hbase.client.RpcRetryingCaller@4771af2c, java.net.SocketTimeoutException: Call to bronto07.usa.hp.com/15.250.49.13:60020 failed because java.net.SocketTimeoutException: 60000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/15.250.49.15:44766 remote=bronto07.usa.hp.com/15.250.49.13:60020]
Fri Apr 17 20:53:43 UTC 2015, org.apache.hadoop.hbase.client.RpcRetryingCaller@4771af2c, java.net.SocketTimeoutException: Call to bronto07.usa.hp.com/15.250.49.13:60020 failed because java.net.SocketTimeoutException: 60000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/15.250.49.15:45392 remote=bronto07.usa.hp.com/15.250.49.13:60020]
Fri Apr 17 20:54:45 UTC 2015, org.apache.hadoop.hbase.client.RpcRetryingCaller@4771af2c, java.net.SocketTimeoutException: Call to bronto07.usa.hp.com/15.250.49.13:60020 failed because java.net.SocketTimeoutException: 60000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/15.250.49.15:45861 remote=bronto07.usa.hp.com/15.250.49.13:60020]
Fri Apr 17 20:55:49 UTC 2015, org.apache.hadoop.hbase.client.RpcRetryingCaller@4771af2c, java.net.SocketTimeoutException: Call to bronto07.usa.hp.com/15.250.49.13:60020 failed because java.net.SocketTimeoutException: 60000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/15.250.49.15:46399 remote=bronto07.usa.hp.com/15.250.49.13:60020]
Fri Apr 17 20:56:59 UTC 2015, org.apache.hadoop.hbase.client.RpcRetryingCaller@4771af2c, java.net.SocketTimeoutException: Call to bronto07.usa.hp.com/15.250.49.13:60020 failed because java.net.SocketTimeoutException: 60000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/15.250.49.15:46981 remote=bronto07.usa.hp.com/15.250.49.13:60020]
Fri Apr 17 20:58:09 UTC 2015, org.apache.hadoop.hbase.client.RpcRetryingCaller@4771af2c, java.net.SocketTimeoutException: Call to bronto07.usa.hp.com/15.250.49.13:60020 failed because java.net.SocketTimeoutException: 60000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/15.250.49.15:47426 remote=bronto07.usa.hp.com/15.250.49.13:60020]
Fri Apr 17 20:59:19 UTC 2015, org.apache.hadoop.hbase.client.RpcRetryingCaller@4771af2c, java.net.SocketTimeoutException: Call to bronto07.usa.hp.com/15.250.49.13:60020 failed because java.net.SocketTimeoutException: 60000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/15.250.49.15:47970 remote=bronto07.usa.hp.com/15.250.49.13:60020]
Fri Apr 17 21:00:29 UTC 2015, org.apache.hadoop.hbase.client.RpcRetryingCaller@4771af2c, java.net.SocketTimeoutException: Call to bronto07.usa.hp.com/15.250.49.13:60020 failed because java.net.SocketTimeoutException: 60000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/15.250.49.15:48460 remote=bronto07.usa.hp.com/15.250.49.13:60020]
Fri Apr 17 21:01:50 UTC 2015, org.apache.hadoop.hbase.client.RpcRetryingCaller@4771af2c, java.net.SocketTimeoutException: Call to bronto07.usa.hp.com/15.250.49.13:60020 failed because java.net.SocketTimeoutException: 60000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/15.250.49.15:49151 remote=bronto07.usa.hp.com/15.250.49.13:60020]
Fri Apr 17 21:03:10 UTC 2015, org.apache.hadoop.hbase.client.RpcRetryingCaller@4771af2c, java.net.SocketTimeoutException: Call to bronto07.usa.hp.com/15.250.49.13:60020 failed because java.net.SocketTimeoutException: 60000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/15.250.49.15:49769 remote=bronto07.usa.hp.com/15.250.49.13:60020]
Fri Apr 17 21:04:30 UTC 2015, org.apache.hadoop.hbase.client.RpcRetryingCaller@4771af2c, java.net.SocketTimeoutException: Call to bronto07.usa.hp.com/15.250.49.13:60020 failed because java.net.SocketTimeoutException: 60000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/15.250.49.15:50406 remote=bronto07.usa.hp.com/15.250.49.13:60020]
Fri Apr 17 21:05:50 UTC 2015, org.apache.hadoop.hbase.client.RpcRetryingCaller@4771af2c, java.net.SocketTimeoutException: Call to bronto07.usa.hp.com/15.250.49.13:60020 failed because java.net.SocketTimeoutException: 60000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/15.250.49.15:50999 remote=bronto07.usa.hp.com/15.250.49.13:60020]
Fri Apr 17 21:07:10 UTC 2015, org.apache.hadoop.hbase.client.RpcRetryingCaller@4771af2c, java.net.SocketTimeoutException: Call to bronto07.usa.hp.com/15.250.49.13:60020 failed because java.net.SocketTimeoutException: 60000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/15.250.49.15:51493 remote=bronto07.usa.hp.com/15.250.49.13:60020]
Fri Apr 17 21:08:30 UTC 2015, org.apache.hadoop.hbase.client.RpcRetryingCaller@4771af2c, java.net.SocketTimeoutException: Call to bronto07.usa.hp.com/15.250.49.13:60020 failed because java.net.SocketTimeoutException: 60000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/15.250.49.15:52059 remote=bronto07.usa.hp.com/15.250.49.13:60020]
Fri Apr 17 21:09:51 UTC 2015, org.apache.hadoop.hbase.client.RpcRetryingCaller@4771af2c, java.net.SocketTimeoutException: Call to bronto07.usa.hp.com/15.250.49.13:60020 failed because java.net.SocketTimeoutException: 60000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/15.250.49.15:52707 remote=bronto07.usa.hp.com/15.250.49.13:60020]
Fri Apr 17 21:11:11 UTC 2015, org.apache.hadoop.hbase.client.RpcRetryingCaller@4771af2c, java.net.SocketTimeoutException: Call to bronto07.usa.hp.com/15.250.49.13:60020 failed because java.net.SocketTimeoutException: 60000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/15.250.49.15:53335 remote=bronto07.usa.hp.com/15.250.49.13:60020]
Fri Apr 17 21:12:31 UTC 2015, org.apache.hadoop.hbase.client.RpcRetryingCaller@4771af2c, java.net.SocketTimeoutException: Call to bronto07.usa.hp.com/15.250.49.13:60020 failed because java.net.SocketTimeoutException: 60000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/15.250.49.15:53866 remote=bronto07.usa.hp.com/15.250.49.13:60020]
Fri Apr 17 21:13:51 UTC 2015, org.apache.hadoop.hbase.client.RpcRetryingCaller@4771af2c, java.net.SocketTimeoutException: Call to bronto07.usa.hp.com/15.250.49.13:60020 failed because java.net.SocketTimeoutException: 60000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/15.250.49.15:54552 remote=bronto07.usa.hp.com/15.250.49.13:60020]
Fri Apr 17 21:15:11 UTC 2015, org.apache.hadoop.hbase.client.RpcRetryingCaller@4771af2c, java.net.SocketTimeoutException: Call to bronto07.usa.hp.com/15.250.49.13:60020 failed because java.net.SocketTimeoutException: 60000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/15.250.49.15:55243 remote=bronto07.usa.hp.com/15.250.49.13:60020]
Fri Apr 17 21:16:31 UTC 2015, org.apache.hadoop.hbase.client.RpcRetryingCaller@4771af2c, java.net.SocketTimeoutException: Call to bronto07.usa.hp.com/15.250.49.13:60020 failed because java.net.SocketTimeoutException: 60000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/15.250.49.15:55773 remote=bronto07.usa.hp.com/15.250.49.13:60020]
Fri Apr 17 21:17:51 UTC 2015, org.apache.hadoop.hbase.client.RpcRetryingCaller@4771af2c, java.net.SocketTimeoutException: Call to bronto07.usa.hp.com/15.250.49.13:60020 failed because java.net.SocketTimeoutException: 60000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/15.250.49.15:56333 remote=bronto07.usa.hp.com/15.250.49.13:60020]
Fri Apr 17 21:19:11 UTC 2015, org.apache.hadoop.hbase.client.RpcRetryingCaller@4771af2c, java.net.SocketTimeoutException: Call to bronto07.usa.hp.com/15.250.49.13:60020 failed because java.net.SocketTimeoutException: 60000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/15.250.49.15:57015 remote=bronto07.usa.hp.com/15.250.49.13:60020]
Fri Apr 17 21:20:32 UTC 2015, org.apache.hadoop.hbase.client.RpcRetryingCaller@4771af2c, java.net.SocketTimeoutException: Call to bronto07.usa.hp.com/15.250.49.13:60020 failed because java.net.SocketTimeoutException: 60000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/15.250.49.15:57610 remote=bronto07.usa.hp.com/15.250.49.13:60020]
Fri Apr 17 21:21:52 UTC 2015, org.apache.hadoop.hbase.client.RpcRetryingCaller@4771af2c, java.net.SocketTimeoutException: Call to bronto07.usa.hp.com/15.250.49.13:60020 failed because java.net.SocketTimeoutException: 60000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/15.250.49.15:58115 remote=bronto07.usa.hp.com/15.250.49.13:60020]
Fri Apr 17 21:23:12 UTC 2015, org.apache.hadoop.hbase.client.RpcRetryingCaller@4771af2c, java.net.SocketTimeoutException: Call to bronto07.usa.hp.com/15.250.49.13:60020 failed because java.net.SocketTimeoutException: 60000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/15.250.49.15:58777 remote=bronto07.usa.hp.com/15.250.49.13:60020]
Fri Apr 17 21:24:32 UTC 2015, org.apache.hadoop.hbase.client.RpcRetryingCaller@4771af2c, java.net.SocketTimeoutException: Call to bronto07.usa.hp.com/15.250.49.13:60020 failed because java.net.SocketTimeoutException: 60000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/15.250.49.15:59503 remote=bronto07.usa.hp.com/15.250.49.13:60020]
Fri Apr 17 21:25:52 UTC 2015, org.apache.hadoop.hbase.client.RpcRetryingCaller@4771af2c, java.net.SocketTimeoutException: Call to bronto07.usa.hp.com/15.250.49.13:60020 failed because java.net.SocketTimeoutException: 60000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/15.250.49.15:60090 remote=bronto07.usa.hp.com/15.250.49.13:60020]
Fri Apr 17 21:27:40 UTC 2015, org.apache.hadoop.hbase.client.RpcRetryingCaller@4771af2c, java.net.SocketTimeoutException: Call to bronto07.usa.hp.com/15.250.49.13:60020 failed because java.net.SocketTimeoutException: 60000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/15.250.49.15:60617 remote=bronto07.usa.hp.com/15.250.49.13:60020]
Fri Apr 17 21:29:00 UTC 2015, org.apache.hadoop.hbase.client.RpcRetryingCaller@4771af2c, java.net.SocketTimeoutException: Call to bronto07.usa.hp.com/15.250.49.13:60020 failed because java.net.SocketTimeoutException: 60000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/15.250.49.15:33136 remote=bronto07.usa.hp.com/15.250.49.13:60020]
Fri Apr 17 21:30:20 UTC 2015, org.apache.hadoop.hbase.client.RpcRetryingCaller@4771af2c, java.net.SocketTimeoutException: Call to bronto07.usa.hp.com/15.250.49.13:60020 failed because java.net.SocketTimeoutException: 60000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/15.250.49.15:33771 remote=bronto07.usa.hp.com/15.250.49.13:60020]
Fri Apr 17 21:31:40 UTC 2015, org.apache.hadoop.hbase.client.RpcRetryingCaller@4771af2c, java.net.SocketTimeoutException: Call to bronto07.usa.hp.com/15.250.49.13:60020 failed because java.net.SocketTimeoutException: 60000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/15.250.49.15:34496 remote=bronto07.usa.hp.com/15.250.49.13:60020]
Fri Apr 17 21:33:00 UTC 2015, org.apache.hadoop.hbase.client.RpcRetryingCaller@4771af2c, java.net.SocketTimeoutException: Call to bronto07.usa.hp.com/15.250.49.13:60020 failed because java.net.SocketTimeoutException: 60000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/15.250.49.15:35191 remote=bronto07.usa.hp.com/15.250.49.13:60020]
Fri Apr 17 21:34:21 UTC 2015, org.apache.hadoop.hbase.client.RpcRetryingCaller@4771af2c, java.net.SocketTimeoutException: Call to bronto07.usa.hp.com/15.250.49.13:60020 failed because java.net.SocketTimeoutException: 60000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/15.250.49.15:35870 remote=bronto07.usa.hp.com/15.250.49.13:60020]

org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:129)
org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:90)
org.apache.hadoop.hbase.ipc.RegionCoprocessorRpcChannel.callExecService(RegionCoprocessorRpcChannel.java:96)
org.apache.hadoop.hbase.ipc.CoprocessorRpcChannel.callMethod(CoprocessorRpcChannel.java:57)
org.apache.hadoop.hbase.protobuf.generated.AggregateProtos$AggregateService$Stub.getRowNum(AggregateProtos.java:2113)
org.apache.hadoop.hbase.client.coprocessor.AggregationClient$3.call(AggregationClient.java:327)
org.apache.hadoop.hbase.client.coprocessor.AggregationClient$3.call(AggregationClient.java:321)
org.apache.hadoop.hbase.client.HTable$17.call(HTable.java:1571)
java.util.concurrent.FutureTask.run(FutureTask.java:262)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
java.lang.Thread.run(Thread.java:745)
. [2015-04-17 21:34:21]

SQL>
SQL>




Trafodion reported this query completed but i had error text
*** ERROR[8448] Unable to access Hbase interface. Call to ExpHbaseInterface::coProcAggr returned error HBASE_ACCESS_ERROR(-705). Cause: org.apache.hadoop.hbase.client.RetriesExhaustedException: Faile



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)