You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by James Teng <te...@outlook.com> on 2015/03/27 04:47:35 UTC
HBase Error -- Can not scan table anymore.
hi,i have deployed hbase on my laptop as pseduo-distributed mode, however suddenly encountered an error and can not scan a hbase table anymore?could anyone show me any comments on this?thanks in advance.
uknow.
2015-03-27 11:35:00,152 WARN [CatalogJanitor-10.128.120.35:16020] master.CatalogJanitor: Failed scan of catalog tableorg.apache.hadoop.hbase.client.RetriesExhaustedException: Failed after attempts=351, exceptions:Fri Mar 27 11:35:00 CST 2015, null, java.net.SocketTimeoutException: callTimeout=60000, callDuration=68068: row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=10.128.120.35,16201,1427426329960, seqNum=0
at org.apache.hadoop.hbase.client.RpcRetryingCallerWithReadReplicas.throwEnrichedException(RpcRetryingCallerWithReadReplicas.java:264) at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:199) at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:56) at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithoutRetries(RpcRetryingCaller.java:200) at org.apache.hadoop.hbase.client.ClientScanner.call(ClientScanner.java:287) at org.apache.hadoop.hbase.client.ClientScanner.nextScanner(ClientScanner.java:267) at org.apache.hadoop.hbase.client.ClientScanner.initializeScannerInConstruction(ClientScanner.java:139) at org.apache.hadoop.hbase.client.ClientScanner.<init>(ClientScanner.java:134) at org.apache.hadoop.hbase.client.HTable.getScanner(HTable.java:823) at org.apache.hadoop.hbase.client.MetaScanner.metaScan(MetaScanner.java:187) at org.apache.hadoop.hbase.client.MetaScanner.metaScan(MetaScanner.java:89) at org.apache.hadoop.hbase.master.CatalogJanitor.getMergedRegionsAndSplitParents(CatalogJanitor.java:169) at org.apache.hadoop.hbase.master.CatalogJanitor.getMergedRegionsAndSplitParents(CatalogJanitor.java:121) at org.apache.hadoop.hbase.master.CatalogJanitor.scan(CatalogJanitor.java:222) at org.apache.hadoop.hbase.master.CatalogJanitor.chore(CatalogJanitor.java:103) at org.apache.hadoop.hbase.Chore.run(Chore.java:80) at java.lang.Thread.run(Thread.java:745)Caused by: java.net.SocketTimeoutException: callTimeout=60000, callDuration=68068: row '' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=10.128.120.35,16201,1427426329960, seqNum=0 at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:159) at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas$RetryingRPC.call(ScannerCallableWithReplicas.java:294) at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas$RetryingRPC.call(ScannerCallableWithReplicas.java:275) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) ... 1 moreCaused by: java.net.ConnectException: Connection refused at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206) at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:529) at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:493) at org.apache.hadoop.hbase.ipc.RpcClientImpl$Connection.setupConnection(RpcClientImpl.java:403) at org.apache.hadoop.hbase.ipc.RpcClientImpl$Connection.setupIOstreams(RpcClientImpl.java:709) at org.apache.hadoop.hbase.ipc.RpcClientImpl$Connection.writeRequest(RpcClientImpl.java:880) at org.apache.hadoop.hbase.ipc.RpcClientImpl$Connection.tracedWriteRequest(RpcClientImpl.java:849) at org.apache.hadoop.hbase.ipc.RpcClientImpl.call(RpcClientImpl.java:1173) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.callBlockingMethod(AbstractRpcClient.java:216) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$BlockingRpcChannelImplementation.callBlockingMethod(AbstractRpcClient.java:300) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$BlockingStub.scan(ClientProtos.java:31751) at org.apache.hadoop.hbase.client.ScannerCallable.openScanner(ScannerCallable.java:332) at org.apache.hadoop.hbase.client.ScannerCallable.call(ScannerCallable.java:187) at org.apache.hadoop.hbase.client.ScannerCallable.call(ScannerCallable.java:62) at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:126) ... 6 more2015-03-27 11:35:00,834 INFO [main-EventThread] coordination.SplitLogManagerCoordination: task /hbase/splitWAL/RESCAN0000000728 entered state: DONE 10.128.120.35,16020,14274263285532015-03-27 11:35:01,844 INFO [main-EventThread] coordination.SplitLogManagerCoordination: task /hbase/splitWAL/RESCAN0000000729 entered state: DONE 10.128.120.35,16020,14274263285532015-03-27 11:35:02,833 INFO [10.128.120.35,16020,1427426328553.splitLogManagerTimeoutMonitor] master.SplitLogManager: total tasks = 3 unassigned = 3 tasks={/hbase/splitWAL/WALs%2F10.128.120.35%2C16201%2C1427426329960-splitting%2F10.128.120.35%252C16201%252C1427426329960..meta.1427426351949.meta=last_update = -1 last_version = -1 cur_worker_name = null status = in_progress incarnation = 0 resubmits = 0 batch = installed = 3 done = 0 error = 0, /hbase/splitWAL/WALs%2F10.128.120.35%2C16201%2C1427426329960-splitting%2F10.128.120.35%252C16201%252C1427426329960..meta.1427426385371.meta=last_update = -1 last_version = -1 cur_worker_name = null status = in_progress incarnation = 0 resubmits = 0 batch = installed = 3 done = 0 error = 0, /hbase/splitWAL/WALs%2F10.128.120.35%2C16201%2C1427426329960-splitting%2F10.128.120.35%252C16201%252C1427426329960..meta.1427426352298.meta=last_update = -1 last_version = -1 cur_worker_name = null status = in_progress incarnation = 0 resubmits = 0 batch = installed = 3 done = 0 error = 0}2015-03-27 11:35:02,836 INFO [main-EventThread] coordination.SplitLogManagerCoordination: task /hbase/splitWAL/RESCAN0000000730 entered state: DONE 10.128.120.35,16020,14274263285532015-03-27 11:35:03,843 INFO [main-EventThread] coordination.SplitLogManagerCoordination: task /hbase/splitWAL/RESCAN0000000731 entered state: DONE 10.128.120.35,16020,14274263285532015-03-27 11:35:04,845 INFO [main-EventThread] coordination.SplitLogManagerCoordination: task /hbase/splitWAL/RESCAN0000000732 entered state: DONE 10.128.120.35,16020,14274263285532015-03-27 11:35:05,845 INFO [main-EventThread] coordination.SplitLogManagerCoordination: task /hbase/splitWAL/RESCAN0000000733 entered state: DONE 10.128.120.35,16020,14274263285532015-03-27 11:35:06,846 INFO [main-EventThread] coordination.SplitLogManagerCoordination: task /hbase/splitWAL/RESCAN0000000734 entered state: DONE 10.128.120.35,16020,14274263285532015-03-27 11:35:07,837 INFO [10.128.120.35,16020,1427426328553.splitLogManagerTimeoutMonitor] master.SplitLogManager: total tasks = 3 unassigned = 3 tasks={/hbase/splitWAL/WALs%2F10.128.120.35%2C16201%2C1427426329960-splitting%2F10.128.120.35%252C16201%252C1427426329960..meta.1427426351949.meta=last_update = -1 last_version = -1 cur_worker_name = null status = in_progress incarnation = 0 resubmits = 0 batch = installed = 3 done = 0 error = 0, /hbase/splitWAL/WALs%2F10.128.120.35%2C16201%2C1427426329960-splitting%2F10.128.120.35%252C16201%252C1427426329960..meta.1427426385371.meta=last_update = -1 last_version = -1 cur_worker_name = null status = in_progress incarnation = 0 resubmits = 0 batch = installed = 3 done = 0 error = 0, /hbase/splitWAL/WALs%2F10.128.120.35%2C16201%2C1427426329960-splitting%2F10.128.120.35%252C16201%252C1427426329960..meta.1427426352298.meta=last_update = -1 last_version = -1 cur_worker_name = null status = in_progress incarnation = 0 resubmits = 0 batch = installed = 3 done = 0 error = 0}2015-03-27 11:35:07,848 INFO [main-EventThread] coordination.SplitLogManagerCoordination: task /hbase/splitWAL/RESCAN0000000735 entered state: DONE 10.128.120.35,16020,14274263285532015-03-27 11:35:08,847 INFO [main-EventThread] coordination.SplitLogManagerCoordination: task /hbase/splitWAL/RESCAN0000000736 entered state: DONE 10.128.120.35,16020,14274263285532015-03-27 11:35:09,840 INFO [main-EventThread] coordination.SplitLogManagerCoordination: task /hbase/splitWAL/RESCAN0000000737 entered state: DONE 10.128.120.35,16020,14274263285532015-03-27 11:35:10,841 INFO [main-EventThread] coordination.SplitLogManagerCoordination: task /hbase/splitWAL/RESCAN0000000738 entered state: DONE 10.128.120.35,16020,14274263285532015-03-27 11:35:11,849 INFO [main-EventThread] coordination.SplitLogManagerCoordination: task /hbase/splitWAL/RESCAN0000000739 entered state: DONE 10.128.120.35,16020,1427426328553