You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hbase.apache.org by "Andrew Purtell (JIRA)" <ji...@apache.org> on 2008/12/21 21:23:44 UTC
[jira] Reopened: (HBASE-1045) Hangup by regionserver causes write
to fail
[ https://issues.apache.org/jira/browse/HBASE-1045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Andrew Purtell reopened HBASE-1045:
-----------------------------------
Dec 21, 2008 7:28:07 PM com.powerset.heritrix.writer.HBaseWriterProcessor innerProcessResult
SEVERE: Failed write of Record: dns:www.mp3.com (in thread 'ToeThread #3: dns:www.mp3.com'; in processor 'Archiver')
java.io.IOException: java.lang.NullPointerException
at com.powerset.heritrix.writer.HBaseWriter.write(Unknown Source)
at com.powerset.heritrix.writer.HBaseWriterProcessor.write(Unknown Source)
at com.powerset.heritrix.writer.HBaseWriterProcessor.innerProcessResult(Unknown Source)
at org.archive.modules.Processor.process(Processor.java:123)
at org.archive.crawler.framework.ToeThread.processCrawlUri(ToeThread.java:310)
at org.archive.crawler.framework.ToeThread.run(ToeThread.java:157)
Caused by: java.lang.NullPointerException
at org.apache.hadoop.hbase.client.HConnectionManager$TableServers.processBatchOfRows(HConnectionManager.java:911)
at org.apache.hadoop.hbase.client.HTable.flushCommits(HTable.java:1267)
at org.apache.hadoop.hbase.client.HTable.commit(HTable.java:1238)
at org.apache.hadoop.hbase.client.HTable.commit(HTable.java:1218)
at net.iridiant.content.Content.store(Unknown Source)
at net.iridiant.content.Content.store(Unknown Source)
... 6 more
> Hangup by regionserver causes write to fail
> -------------------------------------------
>
> Key: HBASE-1045
> URL: https://issues.apache.org/jira/browse/HBASE-1045
> Project: Hadoop HBase
> Issue Type: Bug
> Components: client
> Reporter: Andrew Purtell
> Assignee: Jean-Daniel Cryans
> Fix For: 0.19.0
>
> Attachments: hbase-1045-1.patch
>
>
> Root cause is OOME on the region server. Nonetheless a hangup during IPC causes the client to fail the write, currently causing data loss. Should the application catch and retry? Or should the client libraries try harder?
> Dec 4, 2008 5:25:30 PM com.powerset.heritrix.writer.HBaseWriterProcessor innerProcessResult
> SEVERE: Failed write of Record: http://www.publicrecordslocal.com/georgia.htm (in thread 'ToeThread #9: http://www.publicrecordslocal.com/georgia.htm'; in processor 'Archiver')
> java.io.IOException: java.io.IOException: Call to /10.30.94.38:60020 failed on local exception: Connection refused
> at com.powerset.heritrix.writer.HBaseWriter.write(Unknown Source)
> at com.powerset.heritrix.writer.HBaseWriterProcessor.write(Unknown Source)
> at com.powerset.heritrix.writer.HBaseWriterProcessor.innerProcessResult(Unknown Source)
> at org.archive.modules.Processor.process(Processor.java:123)
> at org.archive.crawler.framework.ToeThread.processCrawlUri(ToeThread.java:310)
> at org.archive.crawler.framework.ToeThread.run(ToeThread.java:157)
> Caused by: java.io.IOException: Call to /10.30.94.38:60020 failed on local exception: Connection refused
> at org.apache.hadoop.ipc.Client.call(Client.java:699)
> at org.apache.hadoop.hbase.ipc.HbaseRPC$Invoker.invoke(HbaseRPC.java:323)
> at $Proxy12.batchUpdates(Unknown Source)
> at org.apache.hadoop.hbase.client.HConnectionManager$TableServers$2.call(HConnectionManager.java:919)
> at org.apache.hadoop.hbase.client.HConnectionManager$TableServers$2.call(HConnectionManager.java:917)
> at org.apache.hadoop.hbase.client.HConnectionManager$TableServers.getRegionServerForWithoutRetries(HConnectionManager.java:875)
> at org.apache.hadoop.hbase.client.HConnectionManager$TableServers.processBatchOfRows(HConnectionManager.java:916)
> at org.apache.hadoop.hbase.client.HTable.flushCommits(HTable.java:1267)
> at org.apache.hadoop.hbase.client.HTable.commit(HTable.java:1238)
> at org.apache.hadoop.hbase.client.HTable.commit(HTable.java:1218)
> at net.iridiant.content.Content.storeURLInfo(Unknown Source)
> ... 6 more
> Caused by: java.net.ConnectException: Connection refused
> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:574)
> at sun.nio.ch.SocketAdaptor.connect(SocketAdaptor.java:100)
> at org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:299)
> at org.apache.hadoop.ipc.Client$Connection.access$1700(Client.java:176)
> at org.apache.hadoop.ipc.Client.getConnection(Client.java:772)
> at org.apache.hadoop.ipc.Client.call(Client.java:685)
> ... 16 more
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.