You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "stack (JIRA)" <ji...@apache.org> on 2008/01/23 23:48:34 UTC
[jira] Created: (HADOOP-2693) [hbase] NPE in getClosestRowBefore
[hbase] NPE in getClosestRowBefore
----------------------------------
Key: HADOOP-2693
URL: https://issues.apache.org/jira/browse/HADOOP-2693
Project: Hadoop Core
Issue Type: Bug
Components: contrib/hbase
Reporter: stack
Just saw this in a load test:
{code}
2008-01-23 22:43:42,831 INFO org.apache.hadoop.ipc.Server: IPC Server handler 8 on 60020, call getClosestRowBefore(.META.,,1, TestTable,,999999999999999, 9223372036854775807) from XX.XX.XX.141:49068: error: java.io.IOException: java.lang.NullPointerException
java.io.IOException: java.lang.NullPointerException
at org.apache.hadoop.io.Text.compareTo(Text.java:278)
at org.apache.hadoop.hbase.HStore.getRowKeyAtOrBefore(HStore.java:1846)
at org.apache.hadoop.hbase.HRegion.getClosestRowBefore(HRegion.java:1109)
at org.apache.hadoop.hbase.HRegionServer.getClosestRowBefore(HRegionServer.java:1434)
at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:908)
{code}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-2693) [hbase] NPE in getClosestRowBefore
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12561968#action_12561968 ]
Hadoop QA commented on HADOOP-2693:
-----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12373889/2693.patch
against trunk revision 614721.
@author +1. The patch does not contain any @author tags.
javadoc +1. The javadoc tool did not generate any warning messages.
javac +1. The applied patch does not generate any new compiler warnings.
findbugs +1. The patch does not introduce any new Findbugs warnings.
core tests -1. The patch failed core unit tests.
contrib tests +1. The patch passed contrib unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/1660/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/1660/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/1660/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/1660/console
This message is automatically generated.
> [hbase] NPE in getClosestRowBefore
> ----------------------------------
>
> Key: HADOOP-2693
> URL: https://issues.apache.org/jira/browse/HADOOP-2693
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/hbase
> Reporter: stack
> Assignee: Bryan Duxbury
> Attachments: 2693.patch
>
>
> Just saw this in a load test:
> {code}
> 2008-01-23 22:43:42,831 INFO org.apache.hadoop.ipc.Server: IPC Server handler 8 on 60020, call getClosestRowBefore(.META.,,1, TestTable,,999999999999999, 9223372036854775807) from XX.XX.XX.141:49068: error: java.io.IOException: java.lang.NullPointerException
> java.io.IOException: java.lang.NullPointerException
> at org.apache.hadoop.io.Text.compareTo(Text.java:278)
> at org.apache.hadoop.hbase.HStore.getRowKeyAtOrBefore(HStore.java:1846)
> at org.apache.hadoop.hbase.HRegion.getClosestRowBefore(HRegion.java:1109)
> at org.apache.hadoop.hbase.HRegionServer.getClosestRowBefore(HRegionServer.java:1434)
> at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413)
> at org.apache.hadoop.ipc.Server$Handler.run(Server.java:908)
> {code}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-2693) [hbase] NPE in getClosestRowBefore
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12561862#action_12561862 ]
stack commented on HADOOP-2693:
-------------------------------
This is what it looks like client-side:
{code}
08/01/23 22:44:13 ERROR hbase.PerformanceEvaluation: Failed
java.io.IOException: java.io.IOException: java.lang.NullPointerException
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
at org.apache.hadoop.hbase.RemoteExceptionHandler.decodeRemoteException(RemoteExceptionHandler.java:82)
at org.apache.hadoop.hbase.HConnectionManager$TableServers.locateRegionInMeta(HConnectionManager.java:469)
at org.apache.hadoop.hbase.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:343)
at org.apache.hadoop.hbase.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:306)
at org.apache.hadoop.hbase.HTable.<init>(HTable.java:90)
at org.apache.hadoop.hbase.PerformanceEvaluation$Test.testSetup(PerformanceEvaluation.java:308)
at org.apache.hadoop.hbase.PerformanceEvaluation$Test.test(PerformanceEvaluation.java:323)
at org.apache.hadoop.hbase.PerformanceEvaluation.runOneClient(PerformanceEvaluation.java:525)
at org.apache.hadoop.hbase.PerformanceEvaluation.runNIsOne(PerformanceEvaluation.java:546)
at org.apache.hadoop.hbase.PerformanceEvaluation.runTest(PerformanceEvaluation.java:568)
at org.apache.hadoop.hbase.PerformanceEvaluation.doCommandLine(PerformanceEvaluation.java:663)
at org.apache.hadoop.hbase.PerformanceEvaluation.main(PerformanceEvaluation.java:682)
{code}
> [hbase] NPE in getClosestRowBefore
> ----------------------------------
>
> Key: HADOOP-2693
> URL: https://issues.apache.org/jira/browse/HADOOP-2693
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/hbase
> Reporter: stack
>
> Just saw this in a load test:
> {code}
> 2008-01-23 22:43:42,831 INFO org.apache.hadoop.ipc.Server: IPC Server handler 8 on 60020, call getClosestRowBefore(.META.,,1, TestTable,,999999999999999, 9223372036854775807) from XX.XX.XX.141:49068: error: java.io.IOException: java.lang.NullPointerException
> java.io.IOException: java.lang.NullPointerException
> at org.apache.hadoop.io.Text.compareTo(Text.java:278)
> at org.apache.hadoop.hbase.HStore.getRowKeyAtOrBefore(HStore.java:1846)
> at org.apache.hadoop.hbase.HRegion.getClosestRowBefore(HRegion.java:1109)
> at org.apache.hadoop.hbase.HRegionServer.getClosestRowBefore(HRegionServer.java:1434)
> at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413)
> at org.apache.hadoop.ipc.Server$Handler.run(Server.java:908)
> {code}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-2693) [hbase] NPE in getClosestRowBefore
Posted by "Bryan Duxbury (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Bryan Duxbury updated HADOOP-2693:
----------------------------------
Status: Patch Available (was: Open)
Trying Hudson.
> [hbase] NPE in getClosestRowBefore
> ----------------------------------
>
> Key: HADOOP-2693
> URL: https://issues.apache.org/jira/browse/HADOOP-2693
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/hbase
> Reporter: stack
> Assignee: Bryan Duxbury
> Attachments: 2693.patch
>
>
> Just saw this in a load test:
> {code}
> 2008-01-23 22:43:42,831 INFO org.apache.hadoop.ipc.Server: IPC Server handler 8 on 60020, call getClosestRowBefore(.META.,,1, TestTable,,999999999999999, 9223372036854775807) from XX.XX.XX.141:49068: error: java.io.IOException: java.lang.NullPointerException
> java.io.IOException: java.lang.NullPointerException
> at org.apache.hadoop.io.Text.compareTo(Text.java:278)
> at org.apache.hadoop.hbase.HStore.getRowKeyAtOrBefore(HStore.java:1846)
> at org.apache.hadoop.hbase.HRegion.getClosestRowBefore(HRegion.java:1109)
> at org.apache.hadoop.hbase.HRegionServer.getClosestRowBefore(HRegionServer.java:1434)
> at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413)
> at org.apache.hadoop.ipc.Server$Handler.run(Server.java:908)
> {code}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-2693) [hbase] NPE in getClosestRowBefore
Posted by "Jim Kellerman (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12561893#action_12561893 ]
Jim Kellerman commented on HADOOP-2693:
---------------------------------------
Agreed that this is transitory. Also should not occur after HADOOP-2636 except after new table creation because it does not flush the cache if there are zero entries (which would create an empty MapFile)
> [hbase] NPE in getClosestRowBefore
> ----------------------------------
>
> Key: HADOOP-2693
> URL: https://issues.apache.org/jira/browse/HADOOP-2693
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/hbase
> Reporter: stack
> Assignee: Bryan Duxbury
> Attachments: 2693.patch
>
>
> Just saw this in a load test:
> {code}
> 2008-01-23 22:43:42,831 INFO org.apache.hadoop.ipc.Server: IPC Server handler 8 on 60020, call getClosestRowBefore(.META.,,1, TestTable,,999999999999999, 9223372036854775807) from XX.XX.XX.141:49068: error: java.io.IOException: java.lang.NullPointerException
> java.io.IOException: java.lang.NullPointerException
> at org.apache.hadoop.io.Text.compareTo(Text.java:278)
> at org.apache.hadoop.hbase.HStore.getRowKeyAtOrBefore(HStore.java:1846)
> at org.apache.hadoop.hbase.HRegion.getClosestRowBefore(HRegion.java:1109)
> at org.apache.hadoop.hbase.HRegionServer.getClosestRowBefore(HRegionServer.java:1434)
> at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413)
> at org.apache.hadoop.ipc.Server$Handler.run(Server.java:908)
> {code}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Assigned: (HADOOP-2693) [hbase] NPE in getClosestRowBefore
Posted by "Bryan Duxbury (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Bryan Duxbury reassigned HADOOP-2693:
-------------------------------------
Assignee: Bryan Duxbury
> [hbase] NPE in getClosestRowBefore
> ----------------------------------
>
> Key: HADOOP-2693
> URL: https://issues.apache.org/jira/browse/HADOOP-2693
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/hbase
> Reporter: stack
> Assignee: Bryan Duxbury
>
> Just saw this in a load test:
> {code}
> 2008-01-23 22:43:42,831 INFO org.apache.hadoop.ipc.Server: IPC Server handler 8 on 60020, call getClosestRowBefore(.META.,,1, TestTable,,999999999999999, 9223372036854775807) from XX.XX.XX.141:49068: error: java.io.IOException: java.lang.NullPointerException
> java.io.IOException: java.lang.NullPointerException
> at org.apache.hadoop.io.Text.compareTo(Text.java:278)
> at org.apache.hadoop.hbase.HStore.getRowKeyAtOrBefore(HStore.java:1846)
> at org.apache.hadoop.hbase.HRegion.getClosestRowBefore(HRegion.java:1109)
> at org.apache.hadoop.hbase.HRegionServer.getClosestRowBefore(HRegionServer.java:1434)
> at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413)
> at org.apache.hadoop.ipc.Server$Handler.run(Server.java:908)
> {code}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-2693) [hbase] NPE in getClosestRowBefore
Posted by "Bryan Duxbury (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Bryan Duxbury updated HADOOP-2693:
----------------------------------
Attachment: 2693.patch
This patch adds a NP check before using it. I think this problem is transitory anyway, because it should only happen when a MapFile is empty, and that only happens because the flusher is over flushing.
My tests pass locally with this patch.
> [hbase] NPE in getClosestRowBefore
> ----------------------------------
>
> Key: HADOOP-2693
> URL: https://issues.apache.org/jira/browse/HADOOP-2693
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/hbase
> Reporter: stack
> Assignee: Bryan Duxbury
> Attachments: 2693.patch
>
>
> Just saw this in a load test:
> {code}
> 2008-01-23 22:43:42,831 INFO org.apache.hadoop.ipc.Server: IPC Server handler 8 on 60020, call getClosestRowBefore(.META.,,1, TestTable,,999999999999999, 9223372036854775807) from XX.XX.XX.141:49068: error: java.io.IOException: java.lang.NullPointerException
> java.io.IOException: java.lang.NullPointerException
> at org.apache.hadoop.io.Text.compareTo(Text.java:278)
> at org.apache.hadoop.hbase.HStore.getRowKeyAtOrBefore(HStore.java:1846)
> at org.apache.hadoop.hbase.HRegion.getClosestRowBefore(HRegion.java:1109)
> at org.apache.hadoop.hbase.HRegionServer.getClosestRowBefore(HRegionServer.java:1434)
> at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:413)
> at org.apache.hadoop.ipc.Server$Handler.run(Server.java:908)
> {code}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.