You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hbase.apache.org by "ryan rawson (JIRA)" <ji...@apache.org> on 2009/06/20 06:10:07 UTC
[jira] Created: (HBASE-1555) some java "concurrent" structures may
not be so much after all!
some java "concurrent" structures may not be so much after all!
---------------------------------------------------------------
Key: HBASE-1555
URL: https://issues.apache.org/jira/browse/HBASE-1555
Project: Hadoop HBase
Issue Type: Bug
Affects Versions: 0.20.0
Reporter: ryan rawson
Fix For: 0.20.0
during a huge import (high concurrenty, 56 writers) I have seen:
java.io.IOException: java.lang.NullPointerException
at org.apache.hadoop.hbase.regionserver.HRegionServer.convertThrowableToIOE(HRegionServer.java:832)
at org.apache.hadoop.hbase.regionserver.HRegionServer.convertThrowableToIOE(HRegionServer.java:822)
at org.apache.hadoop.hbase.regionserver.HRegionServer.put(HRegionServer.java:1775)
at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:643)
at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:913)
Caused by: java.lang.NullPointerException
at java.util.concurrent.ConcurrentHashMap$Segment.put(ConcurrentHashMap.java:426)
at java.util.concurrent.ConcurrentHashMap.put(ConcurrentHashMap.java:883)
at org.apache.hadoop.hbase.regionserver.HRegion.obtainRowLock(HRegion.java:1557)
at org.apache.hadoop.hbase.regionserver.HRegion.getLock(HRegion.java:1610)
at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:1225)
at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:1197)
at org.apache.hadoop.hbase.regionserver.HRegionServer.put(HRegionServer.java:1768)
... 5 more
2009-06-19 20:13:55,672 ERROR org.apache.hadoop.hbase.regionserver.HRegionServer: java.lang.NullPointerException
2009-06-19 20:13:55,672 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 5 on 60020, call put([B@3160e069, [Lorg.apache.hadoop.hbase.client.Put;@4f2d26d2) from 10.10.20.226
:38741: error: java.io.IOException: java.lang.NullPointerException
java.io.IOException: java.lang.NullPointerException
at org.apache.hadoop.hbase.regionserver.HRegionServer.convertThrowableToIOE(HRegionServer.java:832)
at org.apache.hadoop.hbase.regionserver.HRegionServer.convertThrowableToIOE(HRegionServer.java:822)
at org.apache.hadoop.hbase.regionserver.HRegionServer.put(HRegionServer.java:1775)
at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:643)
at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:913)
Caused by: java.lang.NullPointerException
at java.util.concurrent.ConcurrentHashMap$Segment.put(ConcurrentHashMap.java:426)
at java.util.concurrent.ConcurrentHashMap.put(ConcurrentHashMap.java:883)
at org.apache.hadoop.hbase.regionserver.HRegion.obtainRowLock(HRegion.java:1557)
at org.apache.hadoop.hbase.regionserver.HRegion.getLock(HRegion.java:1610)
at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:1225)
at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:1197)
at org.apache.hadoop.hbase.regionserver.HRegionServer.put(HRegionServer.java:1768)
... 5 more
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HBASE-1555) some java "concurrent" structures
may not be so much after all!
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12722728#action_12722728 ]
stack commented on HBASE-1555:
------------------------------
Looking in CHM#put, is it possible you were passing a null key when putting Ryan?
> some java "concurrent" structures may not be so much after all!
> ---------------------------------------------------------------
>
> Key: HBASE-1555
> URL: https://issues.apache.org/jira/browse/HBASE-1555
> Project: Hadoop HBase
> Issue Type: Bug
> Affects Versions: 0.20.0
> Reporter: ryan rawson
> Fix For: 0.20.0
>
>
> during a huge import (high concurrenty, 56 writers) I have seen:
> java.io.IOException: java.lang.NullPointerException
> at org.apache.hadoop.hbase.regionserver.HRegionServer.convertThrowableToIOE(HRegionServer.java:832)
> at org.apache.hadoop.hbase.regionserver.HRegionServer.convertThrowableToIOE(HRegionServer.java:822)
> at org.apache.hadoop.hbase.regionserver.HRegionServer.put(HRegionServer.java:1775)
> at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:643)
> at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:913)
> Caused by: java.lang.NullPointerException
> at java.util.concurrent.ConcurrentHashMap$Segment.put(ConcurrentHashMap.java:426)
> at java.util.concurrent.ConcurrentHashMap.put(ConcurrentHashMap.java:883)
> at org.apache.hadoop.hbase.regionserver.HRegion.obtainRowLock(HRegion.java:1557)
> at org.apache.hadoop.hbase.regionserver.HRegion.getLock(HRegion.java:1610)
> at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:1225)
> at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:1197)
> at org.apache.hadoop.hbase.regionserver.HRegionServer.put(HRegionServer.java:1768)
> ... 5 more
> 2009-06-19 20:13:55,672 ERROR org.apache.hadoop.hbase.regionserver.HRegionServer: java.lang.NullPointerException
> 2009-06-19 20:13:55,672 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 5 on 60020, call put([B@3160e069, [Lorg.apache.hadoop.hbase.client.Put;@4f2d26d2) from 10.10.20.226
> :38741: error: java.io.IOException: java.lang.NullPointerException
> java.io.IOException: java.lang.NullPointerException
> at org.apache.hadoop.hbase.regionserver.HRegionServer.convertThrowableToIOE(HRegionServer.java:832)
> at org.apache.hadoop.hbase.regionserver.HRegionServer.convertThrowableToIOE(HRegionServer.java:822)
> at org.apache.hadoop.hbase.regionserver.HRegionServer.put(HRegionServer.java:1775)
> at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:643)
> at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:913)
> Caused by: java.lang.NullPointerException
> at java.util.concurrent.ConcurrentHashMap$Segment.put(ConcurrentHashMap.java:426)
> at java.util.concurrent.ConcurrentHashMap.put(ConcurrentHashMap.java:883)
> at org.apache.hadoop.hbase.regionserver.HRegion.obtainRowLock(HRegion.java:1557)
> at org.apache.hadoop.hbase.regionserver.HRegion.getLock(HRegion.java:1610)
> at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:1225)
> at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:1197)
> at org.apache.hadoop.hbase.regionserver.HRegionServer.put(HRegionServer.java:1768)
> ... 5 more
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Resolved: (HBASE-1555) some java "concurrent" structures may
not be so much after all!
Posted by "ryan rawson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
ryan rawson resolved HBASE-1555.
--------------------------------
Resolution: Cannot Reproduce
havent seen this again.
> some java "concurrent" structures may not be so much after all!
> ---------------------------------------------------------------
>
> Key: HBASE-1555
> URL: https://issues.apache.org/jira/browse/HBASE-1555
> Project: Hadoop HBase
> Issue Type: Bug
> Affects Versions: 0.20.0
> Reporter: ryan rawson
> Fix For: 0.20.0
>
>
> during a huge import (high concurrenty, 56 writers) I have seen:
> java.io.IOException: java.lang.NullPointerException
> at org.apache.hadoop.hbase.regionserver.HRegionServer.convertThrowableToIOE(HRegionServer.java:832)
> at org.apache.hadoop.hbase.regionserver.HRegionServer.convertThrowableToIOE(HRegionServer.java:822)
> at org.apache.hadoop.hbase.regionserver.HRegionServer.put(HRegionServer.java:1775)
> at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:643)
> at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:913)
> Caused by: java.lang.NullPointerException
> at java.util.concurrent.ConcurrentHashMap$Segment.put(ConcurrentHashMap.java:426)
> at java.util.concurrent.ConcurrentHashMap.put(ConcurrentHashMap.java:883)
> at org.apache.hadoop.hbase.regionserver.HRegion.obtainRowLock(HRegion.java:1557)
> at org.apache.hadoop.hbase.regionserver.HRegion.getLock(HRegion.java:1610)
> at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:1225)
> at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:1197)
> at org.apache.hadoop.hbase.regionserver.HRegionServer.put(HRegionServer.java:1768)
> ... 5 more
> 2009-06-19 20:13:55,672 ERROR org.apache.hadoop.hbase.regionserver.HRegionServer: java.lang.NullPointerException
> 2009-06-19 20:13:55,672 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 5 on 60020, call put([B@3160e069, [Lorg.apache.hadoop.hbase.client.Put;@4f2d26d2) from 10.10.20.226
> :38741: error: java.io.IOException: java.lang.NullPointerException
> java.io.IOException: java.lang.NullPointerException
> at org.apache.hadoop.hbase.regionserver.HRegionServer.convertThrowableToIOE(HRegionServer.java:832)
> at org.apache.hadoop.hbase.regionserver.HRegionServer.convertThrowableToIOE(HRegionServer.java:822)
> at org.apache.hadoop.hbase.regionserver.HRegionServer.put(HRegionServer.java:1775)
> at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:643)
> at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:913)
> Caused by: java.lang.NullPointerException
> at java.util.concurrent.ConcurrentHashMap$Segment.put(ConcurrentHashMap.java:426)
> at java.util.concurrent.ConcurrentHashMap.put(ConcurrentHashMap.java:883)
> at org.apache.hadoop.hbase.regionserver.HRegion.obtainRowLock(HRegion.java:1557)
> at org.apache.hadoop.hbase.regionserver.HRegion.getLock(HRegion.java:1610)
> at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:1225)
> at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:1197)
> at org.apache.hadoop.hbase.regionserver.HRegionServer.put(HRegionServer.java:1768)
> ... 5 more
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HBASE-1555) some java "concurrent" structures
may not be so much after all!
Posted by "ryan rawson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12722312#action_12722312 ]
ryan rawson commented on HBASE-1555:
------------------------------------
i have been unable to cause this to happen again since i fixed 1558... Its a very strange/impossible situation!
this was 1.6u14
> some java "concurrent" structures may not be so much after all!
> ---------------------------------------------------------------
>
> Key: HBASE-1555
> URL: https://issues.apache.org/jira/browse/HBASE-1555
> Project: Hadoop HBase
> Issue Type: Bug
> Affects Versions: 0.20.0
> Reporter: ryan rawson
> Fix For: 0.20.0
>
>
> during a huge import (high concurrenty, 56 writers) I have seen:
> java.io.IOException: java.lang.NullPointerException
> at org.apache.hadoop.hbase.regionserver.HRegionServer.convertThrowableToIOE(HRegionServer.java:832)
> at org.apache.hadoop.hbase.regionserver.HRegionServer.convertThrowableToIOE(HRegionServer.java:822)
> at org.apache.hadoop.hbase.regionserver.HRegionServer.put(HRegionServer.java:1775)
> at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:643)
> at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:913)
> Caused by: java.lang.NullPointerException
> at java.util.concurrent.ConcurrentHashMap$Segment.put(ConcurrentHashMap.java:426)
> at java.util.concurrent.ConcurrentHashMap.put(ConcurrentHashMap.java:883)
> at org.apache.hadoop.hbase.regionserver.HRegion.obtainRowLock(HRegion.java:1557)
> at org.apache.hadoop.hbase.regionserver.HRegion.getLock(HRegion.java:1610)
> at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:1225)
> at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:1197)
> at org.apache.hadoop.hbase.regionserver.HRegionServer.put(HRegionServer.java:1768)
> ... 5 more
> 2009-06-19 20:13:55,672 ERROR org.apache.hadoop.hbase.regionserver.HRegionServer: java.lang.NullPointerException
> 2009-06-19 20:13:55,672 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 5 on 60020, call put([B@3160e069, [Lorg.apache.hadoop.hbase.client.Put;@4f2d26d2) from 10.10.20.226
> :38741: error: java.io.IOException: java.lang.NullPointerException
> java.io.IOException: java.lang.NullPointerException
> at org.apache.hadoop.hbase.regionserver.HRegionServer.convertThrowableToIOE(HRegionServer.java:832)
> at org.apache.hadoop.hbase.regionserver.HRegionServer.convertThrowableToIOE(HRegionServer.java:822)
> at org.apache.hadoop.hbase.regionserver.HRegionServer.put(HRegionServer.java:1775)
> at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:643)
> at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:913)
> Caused by: java.lang.NullPointerException
> at java.util.concurrent.ConcurrentHashMap$Segment.put(ConcurrentHashMap.java:426)
> at java.util.concurrent.ConcurrentHashMap.put(ConcurrentHashMap.java:883)
> at org.apache.hadoop.hbase.regionserver.HRegion.obtainRowLock(HRegion.java:1557)
> at org.apache.hadoop.hbase.regionserver.HRegion.getLock(HRegion.java:1610)
> at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:1225)
> at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:1197)
> at org.apache.hadoop.hbase.regionserver.HRegionServer.put(HRegionServer.java:1768)
> ... 5 more
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HBASE-1555) some java "concurrent" structures
may not be so much after all!
Posted by "Andrew Purtell (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12722220#action_12722220 ]
Andrew Purtell commented on HBASE-1555:
---------------------------------------
Replace with a synchronized HashMap - {{Collections.synchronizedHashMap(...)}}? What version of JRE/JDK? I'd like to see what is at ConcurrentHashMap.java:426.
> some java "concurrent" structures may not be so much after all!
> ---------------------------------------------------------------
>
> Key: HBASE-1555
> URL: https://issues.apache.org/jira/browse/HBASE-1555
> Project: Hadoop HBase
> Issue Type: Bug
> Affects Versions: 0.20.0
> Reporter: ryan rawson
> Fix For: 0.20.0
>
>
> during a huge import (high concurrenty, 56 writers) I have seen:
> java.io.IOException: java.lang.NullPointerException
> at org.apache.hadoop.hbase.regionserver.HRegionServer.convertThrowableToIOE(HRegionServer.java:832)
> at org.apache.hadoop.hbase.regionserver.HRegionServer.convertThrowableToIOE(HRegionServer.java:822)
> at org.apache.hadoop.hbase.regionserver.HRegionServer.put(HRegionServer.java:1775)
> at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:643)
> at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:913)
> Caused by: java.lang.NullPointerException
> at java.util.concurrent.ConcurrentHashMap$Segment.put(ConcurrentHashMap.java:426)
> at java.util.concurrent.ConcurrentHashMap.put(ConcurrentHashMap.java:883)
> at org.apache.hadoop.hbase.regionserver.HRegion.obtainRowLock(HRegion.java:1557)
> at org.apache.hadoop.hbase.regionserver.HRegion.getLock(HRegion.java:1610)
> at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:1225)
> at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:1197)
> at org.apache.hadoop.hbase.regionserver.HRegionServer.put(HRegionServer.java:1768)
> ... 5 more
> 2009-06-19 20:13:55,672 ERROR org.apache.hadoop.hbase.regionserver.HRegionServer: java.lang.NullPointerException
> 2009-06-19 20:13:55,672 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server handler 5 on 60020, call put([B@3160e069, [Lorg.apache.hadoop.hbase.client.Put;@4f2d26d2) from 10.10.20.226
> :38741: error: java.io.IOException: java.lang.NullPointerException
> java.io.IOException: java.lang.NullPointerException
> at org.apache.hadoop.hbase.regionserver.HRegionServer.convertThrowableToIOE(HRegionServer.java:832)
> at org.apache.hadoop.hbase.regionserver.HRegionServer.convertThrowableToIOE(HRegionServer.java:822)
> at org.apache.hadoop.hbase.regionserver.HRegionServer.put(HRegionServer.java:1775)
> at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:643)
> at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:913)
> Caused by: java.lang.NullPointerException
> at java.util.concurrent.ConcurrentHashMap$Segment.put(ConcurrentHashMap.java:426)
> at java.util.concurrent.ConcurrentHashMap.put(ConcurrentHashMap.java:883)
> at org.apache.hadoop.hbase.regionserver.HRegion.obtainRowLock(HRegion.java:1557)
> at org.apache.hadoop.hbase.regionserver.HRegion.getLock(HRegion.java:1610)
> at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:1225)
> at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:1197)
> at org.apache.hadoop.hbase.regionserver.HRegionServer.put(HRegionServer.java:1768)
> ... 5 more
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.