You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cassandra.apache.org by "Jason Harvey (JIRA)" <ji...@apache.org> on 2012/06/28 01:33:42 UTC
[jira] [Created] (CASSANDRA-4387) Multiple RPC threads waiting on a
single thread
Jason Harvey created CASSANDRA-4387:
---------------------------------------
Summary: Multiple RPC threads waiting on a single thread
Key: CASSANDRA-4387
URL: https://issues.apache.org/jira/browse/CASSANDRA-4387
Project: Cassandra
Issue Type: Bug
Affects Versions: 1.0.7
Environment: sun java 6.24
Reporter: Jason Harvey
Priority: Minor
Attachments: output.log
I'm investigating a load spike issue on our cluster. A thread dump that I collected during a spike shows a peculiar symptom. There are 162 RPC threads all parked waiting on a single java.util.concurrent.SynchronousQueue$TransferStack thread. Brandon took a peek and recommended I create a ticket for investigation.
Full thread dump attached. The thread which is being waited on is 0x00000006ac1aba60.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Comment Edited] (CASSANDRA-4387) Multiple RPC threads
waiting on a single thread
Posted by "Jason Harvey (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-4387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13402665#comment-13402665 ]
Jason Harvey edited comment on CASSANDRA-4387 at 6/27/12 11:33 PM:
-------------------------------------------------------------------
Full thread dump attached.
was (Author: alienth):
Full thread dump.
> Multiple RPC threads waiting on a single thread
> -----------------------------------------------
>
> Key: CASSANDRA-4387
> URL: https://issues.apache.org/jira/browse/CASSANDRA-4387
> Project: Cassandra
> Issue Type: Bug
> Affects Versions: 1.0.7
> Environment: sun java 6.24
> Reporter: Jason Harvey
> Priority: Minor
> Attachments: output.log
>
>
> I'm investigating a load spike issue on our cluster. A thread dump that I collected during a spike shows a peculiar symptom. There are 162 RPC threads all parked waiting on a single java.util.concurrent.SynchronousQueue$TransferStack thread. Brandon took a peek and recommended I create a ticket for investigation.
> Full thread dump attached. The thread which is being waited on is 0x00000006ac1aba60.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (CASSANDRA-4387) Multiple RPC threads waiting on
a single thread
Posted by "Jonathan Ellis (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-4387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13402686#comment-13402686 ]
Jonathan Ellis commented on CASSANDRA-4387:
-------------------------------------------
Odd. Sounds like a problem with SynchronousQueue internals to me. Only thing I could suggest trying is replacing it (in AbstractCassandraDaemon) with the java7 TransferQueue, which is supposed to be significantly more performant.
http://docs.oracle.com/javase/7/docs/api/java/util/concurrent/TransferQueue.html
> Multiple RPC threads waiting on a single thread
> -----------------------------------------------
>
> Key: CASSANDRA-4387
> URL: https://issues.apache.org/jira/browse/CASSANDRA-4387
> Project: Cassandra
> Issue Type: Bug
> Affects Versions: 1.0.7
> Environment: sun java 6.24
> Reporter: Jason Harvey
> Priority: Minor
> Attachments: output.log
>
>
> I'm investigating a load spike issue on our cluster. A thread dump that I collected during a spike shows a peculiar symptom. There are 162 RPC threads all parked waiting on a single java.util.concurrent.SynchronousQueue$TransferStack thread. Brandon took a peek and recommended I create a ticket for investigation.
> Full thread dump attached. The thread which is being waited on is 0x00000006ac1aba60.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (CASSANDRA-4387) Multiple RPC threads waiting on a
single thread
Posted by "Jason Harvey (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CASSANDRA-4387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jason Harvey updated CASSANDRA-4387:
------------------------------------
Attachment: output.log
Full thread dump.
> Multiple RPC threads waiting on a single thread
> -----------------------------------------------
>
> Key: CASSANDRA-4387
> URL: https://issues.apache.org/jira/browse/CASSANDRA-4387
> Project: Cassandra
> Issue Type: Bug
> Affects Versions: 1.0.7
> Environment: sun java 6.24
> Reporter: Jason Harvey
> Priority: Minor
> Attachments: output.log
>
>
> I'm investigating a load spike issue on our cluster. A thread dump that I collected during a spike shows a peculiar symptom. There are 162 RPC threads all parked waiting on a single java.util.concurrent.SynchronousQueue$TransferStack thread. Brandon took a peek and recommended I create a ticket for investigation.
> Full thread dump attached. The thread which is being waited on is 0x00000006ac1aba60.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira