You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cassandra.apache.org by "Sumanth Pasupuleti (JIRA)" <ji...@apache.org> on 2019/06/27 07:13:00 UTC
[jira] [Comment Edited] (CASSANDRA-15013) Message Flusher queue can
grow unbounded, potentially running JVM out of memory
[ https://issues.apache.org/jira/browse/CASSANDRA-15013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16873870#comment-16873870 ]
Sumanth Pasupuleti edited comment on CASSANDRA-15013 at 6/27/19 7:12 AM:
-------------------------------------------------------------------------
+1 on the suggestions [~benedict]. I have applied your commit on my [branch|https://github.com/sumanth-pasupuleti/cassandra/commits/15013_trunk_2] and ran the tests.
UTs and JVM DTests pass. All Dtests pass except for 6 failures which seem unrelated.
https://circleci.com/workflow-run/04b77dd7-7dca-49d4-8328-e55b357fcca6
was (Author: sumanth.pasupuleti):
+1 on the suggestions [~benedict]. I have applied your commit on my branch and ran the tests.
UTs and JVM DTests pass. All Dtests pass except for 6 failures which seem unrelated.
https://circleci.com/workflow-run/04b77dd7-7dca-49d4-8328-e55b357fcca6
> Message Flusher queue can grow unbounded, potentially running JVM out of memory
> -------------------------------------------------------------------------------
>
> Key: CASSANDRA-15013
> URL: https://issues.apache.org/jira/browse/CASSANDRA-15013
> Project: Cassandra
> Issue Type: Bug
> Components: Messaging/Client
> Reporter: Sumanth Pasupuleti
> Assignee: Sumanth Pasupuleti
> Priority: Normal
> Labels: pull-request-available
> Fix For: 4.0, 3.0.x, 3.11.x
>
> Attachments: BlockedEpollEventLoopFromHeapDump.png, BlockedEpollEventLoopFromThreadDump.png, RequestExecutorQueueFull.png, heap dump showing each ImmediateFlusher taking upto 600MB.png
>
>
> This is a follow-up ticket out of CASSANDRA-14855, to make the Flusher queue bounded, since, in the current state, items get added to the queue without any checks on queue size, nor with any checks on netty outbound buffer to check the isWritable state.
> We are seeing this issue hit our production 3.0 clusters quite often.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cassandra.apache.org
For additional commands, e-mail: commits-help@cassandra.apache.org