You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@cassandra.apache.org by "Tupshin Harper (JIRA)" <ji...@apache.org> on 2013/10/01 23:20:26 UTC

[jira] [Created] (CASSANDRA-6127) vnodes don't scale to hundreds of nodes

Tupshin Harper created CASSANDRA-6127:
-----------------------------------------

             Summary: vnodes don't scale to hundreds of nodes
                 Key: CASSANDRA-6127
                 URL: https://issues.apache.org/jira/browse/CASSANDRA-6127
             Project: Cassandra
          Issue Type: Bug
          Components: Core
         Environment: Any cluster that has vnodes and consists of hundreds of physical nodes.
            Reporter: Tupshin Harper
            Assignee: Jonathan Ellis


There are a lot of gossip-related issues related to very wide clusters that also have vnodes enabled. Let's use this ticket as a master in case there are sub-tickets.

The most obvious symptom I've seen is with 1000 nodes in EC2 with m1.xlarge instances. Each node configured with 32 vnodes.

Without vnodes, cluster spins up fine and is ready to handle requests within 30 minutes or less. 

With vnodes, nodes are reporting constant up/down flapping messages with no external load on the cluster. After a couple of hours, they were still flapping, had very high cpu load, and the cluster never looked like it was going to stabilize or be useful for traffic.



--
This message was sent by Atlassian JIRA
(v6.1#6144)