You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@cassandra.apache.org by Mike Subelsky <mi...@subelsky.com> on 2010/06/04 23:27:51 UTC
strange load balancing across three nodes
Hello everyone,
One of my nodes has a much higher load (10x) than the other two nodes.
I don't think it's because a few keys have a lot more columns than
others -- the keys are well distributed and I'm using the random
partitioner.
Could someone point me in the direction of what should I be checking
for in a situation like this? I don't totally understand what the
range value represents below but I feel like that be must a clue. I
know I can run loadbalance here but I want to address the underlying
problem that caused the imbalance in the first place.
Address Status Load Range
Ring
152603206199102353627433717890579536149
10.198.7.47 Up 95.8 MB
2178153229901630557148545713417876599 |<--|
10.210.239.191Up 1.09 GB
129781355096377133235068186455049349192 | |
10.193.210.192Up 125.44 MB
152603206199102353627433717890579536149 |-->|
thanks!
-Mike
--
Mike Subelsky
oib.com // ignitebaltimore.com // subelsky.com
@subelsky
Re: strange load balancing across three nodes
Posted by Mike Subelsky <mi...@subelsky.com>.
Ahh, I think this is the key section I missed:
"you can still have imbalances if your Tokens do not divide up the
range evenly, so you should specify InitialToken to your first nodes
as i * (2**127 / N) for i = 1 .. N."
I'm going to reset my cluster with initial tokens like that. Thanks!
-Mike
On Fri, Jun 4, 2010 at 8:10 PM, Jonathan Ellis <jb...@gmail.com> wrote:
> The sections on ring management and token selection on
> http://wiki.apache.org/cassandra/Operations will help.
>
> On Fri, Jun 4, 2010 at 2:27 PM, Mike Subelsky <mi...@subelsky.com> wrote:
>> Hello everyone,
>>
>> One of my nodes has a much higher load (10x) than the other two nodes.
>> I don't think it's because a few keys have a lot more columns than
>> others -- the keys are well distributed and I'm using the random
>> partitioner.
>>
>> Could someone point me in the direction of what should I be checking
>> for in a situation like this? I don't totally understand what the
>> range value represents below but I feel like that be must a clue. I
>> know I can run loadbalance here but I want to address the underlying
>> problem that caused the imbalance in the first place.
>>
>> Address Status Load Range
>> Ring
>>
>> 152603206199102353627433717890579536149
>> 10.198.7.47 Up 95.8 MB
>> 2178153229901630557148545713417876599 |<--|
>> 10.210.239.191Up 1.09 GB
>> 129781355096377133235068186455049349192 | |
>> 10.193.210.192Up 125.44 MB
>> 152603206199102353627433717890579536149 |-->|
>>
>> thanks!
>>
>> -Mike
>>
>> --
>> Mike Subelsky
>> oib.com // ignitebaltimore.com // subelsky.com
>> @subelsky
>>
>
>
>
> --
> Jonathan Ellis
> Project Chair, Apache Cassandra
> co-founder of Riptano, the source for professional Cassandra support
> http://riptano.com
>
--
Mike Subelsky
oib.com // ignitebaltimore.com // subelsky.com
@subelsky
Re: strange load balancing across three nodes
Posted by Jonathan Ellis <jb...@gmail.com>.
The sections on ring management and token selection on
http://wiki.apache.org/cassandra/Operations will help.
On Fri, Jun 4, 2010 at 2:27 PM, Mike Subelsky <mi...@subelsky.com> wrote:
> Hello everyone,
>
> One of my nodes has a much higher load (10x) than the other two nodes.
> I don't think it's because a few keys have a lot more columns than
> others -- the keys are well distributed and I'm using the random
> partitioner.
>
> Could someone point me in the direction of what should I be checking
> for in a situation like this? I don't totally understand what the
> range value represents below but I feel like that be must a clue. I
> know I can run loadbalance here but I want to address the underlying
> problem that caused the imbalance in the first place.
>
> Address Status Load Range
> Ring
>
> 152603206199102353627433717890579536149
> 10.198.7.47 Up 95.8 MB
> 2178153229901630557148545713417876599 |<--|
> 10.210.239.191Up 1.09 GB
> 129781355096377133235068186455049349192 | |
> 10.193.210.192Up 125.44 MB
> 152603206199102353627433717890579536149 |-->|
>
> thanks!
>
> -Mike
>
> --
> Mike Subelsky
> oib.com // ignitebaltimore.com // subelsky.com
> @subelsky
>
--
Jonathan Ellis
Project Chair, Apache Cassandra
co-founder of Riptano, the source for professional Cassandra support
http://riptano.com