回复： Tuning bootstrap new node

[Peng Xiao <25...@qq.com>]

We noticed that streaming will take about 10 hours,all the left is compaction,we will improve  concurrent_compactors first.


Thanks all for your reply.




------------------ 原始邮件 ------------------
发件人: "Jon Haddad";<jo...@jonhaddad.com>;
发送时间: 2017年11月1日(星期三) 凌晨4:06
收件人: "user"<us...@cassandra.apache.org>;

主题: Re: Tuning bootstrap new node



Of all the settings you could change, why one that’s related to memtables?  Streaming doesn’t go through the write path, memtables aren’t involved unless you’re using materialized views or CDC.

On Oct 31, 2017, at 11:44 AM, Anubhav Kale <An...@microsoft.com.INVALID> wrote:

You can change YAML setting of memtable_cleanup_threshold to 0.7 (from the default of 0.3). This will push SSTables to disk less often and will reduce the compaction time.
 
While this won’t change the streaming time, it will reduce the overall time for your node to be healthy.
 
From: Harikrishnan Pillai [mailto:HPillai@walmartlabs.com] 
Sent: Tuesday, October 31, 2017 11:28 AM
To: user@cassandra.apache.org
Subject: Re: Re: Tuning bootstrap new node


 

There is no magic in speeding up the node addition other than increasing stream throughput and compaction throughput.

it has been noticed that with heavy compactions the latency may go up if the node also start serving data.

if you really don't want  this node to service traffic till all compactions settle down, you can disable gossip and binary protocol using the nodetool command. This will allow compactions to continue but requires a repair to fix the stale data later.

Regards

Hari

 


From: Nitan Kainth <ni...@gmail.com>
Sent: Tuesday, October 31, 2017 5:47 AM
To: user@cassandra.apache.org
Subject: EXT: Re: Tuning bootstrap new node
 


Do not stop compaction, you will end up with thousands of sstables.
 


You increase stream throughput from default 200 to a heifer value if your network can handle it.
Sent from my iPhone



On Oct 31, 2017, at 6:35 AM, Peng Xiao <25...@qq.com> wrote:

Can we stop the compaction during the new node bootstraping and enable it after the new node joined?

 

Thanks

------------------ Original ------------------

From:  "我自己的邮箱";<25...@qq.com>;

Date:  Tue, Oct 31, 2017 07:18 PM

To:  "user"<us...@cassandra.apache.org>;

Subject:  Tuning bootstrap new node


 

Dear All,
 

Can we make some tuning to make bootstrap new node more quick?We have a three DC cluster(RF=3 in two DCs,RF=1 in another ,48 nodes in the DC with RF=3).As the Cluster is becoming larger and larger,we need to spend more than 24 hours to bootstrap a new node.

Could you please advise how to tune this ?

 

Many Thanks,

Peng Xiao