You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@cassandra.apache.org by Batranut Bogdan <ba...@yahoo.com> on 2015/02/12 12:20:00 UTC
Added new nodes to cluster but no streams
Hello,
I have added new nodes to the existing cluster. In Opscenter I do not see any streams... I presume that the new nodes get the data from the rest of the cluster via streams. The existing cluster has TB magnitude, and space used in the new nodes is ~90 GB. I must admit that I have restarted the new nodes several times after adding them . Does this affect boostrap? AFAIK the new nodes should start loading a part of all the data in the existing cluster.
Is this normal?
Re: Added new nodes to cluster but no streams
Posted by Batranut Bogdan <ba...@yahoo.com>.
Got it, thank you very much.
On Friday, February 13, 2015 4:04 PM, Jens Rantil <je...@tink.se> wrote:
Hi Bastranut,
A few minutes between each node will do.
Cheers,Jens
On Fri, Feb 13, 2015 at 1:12 PM, Batranut Bogdan <ba...@yahoo.com> wrote:
Hello,
When adding a new node to the cluster I need to wait for each node to receive all the data from other nodes in the cluster or just wait a few minutes before I start each node?
On Thursday, February 12, 2015 7:21 PM, Robert Coli <rc...@eventbrite.com> wrote:
On Thu, Feb 12, 2015 at 3:20 AM, Batranut Bogdan <ba...@yahoo.com> wrote:
I have added new nodes to the existing cluster. In Opscenter I do not see any streams... I presume that the new nodes get the data from the rest of the cluster via streams. The existing cluster has TB magnitude, and space used in the new nodes is ~90 GB. I must admit that I have restarted the new nodes several times after adding them . Does this affect boostrap? AFAIK the new nodes should start loading a part of all the data in the existing cluster.
If it stays like this for a while, it sounds like your bootstraps have hung. Note that in general you should add nodes one at a time, especially if you are in a version without the fix for CASSANDRA-2434, in theory adding multiple nodes "at once" might contribute to their bootstraps hanging.
Stop cassandra on the joining nodes, wipe/move aside their data directories, and try again one at a time.
=Rob
--
Jens RantilBackend engineerTink AB
Email: jens.rantil@tink.sePhone: +46 708 84 18 32Web: www.tink.se
Facebook Linkedin Twitter
Re: Added new nodes to cluster but no streams
Posted by Jens Rantil <je...@tink.se>.
Hi Bastranut,
A few minutes between each node will do.
Cheers,
Jens
On Fri, Feb 13, 2015 at 1:12 PM, Batranut Bogdan <ba...@yahoo.com> wrote:
> Hello,
>
> When adding a new node to the cluster I need to wait for each node to
> receive all the data from other nodes in the cluster or just wait a few
> minutes before I start each node?
>
>
>
> On Thursday, February 12, 2015 7:21 PM, Robert Coli <
> rcoli@eventbrite.com> wrote:
>
>
> On Thu, Feb 12, 2015 at 3:20 AM, Batranut Bogdan <ba...@yahoo.com>
> wrote:
>
> I have added new nodes to the existing cluster. In Opscenter I do not see
> any streams... I presume that the new nodes get the data from the rest of
> the cluster via streams. The existing cluster has TB magnitude, and space
> used in the new nodes is ~90 GB. I must admit that I have restarted the new
> nodes several times after adding them . Does this affect boostrap? AFAIK
> the new nodes should start loading a part of all the data in the existing
> cluster.
>
>
> If it stays like this for a while, it sounds like your bootstraps have
> hung. Note that in general you should add nodes one at a time, especially
> if you are in a version without the fix for CASSANDRA-2434, in theory
> adding multiple nodes "at once" might contribute to their bootstraps
> hanging.
>
> Stop cassandra on the joining nodes, wipe/move aside their data
> directories, and try again one at a time.
>
> =Rob
>
>
>
>
>
>
--
Jens Rantil
Backend engineer
Tink AB
Email: jens.rantil@tink.se
Phone: +46 708 84 18 32
Web: www.tink.se
Facebook <https://www.facebook.com/#!/tink.se> Linkedin
<http://www.linkedin.com/company/2735919?trk=vsrp_companies_res_photo&trkInfo=VSRPsearchId%3A1057023381369207406670%2CVSRPtargetId%3A2735919%2CVSRPcmpt%3Aprimary>
Twitter <https://twitter.com/tink>
Re: Added new nodes to cluster but no streams
Posted by Batranut Bogdan <ba...@yahoo.com>.
Hello,
When adding a new node to the cluster I need to wait for each node to receive all the data from other nodes in the cluster or just wait a few minutes before I start each node?
On Thursday, February 12, 2015 7:21 PM, Robert Coli <rc...@eventbrite.com> wrote:
On Thu, Feb 12, 2015 at 3:20 AM, Batranut Bogdan <ba...@yahoo.com> wrote:
I have added new nodes to the existing cluster. In Opscenter I do not see any streams... I presume that the new nodes get the data from the rest of the cluster via streams. The existing cluster has TB magnitude, and space used in the new nodes is ~90 GB. I must admit that I have restarted the new nodes several times after adding them . Does this affect boostrap? AFAIK the new nodes should start loading a part of all the data in the existing cluster.
If it stays like this for a while, it sounds like your bootstraps have hung. Note that in general you should add nodes one at a time, especially if you are in a version without the fix for CASSANDRA-2434, in theory adding multiple nodes "at once" might contribute to their bootstraps hanging.
Stop cassandra on the joining nodes, wipe/move aside their data directories, and try again one at a time.
=Rob
Re: Added new nodes to cluster but no streams
Posted by Robert Coli <rc...@eventbrite.com>.
On Thu, Feb 12, 2015 at 3:20 AM, Batranut Bogdan <ba...@yahoo.com> wrote:
> I have added new nodes to the existing cluster. In Opscenter I do not see
> any streams... I presume that the new nodes get the data from the rest of
> the cluster via streams. The existing cluster has TB magnitude, and space
> used in the new nodes is ~90 GB. I must admit that I have restarted the new
> nodes several times after adding them . Does this affect boostrap? AFAIK
> the new nodes should start loading a part of all the data in the existing
> cluster.
>
If it stays like this for a while, it sounds like your bootstraps have
hung. Note that in general you should add nodes one at a time, especially
if you are in a version without the fix for CASSANDRA-2434, in theory
adding multiple nodes "at once" might contribute to their bootstraps
hanging.
Stop cassandra on the joining nodes, wipe/move aside their data
directories, and try again one at a time.
=Rob