You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@cassandra.apache.org by sai krishnam raju potturi <ps...@gmail.com> on 2015/08/28 20:32:30 UTC

Re : Decommissioned node appears in logs, and is sometimes marked as "UNREACHEABLE" in `nodetool describecluster`

hi;
    we decommissioned nodes in a datacenter a while back. Those nodes keep
showing up in the logs, and also sometimes marked as UNREACHABLE when
`nodetool describecluster` is run.

        However these nodes do not show up in `nodetool status` and
`nodetool ring`.

Below are a couple lines from the logs.

2015-08-27 04:38:16,180 [GossipStage:473] INFO Gossiper InetAddress /
10.0.0.1 is now DOWN
2015-08-27 04:38:16,183 [GossipStage:473] INFO StorageService Removing
tokens [85070591730234615865843651857942052865] for /10.0.0.1

thanks
Sai

Re: Re : Decommissioned node appears in logs, and is sometimes marked as "UNREACHEABLE" in `nodetool describecluster`

Posted by Sebastian Estevez <se...@datastax.com>.
Are they in the system.peers table?
On Aug 28, 2015 4:21 PM, "sai krishnam raju potturi" <ps...@gmail.com>
wrote:

> We are using DSE on our clusters.
>
> DSE version : 4.6.7
> Cassandra version : 2.0.14
>
> thanks
> Sai Potturi
>
>
>
> On Fri, Aug 28, 2015 at 3:40 PM, Robert Coli <rc...@eventbrite.com> wrote:
>
>> On Fri, Aug 28, 2015 at 11:32 AM, sai krishnam raju potturi <
>> pskraju88@gmail.com> wrote:
>>
>>>     we decommissioned nodes in a datacenter a while back. Those nodes
>>> keep showing up in the logs, and also sometimes marked as UNREACHABLE when
>>> `nodetool describecluster` is run.
>>>
>>
>> What version of Cassandra?
>>
>> This happens a lot in 1.0-2.0.
>>
>> =Rob
>>
>
>

Re: Re : Decommissioned node appears in logs, and is sometimes marked as "UNREACHEABLE" in `nodetool describecluster`

Posted by sai krishnam raju potturi <ps...@gmail.com>.
We are using DSE on our clusters.

DSE version : 4.6.7
Cassandra version : 2.0.14

thanks
Sai Potturi



On Fri, Aug 28, 2015 at 3:40 PM, Robert Coli <rc...@eventbrite.com> wrote:

> On Fri, Aug 28, 2015 at 11:32 AM, sai krishnam raju potturi <
> pskraju88@gmail.com> wrote:
>
>>     we decommissioned nodes in a datacenter a while back. Those nodes
>> keep showing up in the logs, and also sometimes marked as UNREACHABLE when
>> `nodetool describecluster` is run.
>>
>
> What version of Cassandra?
>
> This happens a lot in 1.0-2.0.
>
> =Rob
>

Re: Re : Decommissioned node appears in logs, and is sometimes marked as "UNREACHEABLE" in `nodetool describecluster`

Posted by Robert Coli <rc...@eventbrite.com>.
On Fri, Aug 28, 2015 at 11:32 AM, sai krishnam raju potturi <
pskraju88@gmail.com> wrote:

>     we decommissioned nodes in a datacenter a while back. Those nodes keep
> showing up in the logs, and also sometimes marked as UNREACHABLE when
> `nodetool describecluster` is run.
>

What version of Cassandra?

This happens a lot in 1.0-2.0.

=Rob

Re: Re : Decommissioned node appears in logs, and is sometimes marked as "UNREACHEABLE" in `nodetool describecluster`

Posted by Nate McCall <na...@thelastpickle.com>.
Do they show up in nodetool gossipinfo?

Either way, you probably need to invoke Gossiper.unsafeAssassinateEndpoints
via JMX as described in step 1 here:
http://docs.datastax.com/en/cassandra/2.0/cassandra/operations/ops_gossip_purge.html

On Fri, Aug 28, 2015 at 1:32 PM, sai krishnam raju potturi <
pskraju88@gmail.com> wrote:

> hi;
>     we decommissioned nodes in a datacenter a while back. Those nodes keep
> showing up in the logs, and also sometimes marked as UNREACHABLE when
> `nodetool describecluster` is run.
>
>         However these nodes do not show up in `nodetool status` and
> `nodetool ring`.
>
> Below are a couple lines from the logs.
>
> 2015-08-27 04:38:16,180 [GossipStage:473] INFO Gossiper InetAddress /
> 10.0.0.1 is now DOWN
> 2015-08-27 04:38:16,183 [GossipStage:473] INFO StorageService Removing
> tokens [85070591730234615865843651857942052865] for /10.0.0.1
>
> thanks
> Sai
>
>


-- 
-----------------
Nate McCall
Austin, TX
@zznate

Co-Founder & Sr. Technical Consultant
Apache Cassandra Consulting
http://www.thelastpickle.com