You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by Walter Underwood <wu...@wunderwood.org> on 2019/04/11 17:46:47 UTC

Can replicas retry for a longer time?

We had a bad situation with our prod cluster. There was a DNS failure in AWS and all the replicas went “brown”. Only the leaders were taking traffic.

If the replicas had continued to attempt recovery every five minutes or so, they would have come back online automatically.

Is there a way to configure that?

wunder
Walter Underwood
wunder@wunderwood.org
http://observer.wunderwood.org/  (my blog)


Re: Can replicas retry for a longer time?

Posted by Shalin Shekhar Mangar <sh...@gmail.com>.
Assuming this is SolrCloud, the replicas retry upto 500 times and wait an
exponentially increasing time between retries starting from 2 seconds and
upto a minute. Did that not happen in your case? Did the JVM had DNS ttls
set?

On Sun, Apr 28, 2019 at 7:51 PM Walter Underwood <wu...@wunderwood.org>
wrote:

> Hello! Any response on this?
>
> wunder
> Walter Underwood
> wunder@wunderwood.org
> http://observer.wunderwood.org/  (my blog)
>
> > On Apr 11, 2019, at 7:46 PM, Walter Underwood <wu...@wunderwood.org>
> wrote:
> >
> > We had a bad situation with our prod cluster. There was a DNS failure in
> AWS and all the replicas went “brown”. Only the leaders were taking traffic.
> >
> > If the replicas had continued to attempt recovery every five minutes or
> so, they would have come back online automatically.
> >
> > Is there a way to configure that?
> >
> > wunder
> > Walter Underwood
> > wunder@wunderwood.org
> > http://observer.wunderwood.org/  (my blog)
> >
>
>

-- 
Regards,
Shalin Shekhar Mangar.

Re: Can replicas retry for a longer time?

Posted by Walter Underwood <wu...@wunderwood.org>.
Hello! Any response on this?

wunder
Walter Underwood
wunder@wunderwood.org
http://observer.wunderwood.org/  (my blog)

> On Apr 11, 2019, at 7:46 PM, Walter Underwood <wu...@wunderwood.org> wrote:
> 
> We had a bad situation with our prod cluster. There was a DNS failure in AWS and all the replicas went “brown”. Only the leaders were taking traffic.
> 
> If the replicas had continued to attempt recovery every five minutes or so, they would have come back online automatically.
> 
> Is there a way to configure that?
> 
> wunder
> Walter Underwood
> wunder@wunderwood.org
> http://observer.wunderwood.org/  (my blog)
>