You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Mark Miller (Created) (JIRA)" <ji...@apache.org> on 2012/02/12 02:40:59 UTC

[jira] [Created] (SOLR-3126) We should try to do a quick sync on std start up recovery before trying to do a full blown replication.

We should try to do a quick sync on std start up recovery before trying to do a full blown replication.
-------------------------------------------------------------------------------------------------------

                 Key: SOLR-3126
                 URL: https://issues.apache.org/jira/browse/SOLR-3126
             Project: Solr
          Issue Type: Improvement
          Components: SolrCloud
            Reporter: Mark Miller
            Assignee: Mark Miller
             Fix For: 4.0


just more efficient - especially on cluster shutdown/start where the replicas may all be up to date and match anway.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[jira] [Updated] (SOLR-3126) We should try to do a quick sync on std start up recovery before trying to do a full blown replication.

Posted by "Mark Miller (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/SOLR-3126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Mark Miller updated SOLR-3126:
------------------------------

    Attachment: SOLR-3126.patch

Current WIP.

Still trying to track down an issue around FullSolrCloudTest#brindDownShardIndexSomeDocsAndRecover
                
> We should try to do a quick sync on std start up recovery before trying to do a full blown replication.
> -------------------------------------------------------------------------------------------------------
>
>                 Key: SOLR-3126
>                 URL: https://issues.apache.org/jira/browse/SOLR-3126
>             Project: Solr
>          Issue Type: Improvement
>          Components: SolrCloud
>            Reporter: Mark Miller
>            Assignee: Mark Miller
>             Fix For: 4.0
>
>         Attachments: SOLR-3126.patch
>
>
> just more efficient - especially on cluster shutdown/start where the replicas may all be up to date and match anway.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[jira] [Reopened] (SOLR-3126) We should try to do a quick sync on std start up recovery before trying to do a full blown replication.

Posted by "Mark Miller (Reopened) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/SOLR-3126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Mark Miller reopened SOLR-3126:
-------------------------------


Actually I should probably do one more thing here - wait to start sync until we are sure the leader sees as recovering.
                
> We should try to do a quick sync on std start up recovery before trying to do a full blown replication.
> -------------------------------------------------------------------------------------------------------
>
>                 Key: SOLR-3126
>                 URL: https://issues.apache.org/jira/browse/SOLR-3126
>             Project: Solr
>          Issue Type: Improvement
>          Components: SolrCloud
>            Reporter: Mark Miller
>            Assignee: Mark Miller
>             Fix For: 4.0
>
>         Attachments: SOLR-3126.patch
>
>
> just more efficient - especially on cluster shutdown/start where the replicas may all be up to date and match anway.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[jira] [Commented] (SOLR-3126) We should try to do a quick sync on std start up recovery before trying to do a full blown replication.

Posted by "Mark Miller (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/SOLR-3126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13210967#comment-13210967 ] 

Mark Miller commented on SOLR-3126:
-----------------------------------

Hmm...somehow this has made regular replication recovery unstable in some situations (fairly often on apache jenkins, less often locally)...trying to figure out where/how.
                
> We should try to do a quick sync on std start up recovery before trying to do a full blown replication.
> -------------------------------------------------------------------------------------------------------
>
>                 Key: SOLR-3126
>                 URL: https://issues.apache.org/jira/browse/SOLR-3126
>             Project: Solr
>          Issue Type: Improvement
>          Components: SolrCloud
>            Reporter: Mark Miller
>            Assignee: Mark Miller
>             Fix For: 4.0
>
>         Attachments: SOLR-3126.patch, SOLR-3126.patch
>
>
> just more efficient - especially on cluster shutdown/start where the replicas may all be up to date and match anway.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[jira] [Resolved] (SOLR-3126) We should try to do a quick sync on std start up recovery before trying to do a full blown replication.

Posted by "Mark Miller (Resolved) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/SOLR-3126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Mark Miller resolved SOLR-3126.
-------------------------------

    Resolution: Fixed
    
> We should try to do a quick sync on std start up recovery before trying to do a full blown replication.
> -------------------------------------------------------------------------------------------------------
>
>                 Key: SOLR-3126
>                 URL: https://issues.apache.org/jira/browse/SOLR-3126
>             Project: Solr
>          Issue Type: Improvement
>          Components: SolrCloud
>            Reporter: Mark Miller
>            Assignee: Mark Miller
>             Fix For: 4.0
>
>         Attachments: SOLR-3126.patch, SOLR-3126.patch
>
>
> just more efficient - especially on cluster shutdown/start where the replicas may all be up to date and match anway.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[jira] [Updated] (SOLR-3126) We should try to do a quick sync on std start up recovery before trying to do a full blown replication.

Posted by "Mark Miller (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/SOLR-3126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Mark Miller updated SOLR-3126:
------------------------------

    Attachment: SOLR-3126.patch

path for this - I stop committing in the prep recovery cmd so that it can be used also in the sync case - in the replicate case, we do a prep recovery cmd then an explicit commit
                
> We should try to do a quick sync on std start up recovery before trying to do a full blown replication.
> -------------------------------------------------------------------------------------------------------
>
>                 Key: SOLR-3126
>                 URL: https://issues.apache.org/jira/browse/SOLR-3126
>             Project: Solr
>          Issue Type: Improvement
>          Components: SolrCloud
>            Reporter: Mark Miller
>            Assignee: Mark Miller
>             Fix For: 4.0
>
>         Attachments: SOLR-3126.patch, SOLR-3126.patch
>
>
> just more efficient - especially on cluster shutdown/start where the replicas may all be up to date and match anway.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[jira] [Commented] (SOLR-3126) We should try to do a quick sync on std start up recovery before trying to do a full blown replication.

Posted by "Mark Miller (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/SOLR-3126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13207897#comment-13207897 ] 

Mark Miller commented on SOLR-3126:
-----------------------------------

Whoops - was not building the leader url correctly - fixed. I'll commit this soon.
                
> We should try to do a quick sync on std start up recovery before trying to do a full blown replication.
> -------------------------------------------------------------------------------------------------------
>
>                 Key: SOLR-3126
>                 URL: https://issues.apache.org/jira/browse/SOLR-3126
>             Project: Solr
>          Issue Type: Improvement
>          Components: SolrCloud
>            Reporter: Mark Miller
>            Assignee: Mark Miller
>             Fix For: 4.0
>
>         Attachments: SOLR-3126.patch
>
>
> just more efficient - especially on cluster shutdown/start where the replicas may all be up to date and match anway.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[jira] [Commented] (SOLR-3126) We should try to do a quick sync on std start up recovery before trying to do a full blown replication.

Posted by "Mark Miller (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/SOLR-3126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13211017#comment-13211017 ] 

Mark Miller commented on SOLR-3126:
-----------------------------------

I *think* ive made some progress on tracking this down. It looks like perhaps the 4 second wait we do to make sure no updates are still finishing that started seeing stale state might not be long enough after some stuff was rearranged. Boosting that wait is getting me better results - still testing though.
                
> We should try to do a quick sync on std start up recovery before trying to do a full blown replication.
> -------------------------------------------------------------------------------------------------------
>
>                 Key: SOLR-3126
>                 URL: https://issues.apache.org/jira/browse/SOLR-3126
>             Project: Solr
>          Issue Type: Improvement
>          Components: SolrCloud
>            Reporter: Mark Miller
>            Assignee: Mark Miller
>             Fix For: 4.0
>
>         Attachments: SOLR-3126.patch, SOLR-3126.patch
>
>
> just more efficient - especially on cluster shutdown/start where the replicas may all be up to date and match anway.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[jira] [Resolved] (SOLR-3126) We should try to do a quick sync on std start up recovery before trying to do a full blown replication.

Posted by "Mark Miller (Resolved) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/SOLR-3126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Mark Miller resolved SOLR-3126.
-------------------------------

    Resolution: Fixed

Alright, this is in.
                
> We should try to do a quick sync on std start up recovery before trying to do a full blown replication.
> -------------------------------------------------------------------------------------------------------
>
>                 Key: SOLR-3126
>                 URL: https://issues.apache.org/jira/browse/SOLR-3126
>             Project: Solr
>          Issue Type: Improvement
>          Components: SolrCloud
>            Reporter: Mark Miller
>            Assignee: Mark Miller
>             Fix For: 4.0
>
>         Attachments: SOLR-3126.patch
>
>
> just more efficient - especially on cluster shutdown/start where the replicas may all be up to date and match anway.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org