You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Yonik Seeley (JIRA)" <ji...@apache.org> on 2012/06/20 16:26:42 UTC
[jira] [Created] (SOLR-3559) handle deleteByQuery reorders in
distributed indexing
Yonik Seeley created SOLR-3559:
----------------------------------
Summary: handle deleteByQuery reorders in distributed indexing
Key: SOLR-3559
URL: https://issues.apache.org/jira/browse/SOLR-3559
Project: Solr
Issue Type: Improvement
Components: SolrCloud
Reporter: Yonik Seeley
We currently handle other update reorders (i.e. replica A may see update X then Y, and replica B may see update Y then X). deleteByQuery also needs to handle reorders to ensure replicas are consistent.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Commented] (SOLR-3559) handle deleteByQuery reorders in
distributed indexing
Posted by "Yonik Seeley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SOLR-3559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13401621#comment-13401621 ]
Yonik Seeley commented on SOLR-3559:
------------------------------------
Narrowing the issues down, the stress tests only fail with greater than 1 write thread in conjunction with realtime-get.
> handle deleteByQuery reorders in distributed indexing
> -----------------------------------------------------
>
> Key: SOLR-3559
> URL: https://issues.apache.org/jira/browse/SOLR-3559
> Project: Solr
> Issue Type: Improvement
> Components: SolrCloud
> Reporter: Yonik Seeley
> Assignee: Yonik Seeley
> Attachments: SOLR-3559.patch, SOLR-3559.patch, SOLR-3559.patch, SOLR-3559.patch
>
>
> We currently handle other update reorders (i.e. replica A may see update X then Y, and replica B may see update Y then X). deleteByQuery also needs to handle reorders to ensure replicas are consistent.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Assigned] (SOLR-3559) handle deleteByQuery reorders in
distributed indexing
Posted by "Yonik Seeley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SOLR-3559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Yonik Seeley reassigned SOLR-3559:
----------------------------------
Assignee: Yonik Seeley
> handle deleteByQuery reorders in distributed indexing
> -----------------------------------------------------
>
> Key: SOLR-3559
> URL: https://issues.apache.org/jira/browse/SOLR-3559
> Project: Solr
> Issue Type: Improvement
> Components: SolrCloud
> Reporter: Yonik Seeley
> Assignee: Yonik Seeley
>
> We currently handle other update reorders (i.e. replica A may see update X then Y, and replica B may see update Y then X). deleteByQuery also needs to handle reorders to ensure replicas are consistent.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Updated] (SOLR-3559) handle deleteByQuery reorders in
distributed indexing
Posted by "Yonik Seeley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SOLR-3559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Yonik Seeley updated SOLR-3559:
-------------------------------
Attachment: SOLR-3559.patch
Here's a draft patch... no tests yet.
> handle deleteByQuery reorders in distributed indexing
> -----------------------------------------------------
>
> Key: SOLR-3559
> URL: https://issues.apache.org/jira/browse/SOLR-3559
> Project: Solr
> Issue Type: Improvement
> Components: SolrCloud
> Reporter: Yonik Seeley
> Assignee: Yonik Seeley
> Attachments: SOLR-3559.patch
>
>
> We currently handle other update reorders (i.e. replica A may see update X then Y, and replica B may see update Y then X). deleteByQuery also needs to handle reorders to ensure replicas are consistent.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Updated] (SOLR-3559) handle deleteByQuery reorders in
distributed indexing
Posted by "Yonik Seeley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SOLR-3559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Yonik Seeley updated SOLR-3559:
-------------------------------
Attachment: SOLR-3559.patch
OK, additional bug fixes plus a fix to some of the tests that faked doc versions. clearIndex() with it's DBQ of *:* was messing things up since it could also delete documents in the future (docs that were using fake versions that were lower than the DBQ).
Time to add in the stress tests.
> handle deleteByQuery reorders in distributed indexing
> -----------------------------------------------------
>
> Key: SOLR-3559
> URL: https://issues.apache.org/jira/browse/SOLR-3559
> Project: Solr
> Issue Type: Improvement
> Components: SolrCloud
> Reporter: Yonik Seeley
> Assignee: Yonik Seeley
> Attachments: SOLR-3559.patch, SOLR-3559.patch, SOLR-3559.patch
>
>
> We currently handle other update reorders (i.e. replica A may see update X then Y, and replica B may see update Y then X). deleteByQuery also needs to handle reorders to ensure replicas are consistent.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Updated] (SOLR-3559) handle deleteByQuery reorders in
distributed indexing
Posted by "Yonik Seeley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SOLR-3559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Yonik Seeley updated SOLR-3559:
-------------------------------
Attachment: SOLR-3559.patch
Updated patch with bug fixes and a simple test for reordering that passes. Unfortunately some other tests now fail.
> handle deleteByQuery reorders in distributed indexing
> -----------------------------------------------------
>
> Key: SOLR-3559
> URL: https://issues.apache.org/jira/browse/SOLR-3559
> Project: Solr
> Issue Type: Improvement
> Components: SolrCloud
> Reporter: Yonik Seeley
> Assignee: Yonik Seeley
> Attachments: SOLR-3559.patch, SOLR-3559.patch
>
>
> We currently handle other update reorders (i.e. replica A may see update X then Y, and replica B may see update Y then X). deleteByQuery also needs to handle reorders to ensure replicas are consistent.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Updated] (SOLR-3559) handle deleteByQuery reorders in
distributed indexing
Posted by "Yonik Seeley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SOLR-3559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Yonik Seeley updated SOLR-3559:
-------------------------------
Attachment: SOLR-3559.patch
Here's the latest patch. Unfortunately stress tests fail. I'm not sure at this point if it's a logic bug, a concurrency bug, or a test bug...
> handle deleteByQuery reorders in distributed indexing
> -----------------------------------------------------
>
> Key: SOLR-3559
> URL: https://issues.apache.org/jira/browse/SOLR-3559
> Project: Solr
> Issue Type: Improvement
> Components: SolrCloud
> Reporter: Yonik Seeley
> Assignee: Yonik Seeley
> Attachments: SOLR-3559.patch, SOLR-3559.patch, SOLR-3559.patch, SOLR-3559.patch
>
>
> We currently handle other update reorders (i.e. replica A may see update X then Y, and replica B may see update Y then X). deleteByQuery also needs to handle reorders to ensure replicas are consistent.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org