You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@solr.apache.org by "sigram (via GitHub)" <gi...@apache.org> on 2023/09/22 11:27:21 UTC
[GitHub] [solr-sandbox] sigram opened a new pull request, #73: Documents lost in Consumer during target Solr restart.
sigram opened a new pull request, #73:
URL: https://github.com/apache/solr-sandbox/pull/73
This modified test illustrates a scenario when target Solr node(s) go missing (for example due to a crash, a forced restart, or connectivity issues) BUT at the same time the Zookeeper remains online.
The test fails because it looks like some of the documents are lost by the Consumer, even though the `failed_resubmit` code path should resubmit them back to Kafka and they should be picked up later when Solr is back online.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@solr.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@solr.apache.org
For additional commands, e-mail: issues-help@solr.apache.org
[GitHub] [solr-sandbox] markrmiller commented on pull request #73: Documents lost in Consumer during target Solr restart.
Posted by "markrmiller (via GitHub)" <gi...@apache.org>.
markrmiller commented on PR #73:
URL: https://github.com/apache/solr-sandbox/pull/73#issuecomment-1732049563
Taking a look.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@solr.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@solr.apache.org
For additional commands, e-mail: issues-help@solr.apache.org
Re: [PR] Documents lost in Consumer during target Solr restart. [solr-sandbox]
Posted by "markrmiller (via GitHub)" <gi...@apache.org>.
markrmiller commented on PR #73:
URL: https://github.com/apache/solr-sandbox/pull/73#issuecomment-1743774649
Good catch, big hole that that test only tests dropping zk and not Solr.
I'm just wrapping up a fix.
Appears to be caused by batching multiple Kafka records to a SolrRequest to send to Solr, but on failure, adding back just the last Kafka record, so of course you loose the previous records in the batch.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@solr.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@solr.apache.org
For additional commands, e-mail: issues-help@solr.apache.org
Re: [PR] Documents lost in Consumer during target Solr restart. [solr-sandbox]
Posted by "sigram (via GitHub)" <gi...@apache.org>.
sigram commented on PR #73:
URL: https://github.com/apache/solr-sandbox/pull/73#issuecomment-1761253545
If I'm not mistaken this has been fixed in PR 75? if so then this can be closed.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@solr.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@solr.apache.org
For additional commands, e-mail: issues-help@solr.apache.org
Re: [PR] Documents lost in Consumer during target Solr restart. [solr-sandbox]
Posted by "markrmiller (via GitHub)" <gi...@apache.org>.
markrmiller closed pull request #73: Documents lost in Consumer during target Solr restart.
URL: https://github.com/apache/solr-sandbox/pull/73
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@solr.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@solr.apache.org
For additional commands, e-mail: issues-help@solr.apache.org