You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by Lili <ly...@gmail.com> on 2012/12/20 02:30:44 UTC
SolrCloud: only partial results returned
We set up SolrCloud with 2 shards and separate multiple zookeepers. The
data added using http post with json in tutorial sample are not completely
returned in query. However, if you send the same http post request again
or shutdown solr instance and restart, the complete results will be
returned.
We have tried adding "distrib=true" in query or even adding "shards=.....".
Still, only partial results are returned.
This happened with embeded zookeepers too.
However, this doesn't seem to happen if you add data with xml in tutorial
samples.
Any thoughts on what might be wrong or is it a known issue?
Thanks,
Lili
--
View this message in context: http://lucene.472066.n3.nabble.com/SolrCloud-only-partial-results-returned-tp4028200.html
Sent from the Solr - User mailing list archive at Nabble.com.
Re: SolrCloud: only partial results returned
Posted by Lili <ly...@gmail.com>.
I am using the follow command with commit:
curl 'http://<host>:<port>/solr/update/json?commit=true' --data-binary
@books.json -H 'Content-type:application/json'
So I assume this is hard commit?
Thanks,
Lili
--
View this message in context: http://lucene.472066.n3.nabble.com/SolrCloud-only-partial-results-returned-tp4028200p4028683.html
Sent from the Solr - User mailing list archive at Nabble.com.
Re: SolrCloud: only partial results returned
Posted by Erick Erickson <er...@gmail.com>.
I've been bitten by caching before too, server-level, browser level,
whatever-level..
FWIW,
Erick
On Fri, Dec 21, 2012 at 7:06 AM, Per Steffensen <st...@designware.dk> wrote:
> Are you using (soft) auto-commit or do you perform a manual commit after
> the documents have been indexed? You can index documents, but they wont be
> searchable before a (soft) commit has been performed. Even if you are
> running with (soft) auto-commit there is not guarantee that the documents
> are searchable before "configured auto-commit time-period" has passed since
> you indexed your last document.
>
> Regards, Per Steffensen
>
>
> On 12/20/12 6:37 PM, Lili wrote:
>
>> Mark, yes, they have unique ids. Most the time, after the 2nd json
>> http
>> post, query will return complete results.
>>
>> I believe the data was indexed already with 1st post since if I shutdown
>> the
>> solr after 1st post and restart again, query will return complete result
>> set.
>>
>> Thanks,
>>
>> Lili
>>
>>
>>
>> --
>> View this message in context: http://lucene.472066.n3.**
>> nabble.com/SolrCloud-only-**partial-results-returned-**
>> tp4028200p4028367.html<http://lucene.472066.n3.nabble.com/SolrCloud-only-partial-results-returned-tp4028200p4028367.html>
>> Sent from the Solr - User mailing list archive at Nabble.com.
>>
>>
>
Re: SolrCloud: only partial results returned
Posted by Per Steffensen <st...@designware.dk>.
Are you using (soft) auto-commit or do you perform a manual commit after
the documents have been indexed? You can index documents, but they wont
be searchable before a (soft) commit has been performed. Even if you are
running with (soft) auto-commit there is not guarantee that the
documents are searchable before "configured auto-commit time-period" has
passed since you indexed your last document.
Regards, Per Steffensen
On 12/20/12 6:37 PM, Lili wrote:
> Mark, yes, they have unique ids. Most the time, after the 2nd json http
> post, query will return complete results.
>
> I believe the data was indexed already with 1st post since if I shutdown the
> solr after 1st post and restart again, query will return complete result
> set.
>
> Thanks,
>
> Lili
>
>
>
> --
> View this message in context: http://lucene.472066.n3.nabble.com/SolrCloud-only-partial-results-returned-tp4028200p4028367.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>
Re: SolrCloud: only partial results returned
Posted by Lili <ly...@gmail.com>.
Mark, yes, they have unique ids. Most the time, after the 2nd json http
post, query will return complete results.
I believe the data was indexed already with 1st post since if I shutdown the
solr after 1st post and restart again, query will return complete result
set.
Thanks,
Lili
--
View this message in context: http://lucene.472066.n3.nabble.com/SolrCloud-only-partial-results-returned-tp4028200p4028367.html
Sent from the Solr - User mailing list archive at Nabble.com.
Re: SolrCloud: only partial results returned
Posted by Mark Miller <ma...@gmail.com>.
Does all the data have unique ids?
- Mark
On Dec 19, 2012, at 8:30 PM, Lili <ly...@gmail.com> wrote:
> We set up SolrCloud with 2 shards and separate multiple zookeepers. The
> data added using http post with json in tutorial sample are not completely
> returned in query. However, if you send the same http post request again
> or shutdown solr instance and restart, the complete results will be
> returned.
>
> We have tried adding "distrib=true" in query or even adding "shards=.....".
> Still, only partial results are returned.
>
> This happened with embeded zookeepers too.
>
> However, this doesn't seem to happen if you add data with xml in tutorial
> samples.
>
> Any thoughts on what might be wrong or is it a known issue?
>
>
> Thanks,
>
> Lili
>
>
>
> --
> View this message in context: http://lucene.472066.n3.nabble.com/SolrCloud-only-partial-results-returned-tp4028200.html
> Sent from the Solr - User mailing list archive at Nabble.com.