You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by Aman Tandon <am...@gmail.com> on 2014/05/14 07:35:35 UTC
distrib=false is not honoring
I am trying to use the solr cloud for solr 4.2.0 and solr 4.7.1.
Here mcats is our collection name.
*With solr 4.2*
shard1: localhost:8019
shard1: localhost:6019
*With solr 4.7.1*
shard1: localhost:8983
shard1: localhost:1983
With both the server i make the copy of example directory as mentioned in
wiki, and queried over the both nodes
*query 1*:
http://localhost:8983/solr/mcats/select?q.alt=id:69763&distrib=false&qt=mcat.intent
*query 2*:
http://localhost:1983/solr/mcats/select?q.alt=id:69763&distrib=false&qt=mcat.intent
total number of docs count become half but i search for specific id then
the result is same, if distrib=false this enables to search on particular
node then one of these node should not return the return the result. If i
am incorrect please help me out to test that one record is present in one
shard only.
With Regards
Aman Tandon
Re: distrib=false is not honoring
Posted by Aman Tandon <am...@gmail.com>.
Hi,
There is one more problem today, i indexed the mcat core and again copied
the same and then starting the shard
(as decribed in above thread)
*And i was taking my non sharded index(mcats index) and copying it to node1
as well as node 2 and starting the first node as: *
I noticed that there is difference in the total count of docs, please see
these logs
query:
A) *localhost:1983*
*871949 [qtp27058272-19] INFO org.apache.solr.core.SolrCore – [mcats]
webapp=/solr path=/select
params={mm=%0a%09%0a++++++++2<-1+4<70%25%0a+++++&facet=true&tie=0.01&qf=%0a%09namex%0a+++++&distrib=false&wt=javabin&version=2&defType=edismax&rows=10&pf=%0a%09%0a+++++&NOW=1400148489992&shard.url=http://192.168.6.217:1983/solr/mcats/&fl=id,score&start=0&q=*:*&qs=50&isShard=true&fsv=true&ps=3
<http://192.168.6.217:1983/solr/mcats/&fl=id,score&start=0&q=*:*&qs=50&isShard=true&fsv=true&ps=3>}
hits=113573 status=0 QTime=1*
B) *localhost:8983* (running the embedded zookeper server)
*878735 [qtp27058272-15] INFO org.apache.solr.core.SolrCore – [mcats]
webapp=/solr path=/select
params={mm=%0a%09%0a++++++++2<-1+4<70%25%0a+++++&facet=true&tie=0.01&qf=%0a%09namex%0a+++++&distrib=false&wt=javabin&version=2&defType=edismax&rows=10&pf=%0a%09%0a+++++&NOW=1400148489992&shard.url=http://192.168.6.217:8983/solr/mcats/&fl=id,score&start=0&q=*:*&qs=50&isShard=true&fsv=true&ps=3
<http://192.168.6.217:8983/solr/mcats/&fl=id,score&start=0&q=*:*&qs=50&isShard=true&fsv=true&ps=3>}
hits=113573 status=0 QTime=1 878746 [qtp27058272-15] INFO
org.apache.solr.core.SolrCore – [mcats] webapp=/solr path=/select
params={mm=%0a%09%0a++++++++2<-1+4<70%25%0a+++++&facet=false&tie=0.01&ids=42663,26311,40545,4571,19114,26010,2716,38320,25724,29459&qf=%0a%09namex%0a+++++&distrib=false&wt=javabin&version=2&defType=edismax&pf=%0a%09%0a+++++&NOW=1400148489992&shard.url=http://192.168.6.217:8983/solr/mcats/&fl=%0a++++++++%0a%09*,+score%0a+++++&q=*:*&qs=50&isShard=true&ps=3
<http://192.168.6.217:8983/solr/mcats/&fl=%0a++++++++%0a%09*,+score%0a+++++&q=*:*&qs=50&isShard=true&ps=3>}
status=0 QTime=4 878750 [qtp27058272-13] INFO
org.apache.solr.core.SolrCore – [mcats] webapp=/solr path=/select
params={q=*:*&defType=edismax} hits=227136 status=0 QTime=19*
sum of docs should be: *113573 + *
*113573 = 227146 *
But it gives me back the total sum of 227136 as mentioned in logs. Can
anybody help that what's going on here
*.*
With Regards
Aman Tandon
On Thu, May 15, 2014 at 1:36 PM, Aman Tandon <am...@gmail.com>wrote:
> Thanks Jack i am using *q.alt* just for testing purpose only we uses
> *q=query* in our general production environment case and *mcat.intent* is
> our request handler to add extra number of rows and all.
>
> Here i was doing some mistake to properly explaining the situation, so i
> am sorry for that.
>
> *Requirement:* I want to test my sharded environment that a unique
> document should present in single shard not in both.
>
> *core name*: mcats
> *core.properties*: name=mcats, so default collection name would be mcats
> as well.
>
> And i was taking my non sharded index(mcats index) and copying it to node1
> as well as node 2 and starting the first node as:
>
> *java -DzkRun -DnumShards=2 -Dbootstrap_confdir=./solr/mcats/conf
> -Dcollection.configName=myconf -jar start.jar*
>
> And second node as
> *java -Djetty.port=1983 -DzkHost=localhost:9983 -jar start.jar*
>
> So i guess it is taking the whole index as it is because when i run the
> query.
>
> http://localhost:8983/solr/mcats/select?q.alt=*:*<http://localhost:8983/solr/mcats/select?q.alt=id:174060&shards=localhost:8983/solr/mcats>
> it was giving me the sum of documents in both the shards which is 2*no of
> docs in mcats index.
>
> So the same document is present in both the shard at node1:8983 and
> node2:1983
>
> To figure this out i indexed it with the another different doc now when i
> queried with
> http://localhost:8983/solr/mcats/select?q.alt=id:17406780&distrib=false<http://localhost:8983/solr/mcats/select?q.alt=id:174060&shards=localhost:8983/solr/mcats>
> the document is present.
>
> But in another query
> http://localhost:8983/solr/mcats/select?q.alt=id:17406780&distrib=flase<http://localhost:8983/solr/mcats/select?q.alt=id:174060&shards=localhost:8983/solr/mcats>
> it is not found.
>
> which fulfilled my test case.
>
> So i thought i have to do the full indexing of my core mcats to validate
> my test case for each ids. Please correct me if i am wrong.
>
>
> With Regards
> Aman Tandon
>
>
> On Wed, May 14, 2014 at 5:52 PM, Jack Krupansky <ja...@basetechnology.com>wrote:
>
>> The q.alt param specifies only the parameter to use if the q parameter is
>> missing. Could you verify whether that is really the case? Typically
>> solrconfig gives a default of "*:*" for the q parameter. Specifying a query
>> via the q.alt parameter seems like a strange approach - what is your
>> rationale?
>>
>> What is this odd "mcat.intent" query response writer type that you are
>> specifying with the qt parameter?
>>
>> -- Jack Krupansky
>>
>> -----Original Message----- From: Aman Tandon
>> Sent: Wednesday, May 14, 2014 1:35 AM
>> To: solr-user@lucene.apache.org
>> Subject: distrib=false is not honoring
>>
>>
>> I am trying to use the solr cloud for solr 4.2.0 and solr 4.7.1.
>> Here mcats is our collection name.
>>
>> *With solr 4.2*
>>
>> shard1: localhost:8019
>> shard1: localhost:6019
>>
>> *With solr 4.7.1*
>>
>> shard1: localhost:8983
>> shard1: localhost:1983
>>
>> With both the server i make the copy of example directory as mentioned in
>> wiki, and queried over the both nodes
>>
>> *query 1*:
>> http://localhost:8983/solr/mcats/select?q.alt=id:69763&
>> distrib=false&qt=mcat.intent
>> *query 2*:
>>
>> http://localhost:1983/solr/mcats/select?q.alt=id:69763&
>> distrib=false&qt=mcat.intent
>>
>> total number of docs count become half but i search for specific id then
>> the result is same, if distrib=false this enables to search on particular
>> node then one of these node should not return the return the result. If i
>> am incorrect please help me out to test that one record is present in one
>> shard only.
>>
>> With Regards
>> Aman Tandon
>>
>
>
Re: distrib=false is not honoring
Posted by Aman Tandon <am...@gmail.com>.
Thanks Jack i am using *q.alt* just for testing purpose only we uses
*q=query* in our general production environment case and *mcat.intent* is
our request handler to add extra number of rows and all.
Here i was doing some mistake to properly explaining the situation, so i am
sorry for that.
*Requirement:* I want to test my sharded environment that a unique document
should present in single shard not in both.
*core name*: mcats
*core.properties*: name=mcats, so default collection name would be mcats as
well.
And i was taking my non sharded index(mcats index) and copying it to node1
as well as node 2 and starting the first node as:
*java -DzkRun -DnumShards=2 -Dbootstrap_confdir=./solr/mcats/conf
-Dcollection.configName=myconf -jar start.jar*
And second node as
*java -Djetty.port=1983 -DzkHost=localhost:9983 -jar start.jar*
So i guess it is taking the whole index as it is because when i run the
query.
http://localhost:8983/solr/mcats/select?q.alt=*:*<http://localhost:8983/solr/mcats/select?q.alt=id:174060&shards=localhost:8983/solr/mcats>
it was giving me the sum of documents in both the shards which is 2*no of
docs in mcats index.
So the same document is present in both the shard at node1:8983 and
node2:1983
To figure this out i indexed it with the another different doc now when i
queried with
http://localhost:8983/solr/mcats/select?q.alt=id:17406780&distrib=false<http://localhost:8983/solr/mcats/select?q.alt=id:174060&shards=localhost:8983/solr/mcats>
the document is present.
But in another query
http://localhost:8983/solr/mcats/select?q.alt=id:17406780&distrib=flase<http://localhost:8983/solr/mcats/select?q.alt=id:174060&shards=localhost:8983/solr/mcats>
it is not found.
which fulfilled my test case.
So i thought i have to do the full indexing of my core mcats to validate my
test case for each ids. Please correct me if i am wrong.
With Regards
Aman Tandon
On Wed, May 14, 2014 at 5:52 PM, Jack Krupansky <ja...@basetechnology.com>wrote:
> The q.alt param specifies only the parameter to use if the q parameter is
> missing. Could you verify whether that is really the case? Typically
> solrconfig gives a default of "*:*" for the q parameter. Specifying a query
> via the q.alt parameter seems like a strange approach - what is your
> rationale?
>
> What is this odd "mcat.intent" query response writer type that you are
> specifying with the qt parameter?
>
> -- Jack Krupansky
>
> -----Original Message----- From: Aman Tandon
> Sent: Wednesday, May 14, 2014 1:35 AM
> To: solr-user@lucene.apache.org
> Subject: distrib=false is not honoring
>
>
> I am trying to use the solr cloud for solr 4.2.0 and solr 4.7.1.
> Here mcats is our collection name.
>
> *With solr 4.2*
>
> shard1: localhost:8019
> shard1: localhost:6019
>
> *With solr 4.7.1*
>
> shard1: localhost:8983
> shard1: localhost:1983
>
> With both the server i make the copy of example directory as mentioned in
> wiki, and queried over the both nodes
>
> *query 1*:
> http://localhost:8983/solr/mcats/select?q.alt=id:69763&
> distrib=false&qt=mcat.intent
> *query 2*:
>
> http://localhost:1983/solr/mcats/select?q.alt=id:69763&
> distrib=false&qt=mcat.intent
>
> total number of docs count become half but i search for specific id then
> the result is same, if distrib=false this enables to search on particular
> node then one of these node should not return the return the result. If i
> am incorrect please help me out to test that one record is present in one
> shard only.
>
> With Regards
> Aman Tandon
>
Re: distrib=false is not honoring
Posted by Shawn Heisey <so...@elyograg.org>.
> The q.alt param specifies only the parameter to use if the q parameter is
> missing. Could you verify whether that is really the case? Typically
> solrconfig gives a default of "*:*" for the q parameter. Specifying a
> query
> via the q.alt parameter seems like a strange approach - what is your
> rationale?
As the author of a book about Solr, I'm sure you already know these
things. For everyone else:
The qt parameter only gets used if the handleSelect value on the request
dispatcher configuration is true. When that is set, it chooses a request
handler by name. This configuration value defaults to false since version
3.6, so that you can't use the /select handler to do other things, like
/update.
The q.alt parameter is applicable only to the dismax and edismax query
parsers, and specifies the query to send to the standard query parser if
the q parameter is blank or missing. It's most often defined as *:* to get
all docs. The *:* value doesn't have any special meaning to the dismax
parser.
Thanks,
Shawn
Re: distrib=false is not honoring
Posted by Jack Krupansky <ja...@basetechnology.com>.
The q.alt param specifies only the parameter to use if the q parameter is
missing. Could you verify whether that is really the case? Typically
solrconfig gives a default of "*:*" for the q parameter. Specifying a query
via the q.alt parameter seems like a strange approach - what is your
rationale?
What is this odd "mcat.intent" query response writer type that you are
specifying with the qt parameter?
-- Jack Krupansky
-----Original Message-----
From: Aman Tandon
Sent: Wednesday, May 14, 2014 1:35 AM
To: solr-user@lucene.apache.org
Subject: distrib=false is not honoring
I am trying to use the solr cloud for solr 4.2.0 and solr 4.7.1.
Here mcats is our collection name.
*With solr 4.2*
shard1: localhost:8019
shard1: localhost:6019
*With solr 4.7.1*
shard1: localhost:8983
shard1: localhost:1983
With both the server i make the copy of example directory as mentioned in
wiki, and queried over the both nodes
*query 1*:
http://localhost:8983/solr/mcats/select?q.alt=id:69763&distrib=false&qt=mcat.intent
*query 2*:
http://localhost:1983/solr/mcats/select?q.alt=id:69763&distrib=false&qt=mcat.intent
total number of docs count become half but i search for specific id then
the result is same, if distrib=false this enables to search on particular
node then one of these node should not return the return the result. If i
am incorrect please help me out to test that one record is present in one
shard only.
With Regards
Aman Tandon
Re: distrib=false is not honoring
Posted by Aman Tandon <am...@gmail.com>.
I also tried it to query specific shard to make sure that the unique record
is present in different shards but still no success.
http://localhost:8983/solr/mcats/select?q.alt=id:174060&shards=localhost:8983/solr/mcats
http://localhost:8983/solr/mcats/select?q.alt=id:174060&shards=localhost:1983/solr/mcats
My solr cloud setup configs are
java -DzkRun -DnumShards=2 -Dbootstrap_confdir=./solr/mcats/conf
-Dcollection.configName=myconf -jar start.jar
java -Djetty.port=1983 -DzkHost=localhost:9983 -jar start.jar
Please help.
With Regards
Aman Tandon
On Wed, May 14, 2014 at 11:05 AM, Aman Tandon <am...@gmail.com>wrote:
> I am trying to use the solr cloud for solr 4.2.0 and solr 4.7.1.
> Here mcats is our collection name.
>
> *With solr 4.2*
> shard1: localhost:8019
> shard1: localhost:6019
>
> *With solr 4.7.1*
> shard1: localhost:8983
> shard1: localhost:1983
>
> With both the server i make the copy of example directory as mentioned in
> wiki, and queried over the both nodes
>
> *query 1*:
> http://localhost:8983/solr/mcats/select?q.alt=id:69763&distrib=false&qt=mcat.intent
> *query 2*:
> http://localhost:1983/solr/mcats/select?q.alt=id:69763&distrib=false&qt=mcat.intent
>
> total number of docs count become half but i search for specific id then
> the result is same, if distrib=false this enables to search on particular
> node then one of these node should not return the return the result. If i
> am incorrect please help me out to test that one record is present in one
> shard only.
>
> With Regards
> Aman Tandon
>