You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by "joe.cohen.m@gmail.com" <jo...@gmail.com> on 2012/12/19 19:46:16 UTC
Struggling with solr 4.0 and zookeeper - multiple solr collection
and configs
I'm trying to build the following solr cluster:
3 collections, with 3 differnet configuration sets, on multiple servers.
It seems that solr can't use different config trees in the zookeeper at a
certain time.
Even if I manage to get to a state in which under the 'configs' node in the
zookeeper, I have 3 config folders with the solr conf files, when I run
solr, it seems like it picks one of them and looks for the other config
files under the single one it picked.
thus I get messages like " no zookeeper node found in
/configs/collection1cong/collection2conf/solrconfig.xml"
while I was assuming it should see that it has the node :
/configs/collection2conf/solrconfig.xml.
my zookeper configs node looks like:
configs/
configs/collection1conf
configs/collection2conf
configs/collection3conf
configs/collection1conf/<solrfiles>
configs/collection2conf/<solrfiles>
configs/collection3conf/<solrfiles>
I've tried many different ways of solr.xml editing and none helped:
1. setting full paths for each collection - an error says invalid path
2. setting relative paths for each collection - an error says cant find
zookeper node because it searchs under defaultcollectionpath+relativepath
3. running with only one core - solr doesnt see the other collections.
any idea?
is this even possible with current solr version?
thanks.
--
View this message in context: http://lucene.472066.n3.nabble.com/Struggling-with-solr-4-0-and-zookeeper-multiple-solr-collection-and-configs-tp4028113.html
Sent from the Solr - User mailing list archive at Nabble.com.
Re: Struggling with solr 4.0 and zookeeper - multiple solr
collection and configs
Posted by "joe.cohen.m@gmail.com" <jo...@gmail.com>.
Can you please clarify your answer?
You said to try to bootstap:
> > On the solr cloud page, admittedly down the page a ways, is the line
> > below.
> > Does that apply?
> > Best
> > Erick
> >
> > # try bootstrapping all the conf dirs in solr.xml
> > java -classpath example/solr-webapp/WEB-INF/lib/*
> > org.apache.solr.cloud.ZkCLI -cmd bootstrap -zkhost 127.0.0.1:9983
> > -solrhome example/solr
any that is what I tried.
Erick Erickson wrote
> You haven't indicated whether you tried what I pointed you at, you only
> repeated that you tried bootstrapping on the example directory, _not_
> wherever you put your multi-core configuration.
>
> I've seen the example I mentioned work like a champ. Really, try it.
>
> I'd think about using the latest solr nightly build too...
>
> Best
> Erick
>
>
> On Sun, Dec 23, 2012 at 2:55 AM,
> joe.cohen.m@
> <
> joe.cohen.m@
>> wrote:
>
>> If I run
>> java -classpath example/solr-webapp/WEB-INF/lib/*
>> org.apache.solr.cloud.ZkCLI -cmd bootstrap -zkhost 127.0.0.1:9983
>> -solrhome example/solr
>>
>> on each collcetion, I end up having 3 different configs.
>> But when I start solr, it is not able running all 3 collections with
>> each
>> one's configs. It keeps searching collection2's an collection3's config
>> under collection1's relative path config.
>>
>>
>> Erick Erickson wrote
>> > On the solr cloud page, admittedly down the page a ways, is the line
>> > below.
>> > Does that apply?
>> > Best
>> > Erick
>> >
>> > # try bootstrapping all the conf dirs in solr.xml
>> > java -classpath example/solr-webapp/WEB-INF/lib/*
>> > org.apache.solr.cloud.ZkCLI -cmd bootstrap -zkhost 127.0.0.1:9983
>> > -solrhome example/solr
>> >
>> >
>> >
>> > On Wed, Dec 19, 2012 at 1:46 PM,
>>
>> > joe.cohen.m@
>>
>> > <
>>
>> > joe.cohen.m@
>>
>> >> wrote:
>> >
>> >> I'm trying to build the following solr cluster:
>> >> 3 collections, with 3 differnet configuration sets, on multiple
>> servers.
>> >> It seems that solr can't use different config trees in the zookeeper
>> at
>> a
>> >> certain time.
>> >> Even if I manage to get to a state in which under the 'configs' node
>> in
>> >> the
>> >> zookeeper, I have 3 config folders with the solr conf files, when I
>> run
>> >> solr, it seems like it picks one of them and looks for the other
>> config
>> >> files under the single one it picked.
>> >>
>> >> thus I get messages like " no zookeeper node found in
>> >> /configs/collection1cong/collection2conf/solrconfig.xml"
>> >> while I was assuming it should see that it has the node :
>> >> /configs/collection2conf/solrconfig.xml.
>> >>
>> >> my zookeper configs node looks like:
>> >> configs/
>> >> configs/collection1conf
>> >> configs/collection2conf
>> >> configs/collection3conf
>> >> configs/collection1conf/
>> >
> <solrfiles>
>> >> configs/collection2conf/
>> >
> <solrfiles>
>> >> configs/collection3conf/
>> >
> <solrfiles>
>> >>
>> >> I've tried many different ways of solr.xml editing and none helped:
>> >> 1. setting full paths for each collection - an error says invalid
>> path
>> >> 2. setting relative paths for each collection - an error says cant
>> find
>> >> zookeper node because it searchs under
>> defaultcollectionpath+relativepath
>> >> 3. running with only one core - solr doesnt see the other collections.
>> >>
>> >>
>> >> any idea?
>> >> is this even possible with current solr version?
>> >>
>> >> thanks.
>> >>
>> >>
>> >>
>> >> --
>> >> View this message in context:
>> >>
>> http://lucene.472066.n3.nabble.com/Struggling-with-solr-4-0-and-zookeeper-multiple-solr-collection-and-configs-tp4028113.html
>> >> Sent from the Solr - User mailing list archive at Nabble.com.
>> >>
>>
>>
>>
>>
>>
>> --
>> View this message in context:
>> http://lucene.472066.n3.nabble.com/Struggling-with-solr-4-0-and-zookeeper-multiple-solr-collection-and-configs-tp4028113p4028797.html
>> Sent from the Solr - User mailing list archive at Nabble.com.
>>
--
View this message in context: http://lucene.472066.n3.nabble.com/Struggling-with-solr-4-0-and-zookeeper-multiple-solr-collection-and-configs-tp4028113p4029920.html
Sent from the Solr - User mailing list archive at Nabble.com.
Re: Struggling with solr 4.0 and zookeeper - multiple solr collection
and configs
Posted by Erick Erickson <er...@gmail.com>.
You haven't indicated whether you tried what I pointed you at, you only
repeated that you tried bootstrapping on the example directory, _not_
wherever you put your multi-core configuration.
I've seen the example I mentioned work like a champ. Really, try it.
I'd think about using the latest solr nightly build too...
Best
Erick
On Sun, Dec 23, 2012 at 2:55 AM, joe.cohen.m@gmail.com <
joe.cohen.m@gmail.com> wrote:
> If I run
> java -classpath example/solr-webapp/WEB-INF/lib/*
> org.apache.solr.cloud.ZkCLI -cmd bootstrap -zkhost 127.0.0.1:9983
> -solrhome example/solr
>
> on each collcetion, I end up having 3 different configs.
> But when I start solr, it is not able running all 3 collections with each
> one's configs. It keeps searching collection2's an collection3's config
> under collection1's relative path config.
>
>
> Erick Erickson wrote
> > On the solr cloud page, admittedly down the page a ways, is the line
> > below.
> > Does that apply?
> > Best
> > Erick
> >
> > # try bootstrapping all the conf dirs in solr.xml
> > java -classpath example/solr-webapp/WEB-INF/lib/*
> > org.apache.solr.cloud.ZkCLI -cmd bootstrap -zkhost 127.0.0.1:9983
> > -solrhome example/solr
> >
> >
> >
> > On Wed, Dec 19, 2012 at 1:46 PM,
>
> > joe.cohen.m@
>
> > <
>
> > joe.cohen.m@
>
> >> wrote:
> >
> >> I'm trying to build the following solr cluster:
> >> 3 collections, with 3 differnet configuration sets, on multiple servers.
> >> It seems that solr can't use different config trees in the zookeeper at
> a
> >> certain time.
> >> Even if I manage to get to a state in which under the 'configs' node in
> >> the
> >> zookeeper, I have 3 config folders with the solr conf files, when I run
> >> solr, it seems like it picks one of them and looks for the other config
> >> files under the single one it picked.
> >>
> >> thus I get messages like " no zookeeper node found in
> >> /configs/collection1cong/collection2conf/solrconfig.xml"
> >> while I was assuming it should see that it has the node :
> >> /configs/collection2conf/solrconfig.xml.
> >>
> >> my zookeper configs node looks like:
> >> configs/
> >> configs/collection1conf
> >> configs/collection2conf
> >> configs/collection3conf
> >> configs/collection1conf/
> > <solrfiles>
> >> configs/collection2conf/
> > <solrfiles>
> >> configs/collection3conf/
> > <solrfiles>
> >>
> >> I've tried many different ways of solr.xml editing and none helped:
> >> 1. setting full paths for each collection - an error says invalid path
> >> 2. setting relative paths for each collection - an error says cant find
> >> zookeper node because it searchs under
> defaultcollectionpath+relativepath
> >> 3. running with only one core - solr doesnt see the other collections.
> >>
> >>
> >> any idea?
> >> is this even possible with current solr version?
> >>
> >> thanks.
> >>
> >>
> >>
> >> --
> >> View this message in context:
> >>
> http://lucene.472066.n3.nabble.com/Struggling-with-solr-4-0-and-zookeeper-multiple-solr-collection-and-configs-tp4028113.html
> >> Sent from the Solr - User mailing list archive at Nabble.com.
> >>
>
>
>
>
>
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/Struggling-with-solr-4-0-and-zookeeper-multiple-solr-collection-and-configs-tp4028113p4028797.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>
Re: Struggling with solr 4.0 and zookeeper - multiple solr
collection and configs
Posted by "joe.cohen.m@gmail.com" <jo...@gmail.com>.
If I run
java -classpath example/solr-webapp/WEB-INF/lib/*
org.apache.solr.cloud.ZkCLI -cmd bootstrap -zkhost 127.0.0.1:9983
-solrhome example/solr
on each collcetion, I end up having 3 different configs.
But when I start solr, it is not able running all 3 collections with each
one's configs. It keeps searching collection2's an collection3's config
under collection1's relative path config.
Erick Erickson wrote
> On the solr cloud page, admittedly down the page a ways, is the line
> below.
> Does that apply?
> Best
> Erick
>
> # try bootstrapping all the conf dirs in solr.xml
> java -classpath example/solr-webapp/WEB-INF/lib/*
> org.apache.solr.cloud.ZkCLI -cmd bootstrap -zkhost 127.0.0.1:9983
> -solrhome example/solr
>
>
>
> On Wed, Dec 19, 2012 at 1:46 PM,
> joe.cohen.m@
> <
> joe.cohen.m@
>> wrote:
>
>> I'm trying to build the following solr cluster:
>> 3 collections, with 3 differnet configuration sets, on multiple servers.
>> It seems that solr can't use different config trees in the zookeeper at a
>> certain time.
>> Even if I manage to get to a state in which under the 'configs' node in
>> the
>> zookeeper, I have 3 config folders with the solr conf files, when I run
>> solr, it seems like it picks one of them and looks for the other config
>> files under the single one it picked.
>>
>> thus I get messages like " no zookeeper node found in
>> /configs/collection1cong/collection2conf/solrconfig.xml"
>> while I was assuming it should see that it has the node :
>> /configs/collection2conf/solrconfig.xml.
>>
>> my zookeper configs node looks like:
>> configs/
>> configs/collection1conf
>> configs/collection2conf
>> configs/collection3conf
>> configs/collection1conf/
> <solrfiles>
>> configs/collection2conf/
> <solrfiles>
>> configs/collection3conf/
> <solrfiles>
>>
>> I've tried many different ways of solr.xml editing and none helped:
>> 1. setting full paths for each collection - an error says invalid path
>> 2. setting relative paths for each collection - an error says cant find
>> zookeper node because it searchs under defaultcollectionpath+relativepath
>> 3. running with only one core - solr doesnt see the other collections.
>>
>>
>> any idea?
>> is this even possible with current solr version?
>>
>> thanks.
>>
>>
>>
>> --
>> View this message in context:
>> http://lucene.472066.n3.nabble.com/Struggling-with-solr-4-0-and-zookeeper-multiple-solr-collection-and-configs-tp4028113.html
>> Sent from the Solr - User mailing list archive at Nabble.com.
>>
--
View this message in context: http://lucene.472066.n3.nabble.com/Struggling-with-solr-4-0-and-zookeeper-multiple-solr-collection-and-configs-tp4028113p4028797.html
Sent from the Solr - User mailing list archive at Nabble.com.
Re: Struggling with solr 4.0 and zookeeper - multiple solr collection
and configs
Posted by Erick Erickson <er...@gmail.com>.
On the solr cloud page, admittedly down the page a ways, is the line below.
Does that apply?
Best
Erick
# try bootstrapping all the conf dirs in solr.xml
java -classpath example/solr-webapp/WEB-INF/lib/*
org.apache.solr.cloud.ZkCLI -cmd bootstrap -zkhost 127.0.0.1:9983
-solrhome example/solr
On Wed, Dec 19, 2012 at 1:46 PM, joe.cohen.m@gmail.com <
joe.cohen.m@gmail.com> wrote:
> I'm trying to build the following solr cluster:
> 3 collections, with 3 differnet configuration sets, on multiple servers.
> It seems that solr can't use different config trees in the zookeeper at a
> certain time.
> Even if I manage to get to a state in which under the 'configs' node in the
> zookeeper, I have 3 config folders with the solr conf files, when I run
> solr, it seems like it picks one of them and looks for the other config
> files under the single one it picked.
>
> thus I get messages like " no zookeeper node found in
> /configs/collection1cong/collection2conf/solrconfig.xml"
> while I was assuming it should see that it has the node :
> /configs/collection2conf/solrconfig.xml.
>
> my zookeper configs node looks like:
> configs/
> configs/collection1conf
> configs/collection2conf
> configs/collection3conf
> configs/collection1conf/<solrfiles>
> configs/collection2conf/<solrfiles>
> configs/collection3conf/<solrfiles>
>
> I've tried many different ways of solr.xml editing and none helped:
> 1. setting full paths for each collection - an error says invalid path
> 2. setting relative paths for each collection - an error says cant find
> zookeper node because it searchs under defaultcollectionpath+relativepath
> 3. running with only one core - solr doesnt see the other collections.
>
>
> any idea?
> is this even possible with current solr version?
>
> thanks.
>
>
>
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/Struggling-with-solr-4-0-and-zookeeper-multiple-solr-collection-and-configs-tp4028113.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>