You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by farhan diwan <fa...@gmail.com> on 2006/08/13 00:40:16 UTC
Replication on solr
I want to run 3 to 4 instances of solr on different machines. the other
servers will be replicatin the index from the single server.
how is that done and what options needed to modifies or added to config
xml file of solr.
Regards
Farhan Diwan
Re: Replication on solr
Posted by Bill Au <bi...@gmail.com>.
Not we are not using a cron job for snapshooter.
Bill
On Thu, Oct 2, 2008 at 3:53 AM, sunnyfr <jo...@gmail.com> wrote:
>
> Hi Bill,
>
> Just to know, so you use post commit and post optimize and did you create
> a
> cron job for snapshooter ?
> If yes when, the same minute as delta-import ?
>
> Thanks,
>
>
>
> Bill Au wrote:
> >
> > If you use cron, you should use the new "-c" option of snapshooter which
> > only takes a snapshot where there have been changes. My personal
> > preference
> > is to use postCommit and postOptimize event listeners.
> >
> > Bill
> >
> > On Wed, Oct 1, 2008 at 4:28 AM, sunnyfr <jo...@gmail.com> wrote:
> >
> >>
> >> Hi guys,
> >>
> >> Do you think it works better automaticly by solr after commit, fire
> >> snapshooter or start cron job.
> >>
> >> Thanks,
> >>
> >>
> >> hossman_lucene wrote:
> >> >
> >> >
> >> > : I want to run 3 to 4 instances of solr on different machines. the
> >> > other
> >> > : servers will be replicatin the index from the single server.
> >> > : how is that done and what options needed to modifies or added to
> >> config
> >> > : xml file of solr.
> >> >
> >> > I would start by looking at these wiki pages...
> >> >
> >> > http://wiki.apache.org/solr/CollectionDistribution
> >> >
> http://wiki.apache.org/solr/SolrCollectionDistributionOperationsOutline
> >> >
> >> > ...they explain everything you need to know about how the
> >> > creation/replication/installation of snapshots works. then if you
> look
> >> at
> >> > the example solrconfig.xml you'll see where the event listeners for
> >> > "snapshooter" are commented out ... just decide wether you want to
> >> create
> >> > snapshoots on each commit, or just after an optimize, and uncomment
> the
> >> > appropriate code.
> >> >
> >> >
> >> >
> >> > -Hoss
> >> >
> >> >
> >> >
> >>
> >> --
> >> View this message in context:
> >> http://www.nabble.com/Replication-on-solr-tp5780286p19756456.html
> >> Sent from the Solr - User mailing list archive at Nabble.com.
> >>
> >>
> >
> >
>
> --
> View this message in context:
> http://www.nabble.com/Replication-on-solr-tp5780286p19774832.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>
>
Re: Replication on solr
Posted by sunnyfr <jo...@gmail.com>.
Hi Bill,
Just to know, so you use post commit and post optimize and did you create a
cron job for snapshooter ?
If yes when, the same minute as delta-import ?
Thanks,
Bill Au wrote:
>
> If you use cron, you should use the new "-c" option of snapshooter which
> only takes a snapshot where there have been changes. My personal
> preference
> is to use postCommit and postOptimize event listeners.
>
> Bill
>
> On Wed, Oct 1, 2008 at 4:28 AM, sunnyfr <jo...@gmail.com> wrote:
>
>>
>> Hi guys,
>>
>> Do you think it works better automaticly by solr after commit, fire
>> snapshooter or start cron job.
>>
>> Thanks,
>>
>>
>> hossman_lucene wrote:
>> >
>> >
>> > : I want to run 3 to 4 instances of solr on different machines. the
>> > other
>> > : servers will be replicatin the index from the single server.
>> > : how is that done and what options needed to modifies or added to
>> config
>> > : xml file of solr.
>> >
>> > I would start by looking at these wiki pages...
>> >
>> > http://wiki.apache.org/solr/CollectionDistribution
>> > http://wiki.apache.org/solr/SolrCollectionDistributionOperationsOutline
>> >
>> > ...they explain everything you need to know about how the
>> > creation/replication/installation of snapshots works. then if you look
>> at
>> > the example solrconfig.xml you'll see where the event listeners for
>> > "snapshooter" are commented out ... just decide wether you want to
>> create
>> > snapshoots on each commit, or just after an optimize, and uncomment the
>> > appropriate code.
>> >
>> >
>> >
>> > -Hoss
>> >
>> >
>> >
>>
>> --
>> View this message in context:
>> http://www.nabble.com/Replication-on-solr-tp5780286p19756456.html
>> Sent from the Solr - User mailing list archive at Nabble.com.
>>
>>
>
>
--
View this message in context: http://www.nabble.com/Replication-on-solr-tp5780286p19774832.html
Sent from the Solr - User mailing list archive at Nabble.com.
Re: Replication on solr
Posted by sunnyfr <jo...@gmail.com>.
Hi Bill,
Thanks for your answer,
what you mean by postCommit and postOptimize?
It's seems like I have a big problem with this automatic snapshooter .. It
messed up a bit my solr.
Now I've this error :
Could not start SOLR. Check solr/home property java.lang.RuntimeException:
Can't find resource 'solrconfig.xml' in classpath or 'solr/conf/', cwd=/
^Iat
org.apache.solr.core.SolrResourceLoader.openResource(SolrResourceLoader.java:168)
And I'm a bit stuck with it, everything is settled at the good place, my
solr.war in data/solr/
my solr.xml in /etc/tomcat5.5/Catalina/localhost/solr.xml
with :
<Context path="/solr" docBase="/data/solr/solr.war" debug="0"
crossContext="true" >
<Environment name="solr/home" type="java.lang.String" value="/data/solr"
override="true" />
</Context>
But everythins is properly started :
root 22640 0.0 0.0 16516 364 ? Ss 15:17 0:00
/usr/bin/jsvc -user tomcat55 -cp
/usr/share/java/commons-daemon.jar:/usr/share/tomcat5.5/bin/bootstrap.jar
-outfile SYSLOG -errfile SYSLOG -pidfile /var/run/tomcat5.5.pid -Xms256m
-Xmx2000m -XX:+UseParallelGC -XX:+AggressiveOpts -XX:NewRatio=5
-Xloggc:gc.log -XX:+PrintGCDetails -XX:+PrintGCTimeStamps
-Djava.endorsed.dirs=/usr/share/tomcat5.5/common/endorsed
-Dcatalina.base=/var/lib/tomcat5.5 -Dcatalina.home=/usr/share/tomcat5.5
-Djava.io.tmpdir=/var/lib/tomcat5.5/temp
-Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager
-Djava.util.logging.config.file=/var/lib/tomcat5.5/conf/logging.properties
org.apache.catalina.startup.Bootstrap
I just don't have anymore idea ....??
cheers,
Bill Au wrote:
>
> If you use cron, you should use the new "-c" option of snapshooter which
> only takes a snapshot where there have been changes. My personal
> preference
> is to use postCommit and postOptimize event listeners.
>
> Bill
>
> On Wed, Oct 1, 2008 at 4:28 AM, sunnyfr <jo...@gmail.com> wrote:
>
>>
>> Hi guys,
>>
>> Do you think it works better automaticly by solr after commit, fire
>> snapshooter or start cron job.
>>
>> Thanks,
>>
>>
>> hossman_lucene wrote:
>> >
>> >
>> > : I want to run 3 to 4 instances of solr on different machines. the
>> > other
>> > : servers will be replicatin the index from the single server.
>> > : how is that done and what options needed to modifies or added to
>> config
>> > : xml file of solr.
>> >
>> > I would start by looking at these wiki pages...
>> >
>> > http://wiki.apache.org/solr/CollectionDistribution
>> > http://wiki.apache.org/solr/SolrCollectionDistributionOperationsOutline
>> >
>> > ...they explain everything you need to know about how the
>> > creation/replication/installation of snapshots works. then if you look
>> at
>> > the example solrconfig.xml you'll see where the event listeners for
>> > "snapshooter" are commented out ... just decide wether you want to
>> create
>> > snapshoots on each commit, or just after an optimize, and uncomment the
>> > appropriate code.
>> >
>> >
>> >
>> > -Hoss
>> >
>> >
>> >
>>
>> --
>> View this message in context:
>> http://www.nabble.com/Replication-on-solr-tp5780286p19756456.html
>> Sent from the Solr - User mailing list archive at Nabble.com.
>>
>>
>
>
--
View this message in context: http://www.nabble.com/Replication-on-solr-tp5780286p19760430.html
Sent from the Solr - User mailing list archive at Nabble.com.
Re: Replication on solr
Posted by Bill Au <bi...@gmail.com>.
If you use cron, you should use the new "-c" option of snapshooter which
only takes a snapshot where there have been changes. My personal preference
is to use postCommit and postOptimize event listeners.
Bill
On Wed, Oct 1, 2008 at 4:28 AM, sunnyfr <jo...@gmail.com> wrote:
>
> Hi guys,
>
> Do you think it works better automaticly by solr after commit, fire
> snapshooter or start cron job.
>
> Thanks,
>
>
> hossman_lucene wrote:
> >
> >
> > : I want to run 3 to 4 instances of solr on different machines. the
> > other
> > : servers will be replicatin the index from the single server.
> > : how is that done and what options needed to modifies or added to
> config
> > : xml file of solr.
> >
> > I would start by looking at these wiki pages...
> >
> > http://wiki.apache.org/solr/CollectionDistribution
> > http://wiki.apache.org/solr/SolrCollectionDistributionOperationsOutline
> >
> > ...they explain everything you need to know about how the
> > creation/replication/installation of snapshots works. then if you look
> at
> > the example solrconfig.xml you'll see where the event listeners for
> > "snapshooter" are commented out ... just decide wether you want to create
> > snapshoots on each commit, or just after an optimize, and uncomment the
> > appropriate code.
> >
> >
> >
> > -Hoss
> >
> >
> >
>
> --
> View this message in context:
> http://www.nabble.com/Replication-on-solr-tp5780286p19756456.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>
>
Re: Replication on solr
Posted by sunnyfr <jo...@gmail.com>.
Hi guys,
Do you think it works better automaticly by solr after commit, fire
snapshooter or start cron job.
Thanks,
hossman_lucene wrote:
>
>
> : I want to run 3 to 4 instances of solr on different machines. the
> other
> : servers will be replicatin the index from the single server.
> : how is that done and what options needed to modifies or added to config
> : xml file of solr.
>
> I would start by looking at these wiki pages...
>
> http://wiki.apache.org/solr/CollectionDistribution
> http://wiki.apache.org/solr/SolrCollectionDistributionOperationsOutline
>
> ...they explain everything you need to know about how the
> creation/replication/installation of snapshots works. then if you look at
> the example solrconfig.xml you'll see where the event listeners for
> "snapshooter" are commented out ... just decide wether you want to create
> snapshoots on each commit, or just after an optimize, and uncomment the
> appropriate code.
>
>
>
> -Hoss
>
>
>
--
View this message in context: http://www.nabble.com/Replication-on-solr-tp5780286p19756456.html
Sent from the Solr - User mailing list archive at Nabble.com.
Re: Replication on solr
Posted by Chris Hostetter <ho...@fucit.org>.
: I want to run 3 to 4 instances of solr on different machines. the other
: servers will be replicatin the index from the single server.
: how is that done and what options needed to modifies or added to config
: xml file of solr.
I would start by looking at these wiki pages...
http://wiki.apache.org/solr/CollectionDistribution
http://wiki.apache.org/solr/SolrCollectionDistributionOperationsOutline
...they explain everything you need to know about how the
creation/replication/installation of snapshots works. then if you look at
the example solrconfig.xml you'll see where the event listeners for
"snapshooter" are commented out ... just decide wether you want to create
snapshoots on each commit, or just after an optimize, and uncomment the
appropriate code.
-Hoss