You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by "ZAROGKIKAS,GIORGOS" <g....@multirama.gr> on 2010/09/30 10:03:01 UTC
Solr Cluster Indexing data question
Hi there solr experts
I have an solr cluster with two nodes and separate index files for each
node
Node1 is master
Node2 is slave
Node1 is the one that I index my data and replicate them to Node2
How can I index my data at both nodes simultaneously ?????
Is there any specific setup ????
The problem is when my Node1 is down and I index the data from Node2 ,
Solr creates backup index folders like this "index.20100929060410"
and reduce the space of my hard disk
Thanks in advance
Re: Solr Cluster Indexing data question
Posted by Chris Hostetter <ho...@fucit.org>.
: Subject: Solr Cluster Indexing data question
: References: <12...@n3.nabble.com>
: <1E...@progressivealliance.co.uk>
http://people.apache.org/~hossman/#threadhijack
Thread Hijacking on Mailing Lists
When starting a new discussion on a mailing list, please do not reply to
an existing message, instead start a fresh email. Even if you change the
subject line of your email, other mail headers still track which thread
you replied to and your question is "hidden" in that thread and gets less
attention. It makes following discussions in the mailing list archives
particularly difficult.
See Also: http://en.wikipedia.org/wiki/User:DonDiego/Thread_hijacking
-Hoss
--
http://lucenerevolution.org/ ... October 7-8, Boston
http://bit.ly/stump-hoss ... Stump The Chump!
RE: Solr Cluster Indexing data question
Posted by "ZAROGKIKAS,GIORGOS" <g....@multirama.gr>.
Thank you very much Jak
I 'll take a look
-----Original Message-----
From: Jak Akdemir [mailto:jakdemir@gmail.com]
Sent: Thursday, September 30, 2010 5:58 PM
To: solr-user@lucene.apache.org
Subject: Re: Solr Cluster Indexing data question
If you want to use both of your nodes for building index (which means
two master), it makes them unified and collapses master slave
relation.
Would you take a look the link below for index snapshot problem?
http://wiki.apache.org/solr/SolrCollectionDistributionScripts
On Thu, Sep 30, 2010 at 11:03 AM, ZAROGKIKAS,GIORGOS
<g....@multirama.gr> wrote:
> Hi there solr experts
>
>
> I have an solr cluster with two nodes and separate index files for each
> node
>
> Node1 is master
> Node2 is slave
>
>
> Node1 is the one that I index my data and replicate them to Node2
>
> How can I index my data at both nodes simultaneously ?????
> Is there any specific setup ????
>
>
> The problem is when my Node1 is down and I index the data from Node2 ,
> Solr creates backup index folders like this "index.20100929060410"
> and reduce the space of my hard disk
>
> Thanks in advance
>
>
>
>
>
>
>
RE: Solr Cluster Indexing data question
Posted by "ZAROGKIKAS,GIORGOS" <g....@multirama.gr>.
Thanks Steve
I'll check it out
-----Original Message-----
From: Steve Cohen [mailto:mail4steve@gmail.com]
Sent: Thursday, September 30, 2010 9:30 PM
To: solr-user@lucene.apache.org
Subject: Re: Solr Cluster Indexing data question
So how would one set it up to use multiple nodes for building an index?
I
see a document for solr + hadoop
(http://wiki.apache.org/solr/HadoopIndexing)
and it says it has an example but the example is missing.
Thanks,
Steve Cohen
On Thu, Sep 30, 2010 at 10:58 AM, Jak Akdemir <ja...@gmail.com>
wrote:
> If you want to use both of your nodes for building index (which means
> two master), it makes them unified and collapses master slave
> relation.
>
> Would you take a look the link below for index snapshot problem?
> http://wiki.apache.org/solr/SolrCollectionDistributionScripts
>
> On Thu, Sep 30, 2010 at 11:03 AM, ZAROGKIKAS,GIORGOS
> <g....@multirama.gr> wrote:
> > Hi there solr experts
> >
> >
> > I have an solr cluster with two nodes and separate index files for
each
> > node
> >
> > Node1 is master
> > Node2 is slave
> >
> >
> > Node1 is the one that I index my data and replicate them to Node2
> >
> > How can I index my data at both nodes simultaneously ?????
> > Is there any specific setup ????
> >
> >
> > The problem is when my Node1 is down and I index the data from Node2
,
> > Solr creates backup index folders like this "index.20100929060410"
> > and reduce the space of my hard disk
> >
> > Thanks in advance
> >
> >
> >
> >
> >
> >
> >
>
Re: Solr Cluster Indexing data question
Posted by Steve Cohen <ma...@gmail.com>.
So how would one set it up to use multiple nodes for building an index? I
see a document for solr + hadoop (http://wiki.apache.org/solr/HadoopIndexing)
and it says it has an example but the example is missing.
Thanks,
Steve Cohen
On Thu, Sep 30, 2010 at 10:58 AM, Jak Akdemir <ja...@gmail.com> wrote:
> If you want to use both of your nodes for building index (which means
> two master), it makes them unified and collapses master slave
> relation.
>
> Would you take a look the link below for index snapshot problem?
> http://wiki.apache.org/solr/SolrCollectionDistributionScripts
>
> On Thu, Sep 30, 2010 at 11:03 AM, ZAROGKIKAS,GIORGOS
> <g....@multirama.gr> wrote:
> > Hi there solr experts
> >
> >
> > I have an solr cluster with two nodes and separate index files for each
> > node
> >
> > Node1 is master
> > Node2 is slave
> >
> >
> > Node1 is the one that I index my data and replicate them to Node2
> >
> > How can I index my data at both nodes simultaneously ?????
> > Is there any specific setup ????
> >
> >
> > The problem is when my Node1 is down and I index the data from Node2 ,
> > Solr creates backup index folders like this "index.20100929060410"
> > and reduce the space of my hard disk
> >
> > Thanks in advance
> >
> >
> >
> >
> >
> >
> >
>
Re: Solr Cluster Indexing data question
Posted by Jak Akdemir <ja...@gmail.com>.
If you want to use both of your nodes for building index (which means
two master), it makes them unified and collapses master slave
relation.
Would you take a look the link below for index snapshot problem?
http://wiki.apache.org/solr/SolrCollectionDistributionScripts
On Thu, Sep 30, 2010 at 11:03 AM, ZAROGKIKAS,GIORGOS
<g....@multirama.gr> wrote:
> Hi there solr experts
>
>
> I have an solr cluster with two nodes and separate index files for each
> node
>
> Node1 is master
> Node2 is slave
>
>
> Node1 is the one that I index my data and replicate them to Node2
>
> How can I index my data at both nodes simultaneously ?????
> Is there any specific setup ????
>
>
> The problem is when my Node1 is down and I index the data from Node2 ,
> Solr creates backup index folders like this "index.20100929060410"
> and reduce the space of my hard disk
>
> Thanks in advance
>
>
>
>
>
>
>