You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@manifoldcf.apache.org by Arcadius Ahouansou <ar...@menelic.com> on 2013/11/06 03:46:11 UTC

Re-indexing Data into Solr

Hello.

I have ManifoldCF crawling and indexing data into Solr.

Let's say I have done a  schema adjustment in Solr and I need to re-index
all of the data.

Is the crawled data available in PostgreSQL, in which case, I could just
use Solr DIH for indexing or or do I have to  re-crawling the web?

Thanks.

Arcadius.

Re: Re-indexing Data into Solr

Posted by Karl Wright <da...@gmail.com>.
Hi Arcadius,

You do have to recrawl if you changed any part of the Solr schema that
ManifoldCF data would have contributed to.  The way you do that is to just
click the "Reindex all documents" link on the Solr output connection's view
page, and run the job again.  If it was a continuous job, just leave it
running and it ought to catch up.

Karl




On Tue, Nov 5, 2013 at 9:46 PM, Arcadius Ahouansou <ar...@menelic.com>wrote:

>
> Hello.
>
> I have ManifoldCF crawling and indexing data into Solr.
>
> Let's say I have done a  schema adjustment in Solr and I need to re-index
> all of the data.
>
> Is the crawled data available in PostgreSQL, in which case, I could just
> use Solr DIH for indexing or or do I have to  re-crawling the web?
>
> Thanks.
>
> Arcadius.
>

Re: Re-indexing Data into Solr

Posted by Shinichiro Abe <sh...@gmail.com>.
Hi, 

Yes, you have to re-crawl repositories when Solr's schema is changed.

Thanks,
Shinichiro Abe

On 2013/11/06, at 11:46, Arcadius Ahouansou <ar...@menelic.com> wrote:

> 
> Hello.
> 
> I have ManifoldCF crawling and indexing data into Solr.
> 
> Let's say I have done a  schema adjustment in Solr and I need to re-index all of the data.
> 
> Is the crawled data available in PostgreSQL, in which case, I could just use Solr DIH for indexing or or do I have to  re-crawling the web?
> 
> Thanks.
> 
> Arcadius.


Re: Re-indexing Data into Solr

Posted by Muhammed Olgun <mh...@gmail.com>.
Hi,

If you crawl from web, it might be better to use continuous crawling.

Regards
Muhammet


On Nov 6, 2013, at 4:46 AM, Arcadius Ahouansou <ar...@menelic.com> wrote:

> 
> Hello.
> 
> I have ManifoldCF crawling and indexing data into Solr.
> 
> Let's say I have done a  schema adjustment in Solr and I need to re-index all of the data.
> 
> Is the crawled data available in PostgreSQL, in which case, I could just use Solr DIH for indexing or or do I have to  re-crawling the web?
> 
> Thanks.
> 
> Arcadius.