You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by Rajesh Jain <rj...@gmail.com> on 2013/07/25 21:57:13 UTC

Solr Index Files in a Directories

I have flume sink directory where new files are being written periodically.

How can I instruct solr to index the files in the directory every time a
new file gets written.

Any ideas?

Thanks,
Rajesh

Re: Solr Index Files in a Directories

Posted by Otis Gospodnetic <ot...@gmail.com>.
Or simply use Flume Solr Sink and skip writing to local disk.

Otis
--
Solr & ElasticSearch Support -- http://sematext.com/
Performance Monitoring -- http://sematext.com/spm



On Thu, Jul 25, 2013 at 11:02 PM, Jack Krupansky
<ja...@basetechnology.com> wrote:
> Use LucidWorks Search, define a file system data source and set the schedule
> to crawl the directory every minute, 5 minutes, 30 seconds, or whatever
> interval you want.
>
> http://docs.lucidworks.com/display/lweug/Simple+Filesystem+Data+Sources
> http://docs.lucidworks.com/display/help/Schedules
>
> -- Jack Krupansky
>
> -----Original Message----- From: Rajesh Jain
> Sent: Thursday, July 25, 2013 3:57 PM
> To: solr-user@lucene.apache.org
> Subject: Solr Index Files in a Directories
>
>
> I have flume sink directory where new files are being written periodically.
>
> How can I instruct solr to index the files in the directory every time a
> new file gets written.
>
> Any ideas?
>
> Thanks,
> Rajesh

Re: Solr Index Files in a Directories

Posted by Jack Krupansky <ja...@basetechnology.com>.
Use LucidWorks Search, define a file system data source and set the schedule 
to crawl the directory every minute, 5 minutes, 30 seconds, or whatever 
interval you want.

http://docs.lucidworks.com/display/lweug/Simple+Filesystem+Data+Sources
http://docs.lucidworks.com/display/help/Schedules

-- Jack Krupansky

-----Original Message----- 
From: Rajesh Jain
Sent: Thursday, July 25, 2013 3:57 PM
To: solr-user@lucene.apache.org
Subject: Solr Index Files in a Directories

I have flume sink directory where new files are being written periodically.

How can I instruct solr to index the files in the directory every time a
new file gets written.

Any ideas?

Thanks,
Rajesh