You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by hadyelsahar <ha...@gmail.com> on 2013/01/27 11:23:37 UTC
indexing Text file in solr
i have a large Arabic Text File that contains Tweets each line contains one
tweet , that i want to index in solr such that each line of this document
should be indexed in a separate solr document
what i tried so far :
i know how to SQL databse records in solr
i know how to change solr schema to fit the data and working with Data
import handler
i know how the queries used to index data in solr
what i want is :
know how to index text file in solr in order that each line is considered a
solr document
--
View this message in context: http://lucene.472066.n3.nabble.com/indexing-Text-file-in-solr-tp4036496.html
Sent from the Solr - User mailing list archive at Nabble.com.
Re: indexing Text file in solr
Posted by Jan Høydahl <ja...@cominvent.com>.
If you're lucky, the file has a format suitable for the CSV update handler http://wiki.apache.org/solr/UpdateCSV
Note that if your file does not containt unique ID, you can generate those http://wiki.apache.org/solr/UniqueKey
You can then use CURL or http://wiki.apache.org/solr/post.jar to index it
--
Jan Høydahl, search solution architect
Cominvent AS - www.cominvent.com
Solr Training - www.solrtraining.com
27. jan. 2013 kl. 11:23 skrev hadyelsahar <ha...@gmail.com>:
> i have a large Arabic Text File that contains Tweets each line contains one
> tweet , that i want to index in solr such that each line of this document
> should be indexed in a separate solr document
>
> what i tried so far :
>
> i know how to SQL databse records in solr
> i know how to change solr schema to fit the data and working with Data
> import handler
> i know how the queries used to index data in solr
> what i want is :
>
> know how to index text file in solr in order that each line is considered a
> solr document
>
>
>
> --
> View this message in context: http://lucene.472066.n3.nabble.com/indexing-Text-file-in-solr-tp4036496.html
> Sent from the Solr - User mailing list archive at Nabble.com.
Re: indexing Text file in solr
Posted by Edward Garrett <he...@gmail.com>.
i don't have experience with this but it looks like you could use, from DIH:
http://wiki.apache.org/solr/DataImportHandler#LineEntityProcessor
On Sun, Jan 27, 2013 at 10:23 AM, hadyelsahar <ha...@gmail.com> wrote:
> i have a large Arabic Text File that contains Tweets each line contains one
> tweet , that i want to index in solr such that each line of this document
> should be indexed in a separate solr document
>
> what i tried so far :
>
> i know how to SQL databse records in solr
> i know how to change solr schema to fit the data and working with Data
> import handler
> i know how the queries used to index data in solr
> what i want is :
>
> know how to index text file in solr in order that each line is considered a
> solr document
>
>
>
> --
> View this message in context: http://lucene.472066.n3.nabble.com/indexing-Text-file-in-solr-tp4036496.html
> Sent from the Solr - User mailing list archive at Nabble.com.
--
edge