Index Loading

[pof <Me...@gmail.com>]

Hello, I have a question regarding indexing loading. My situation is to use
Solr to index an initial ~30K documents with regular updates. I am making a
java app to parse all these docs to plain text and then loading them onto an
xml to POST to Solr. My concern is that creating an xml for each document
and calling the post.jar for each will be I/O costly and if I make an xml
from all the documents will be too massive on disk. Are there any
suggestions on how to proceed?

Thanks guys, Brett.
-- 
View this message in context: http://www.nabble.com/Index-Loading-tp23954608p23954608.html
Sent from the Solr - Dev mailing list archive at Nabble.com.

Re: Index Loading

[Noble Paul നോബിള്‍ नोब्ळ् <no...@corp.aol.com>]

use SolrJ ,

try CommonsHttpSolrServer# add(Iterator<SolrInputDocument> docIterator)

method



On Wed, Jun 10, 2009 at 7:58 AM, pof<Me...@gmail.com> wrote:
>
> Hello, I have a question regarding indexing loading. My situation is to use
> Solr to index an initial ~30K documents with regular updates. I am making a
> java app to parse all these docs to plain text and then loading them onto an
> xml to POST to Solr. My concern is that creating an xml for each document
> and calling the post.jar for each will be I/O costly and if I make an xml
> from all the documents will be too massive on disk. Are there any
> suggestions on how to proceed?
>
> Thanks guys, Brett.
> --
> View this message in context: http://www.nabble.com/Index-Loading-tp23954608p23954608.html
> Sent from the Solr - Dev mailing list archive at Nabble.com.
>
>



-- 
-----------------------------------------------------
Noble Paul | Principal Engineer| AOL | http://aol.com