You are viewing a plain text version of this content. The canonical link for it is here.

Posted to solr-user@lucene.apache.org by Antonio Eggberg <an...@yahoo.se> on 2009/04/11 20:37:37 UTC

DIH XML/update

Hi,

Wondering if there is a solution to this. I am using DIH to index an XML feed, I update the feed every 10 min and now I have an index of more then 10 million docs, I do DIH update/clean = false. Now more and more I update my indexing time is increasing and its coming to a point where I can see indexing time will be greater then the update time. 

Do you have any suggestion? I am thinking of creating a large index and then every X hours merge the small index with the large ones -- small index is the one which gets updated by the feed. any other thoughts? How are you folks doing it?

Regards
Antonio


      __________________________________________________________
Låna pengar utan säkerhet. Jämför vilkor online hos Kelkoo.
http://www.kelkoo.se/c-100390123-lan-utan-sakerhet.html?partnerId=96915014