You are viewing a plain text version of this content. The canonical link for it is here.

Posted to solr-user@lucene.apache.org by javaxmlsoapdev <vi...@yahoo.com> on 2009/11/25 19:46:14 UTC

Batch file upload using solrJ API

Is there an API to upload files over one connection versus looping through
all the files and creating new ContentStreamUpdateRequest for each file.
This, as expected, doesn't work if there are large number of files and
quickly run into memory problems. Please advise.

Thanks,


-- 
View this message in context: http://old.nabble.com/Batch-file-upload-using-solrJ-API-tp26518167p26518167.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: Batch file upload using solrJ API

Posted by Chris Hostetter <ho...@fucit.org>.

: Is there an API to upload files over one connection versus looping through
: all the files and creating new ContentStreamUpdateRequest for each file.
: This, as expected, doesn't work if there are large number of files and
: quickly run into memory problems. Please advise.

can you elaborate on what types of problems you are having? ... there's no 
reason why the number of files should affect the behavior.

Showing some example code and the stack traces from errors you are getting 
would be the best way to help people understand exactly what type of 
problem you are having.



-Hoss

Re: Batch file upload using solrJ API

Posted by javaxmlsoapdev <vi...@yahoo.com>.

Any suggestion/pointers on this?

javaxmlsoapdev wrote:
> 
> Is there an API to upload files over one connection versus looping through
> all the files and creating new ContentStreamUpdateRequest for each file.
> This, as expected, doesn't work if there are large number of files and
> quickly run into memory problems. Please advise.
> 
> Thanks,
> 
> 
> 

-- 
View this message in context: http://old.nabble.com/Batch-file-upload-using-solrJ-API-tp26518167p26576268.html
Sent from the Solr - User mailing list archive at Nabble.com.