Camel-MongoDB: finadAll returns documents in laks - How to improve performance?

[selva <sg...@gmail.com>]

I am using in my camel spring DSl route with mongo findAll operation.
My route contains below:

<to
uri="mongodb:testDb?database={{testDb}}&collection={{testCollection}}&operation=findAll"
/>
<choice>
<when>
<simple>${headers.CamelMongoDbResultTotalSize} > 0 </simple>
<split streaming="true" parallelProcessing="true">
....
...mongo insert..
..mongo update...
..
</split>

Here I am enabled multi threading option in Splitter EIP pattern. If Mongo
returns 1 Lakh records in this case it throws below exception

*org.apache.camel.component.mongodb.CamelMongoDbException:
java.lang.IllegalArgumentException: response too long: 1936028162*

Note: Splitter EIP without parallelProcessing its process all the 1 lakh
records and its taking 30 minuts.

- Inside splitter I am doing mongo insertion and updation.

I am using com.mongodb.MongoClient & com.mongodb.MongoClientURI for mongo DB
connections.

Pls advise , is there anyway to improve the performance.




--
View this message in context: http://camel.465427.n5.nabble.com/Camel-MongoDB-finadAll-returns-documents-in-laks-How-to-improve-performance-tp5760569.html
Sent from the Camel - Users mailing list archive at Nabble.com.