Store data with bulk loader via Jena API

[Davide Curcio <da...@live.com>]

I used the bulk loader with Jena API to store data in TDB, but I don't know what is
the best way to use it. Because I create statements for each iteration,
and I pass data to bulk loader via InputStream. But if I
store data after load statements into a model, I have an
OutOfMemoryError, but I store data for each iteration, the system is too
slow. So, I would like to know what is the best way to do this with Jena
API.

Thanks

Re: Store data with bulk loader via Jena API

[Andy Seaborne <an...@apache.org>]

Davide,

The bulk loader only does anything special if the database is empty. 
Otherwise,

Can you group a number of iterations together together and load the 
group?  That amortizes the transaction costs.

Or write the updates to a external file, then load that file.

     Andy

On 12/03/18 16:59, Davide Curcio wrote:
> I used the bulk loader with Jena API to store data in TDB, but I don't know what is
> the best way to use it. Because I create statements for each iteration,
> and I pass data to bulk loader via InputStream. But if I
> store data after load statements into a model, I have an
> OutOfMemoryError, but I store data for each iteration, the system is too
> slow. So, I would like to know what is the best way to do this with Jena
> API.
> 
> Thanks
>