You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@jena.apache.org by Martin Vasilev <mr...@gmail.com> on 2013/08/09 17:42:50 UTC
OutOfMemoryError: Java heap space exception when tbquiry-ing
Hi,
Just installed Jena 2.10.1 and playing around with the tdbloader,
tdbloader2 and tdbquery cmd tools. The strange thing is when I execute
tdbquery I get java.lang.OutOfMemoryError: Java heap space exception.
Doing the following commands:
./tdbloader --loc=../temp/
../../edubase-rdf-r2rc3/dataset/EduBaseExtract.rdf
The EduBaseExtract.rdf has about 6.2 million triples. The triples are
loaded without errors - Then I execute the following :
./tdbquery --loc=../temp/ --query query.txt --time -v
I read jvm may be limited for 1.5 or 2 GB of RAM but should the amount
of ram be bound to the size of the store? I mean if that is the problem
and 2 GB ram are not enoght for 6.2 million how much ram a system has to
have for a 60 or 600 mil. store?
Regards,
Martin
Re: OutOfMemoryError: Java heap space exception when tbquiry-ing
Posted by Andy Seaborne <an...@apache.org>.
On 09/08/13 21:10, Martin Vassilev wrote:
> On 08/09/2013 06:48 PM, Andy Seaborne wrote:
>> On 09/08/13 16:42, Martin Vasilev wrote:
>>> Hi,
>>>
>>> Just installed Jena 2.10.1 and playing around with the tdbloader,
>>> tdbloader2 and tdbquery cmd tools. The strange thing is when I execute
>>> tdbquery I get java.lang.OutOfMemoryError: Java heap space exception.
>>>
>>> Doing the following commands:
>>>
>>> ./tdbloader --loc=../temp/
>>> ../../edubase-rdf-r2rc3/dataset/EduBaseExtract.rdf
>>> The EduBaseExtract.rdf has about 6.2 million triples. The triples are
>>> loaded without errors - Then I execute the following :
>>> ./tdbquery --loc=../temp/ --query query.txt --time -v
>>>
>>> I read jvm may be limited for 1.5 or 2 GB of RAM but should the amount
>>> of ram be bound to the size of the store? I mean if that is the problem
>>> and 2 GB ram are not enoght for 6.2 million how much ram a system has to
>>> have for a 60 or 600 mil. store?
>>
>> It's usually enough.
>>
>>>
>>> Regards,
>>> Martin
>>
>> What's in query.txt?
>>
>> Andy
>>
>
> Hi, There is just " select * where {?s ?p ?o} ". Where is the value
> defining the max amount of ram used by jena ? Maybe it needs to be
> increased...
>
> Martin
./tdbquery --loc=../temp/ --query query.txt --time -v
You have chosen the default output format, which is formatter plain
text. To do that, the text formatter needs to calculate column widths
and to do that it needs to scan all the results, go back then output the
text now it knows the padding to add to columns.
That needs an in-memory copy for the intermediate result set.
Choose a format such as TSV or JSON that is streaming. --results=tsv or
--results=json.
Andy
Re: OutOfMemoryError: Java heap space exception when tbquiry-ing
Posted by Martin Vassilev <mr...@gmail.com>.
On 08/09/2013 06:48 PM, Andy Seaborne wrote:
> On 09/08/13 16:42, Martin Vasilev wrote:
>> Hi,
>>
>> Just installed Jena 2.10.1 and playing around with the tdbloader,
>> tdbloader2 and tdbquery cmd tools. The strange thing is when I execute
>> tdbquery I get java.lang.OutOfMemoryError: Java heap space exception.
>>
>> Doing the following commands:
>>
>> ./tdbloader --loc=../temp/
>> ../../edubase-rdf-r2rc3/dataset/EduBaseExtract.rdf
>> The EduBaseExtract.rdf has about 6.2 million triples. The triples are
>> loaded without errors - Then I execute the following :
>> ./tdbquery --loc=../temp/ --query query.txt --time -v
>>
>> I read jvm may be limited for 1.5 or 2 GB of RAM but should the amount
>> of ram be bound to the size of the store? I mean if that is the problem
>> and 2 GB ram are not enoght for 6.2 million how much ram a system has to
>> have for a 60 or 600 mil. store?
>
> It's usually enough.
>
>>
>> Regards,
>> Martin
>
> What's in query.txt?
>
> Andy
>
Hi, There is just " select * where {?s ?p ?o} ". Where is the value
defining the max amount of ram used by jena ? Maybe it needs to be
increased...
Martin
Re: OutOfMemoryError: Java heap space exception when tbquiry-ing
Posted by Andy Seaborne <an...@apache.org>.
On 09/08/13 16:42, Martin Vasilev wrote:
> Hi,
>
> Just installed Jena 2.10.1 and playing around with the tdbloader,
> tdbloader2 and tdbquery cmd tools. The strange thing is when I execute
> tdbquery I get java.lang.OutOfMemoryError: Java heap space exception.
>
> Doing the following commands:
>
> ./tdbloader --loc=../temp/
> ../../edubase-rdf-r2rc3/dataset/EduBaseExtract.rdf
> The EduBaseExtract.rdf has about 6.2 million triples. The triples are
> loaded without errors - Then I execute the following :
> ./tdbquery --loc=../temp/ --query query.txt --time -v
>
> I read jvm may be limited for 1.5 or 2 GB of RAM but should the amount
> of ram be bound to the size of the store? I mean if that is the problem
> and 2 GB ram are not enoght for 6.2 million how much ram a system has to
> have for a 60 or 600 mil. store?
It's usually enough.
>
> Regards,
> Martin
What's in query.txt?
Andy