You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@clerezza.apache.org by "Tsuyoshi Ito (JIRA)" <ji...@apache.org> on 2011/01/04 12:43:46 UTC
[jira] Created: (CLEREZZA-384) Parser.getInstance().parse(mGraph,
serializedGraph, formatidentifier) throws Exception
java.lang.OutOfMemoryError when parses several large turtle files
Parser.getInstance().parse(mGraph, serializedGraph, formatidentifier) throws Exception java.lang.OutOfMemoryError when parses several large turtle files
--------------------------------------------------------------------------------------------------------------------------------------------------------
Key: CLEREZZA-384
URL: https://issues.apache.org/jira/browse/CLEREZZA-384
Project: Clerezza
Issue Type: Bug
Reporter: Tsuyoshi Ito
Priority: Critical
WARN qtp1345062578-23 - /admin/import org.apache.clerezza.triaxrs.JaxRsHandler - Exception (with no exception mapper)
java.lang.OutOfMemoryError: Java heap space
at java.util.Arrays.copyOf(Arrays.java:2882)
at java.lang.AbstractStringBuilder.expandCapacity(AbstractStringBuilder.java:100)
at java.lang.AbstractStringBuilder.append(AbstractStringBuilder.java:572)
at java.lang.StringBuilder.append(StringBuilder.java:203)
at org.openjena.riot.tokens.TokenizerText.insertCodepoint(TokenizerText.java:750)
at org.openjena.riot.tokens.TokenizerText.allBetween(TokenizerText.java:743)
at org.openjena.riot.tokens.TokenizerText.parseToken(TokenizerText.java:188)
at org.openjena.riot.tokens.TokenizerText.hasNext(TokenizerText.java:69)
at org.openjena.atlas.iterator.PeekIterator.fill(PeekIterator.java:37)
at org.openjena.atlas.iterator.PeekIterator.next(PeekIterator.java:77)
at org.openjena.riot.lang.LangBase.nextToken(LangBase.java:145)
at org.openjena.riot.lang.LangTurtleBase.predicateObjectItem(LangTurtleBase.java:272)
at org.openjena.riot.lang.LangTurtleBase.predicateObjectList(LangTurtleBase.java:265)
at org.openjena.riot.lang.LangTurtleBase.triples(LangTurtleBase.java:245)
at org.openjena.riot.lang.LangTurtleBase.triplesSameSubject(LangTurtleBase.java:206)
at org.openjena.riot.lang.LangTurtle.oneTopLevelElement(LangTurtle.java:34)
at org.openjena.riot.lang.LangTurtleBase.runParser(LangTurtleBase.java:132)
at org.openjena.riot.lang.LangBase.parse(LangBase.java:75)
at org.openjena.riot.system.JenaReaderTurtle2.readWorker(JenaReaderTurtle2.java:34)
at org.openjena.riot.system.JenaReaderRIOT.readImpl(JenaReaderRIOT.java:124)
at org.openjena.riot.system.JenaReaderRIOT.read(JenaReaderRIOT.java:79)
at com.hp.hpl.jena.rdf.model.impl.ModelCom.read(ModelCom.java:226)
at org.apache.clerezza.rdf.jena.parser.JenaParserProvider.parse(JenaParserProvider.java:68)
at org.apache.clerezza.rdf.core.serializedform.Parser.parse(Parser.java:191)
at org.apache.clerezza.rdf.core.serializedform.Parser.parse(Parser.java:144)
at org.trialox.importer.Importer.importFiles(Importer.java:102)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.clerezza.triaxrs.RootResourceExecutorImpl.handleWithMethod(RootResourceExecutorImpl.java:469)
at org.apache.clerezza.triaxrs.RootResourceExecutorImpl.execute(RootResourceExecutorImpl.java:119)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] [Closed] (CLEREZZA-384) Parser.getInstance().parse(mGraph,
serializedGraph, formatidentifier) throws Exception
java.lang.OutOfMemoryError when parses several large turtle files
Posted by "Hasan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CLEREZZA-384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hasan closed CLEREZZA-384.
--------------------------
Resolution: Cannot Reproduce
I tried to execute the test provided by the issue as follows:
MAVEN_OPTS="-Xmx256m -Xms128m" mvn clean install exec:java -e
and did not get out of memory exception.
> Parser.getInstance().parse(mGraph, serializedGraph, formatidentifier) throws Exception java.lang.OutOfMemoryError when parses several large turtle files
> --------------------------------------------------------------------------------------------------------------------------------------------------------
>
> Key: CLEREZZA-384
> URL: https://issues.apache.org/jira/browse/CLEREZZA-384
> Project: Clerezza
> Issue Type: Bug
> Reporter: Tsuyoshi Ito
> Assignee: Hasan
> Priority: Critical
>
> WARN qtp1345062578-23 - /admin/import org.apache.clerezza.triaxrs.JaxRsHandler - Exception (with no exception mapper)
> java.lang.OutOfMemoryError: Java heap space
> at java.util.Arrays.copyOf(Arrays.java:2882)
> at java.lang.AbstractStringBuilder.expandCapacity(AbstractStringBuilder.java:100)
> at java.lang.AbstractStringBuilder.append(AbstractStringBuilder.java:572)
> at java.lang.StringBuilder.append(StringBuilder.java:203)
> at org.openjena.riot.tokens.TokenizerText.insertCodepoint(TokenizerText.java:750)
> at org.openjena.riot.tokens.TokenizerText.allBetween(TokenizerText.java:743)
> at org.openjena.riot.tokens.TokenizerText.parseToken(TokenizerText.java:188)
> at org.openjena.riot.tokens.TokenizerText.hasNext(TokenizerText.java:69)
> at org.openjena.atlas.iterator.PeekIterator.fill(PeekIterator.java:37)
> at org.openjena.atlas.iterator.PeekIterator.next(PeekIterator.java:77)
> at org.openjena.riot.lang.LangBase.nextToken(LangBase.java:145)
> at org.openjena.riot.lang.LangTurtleBase.predicateObjectItem(LangTurtleBase.java:272)
> at org.openjena.riot.lang.LangTurtleBase.predicateObjectList(LangTurtleBase.java:265)
> at org.openjena.riot.lang.LangTurtleBase.triples(LangTurtleBase.java:245)
> at org.openjena.riot.lang.LangTurtleBase.triplesSameSubject(LangTurtleBase.java:206)
> at org.openjena.riot.lang.LangTurtle.oneTopLevelElement(LangTurtle.java:34)
> at org.openjena.riot.lang.LangTurtleBase.runParser(LangTurtleBase.java:132)
> at org.openjena.riot.lang.LangBase.parse(LangBase.java:75)
> at org.openjena.riot.system.JenaReaderTurtle2.readWorker(JenaReaderTurtle2.java:34)
> at org.openjena.riot.system.JenaReaderRIOT.readImpl(JenaReaderRIOT.java:124)
> at org.openjena.riot.system.JenaReaderRIOT.read(JenaReaderRIOT.java:79)
> at com.hp.hpl.jena.rdf.model.impl.ModelCom.read(ModelCom.java:226)
> at org.apache.clerezza.rdf.jena.parser.JenaParserProvider.parse(JenaParserProvider.java:68)
> at org.apache.clerezza.rdf.core.serializedform.Parser.parse(Parser.java:191)
> at org.apache.clerezza.rdf.core.serializedform.Parser.parse(Parser.java:144)
> at org.trialox.importer.Importer.importFiles(Importer.java:102)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.clerezza.triaxrs.RootResourceExecutorImpl.handleWithMethod(RootResourceExecutorImpl.java:469)
> at org.apache.clerezza.triaxrs.RootResourceExecutorImpl.execute(RootResourceExecutorImpl.java:119)
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (CLEREZZA-384) Parser.getInstance().parse(mGraph,
serializedGraph, formatidentifier) throws Exception
java.lang.OutOfMemoryError when parses several large turtle files
Posted by "Reto Bachmann-Gmür (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CLEREZZA-384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Reto Bachmann-Gmür reassigned CLEREZZA-384:
-------------------------------------------
Assignee: Hasan (was: Reto Bachmann-Gmür)
Not sure if this is still an issue, thanks Hasan for looking into it.
> Parser.getInstance().parse(mGraph, serializedGraph, formatidentifier) throws Exception java.lang.OutOfMemoryError when parses several large turtle files
> --------------------------------------------------------------------------------------------------------------------------------------------------------
>
> Key: CLEREZZA-384
> URL: https://issues.apache.org/jira/browse/CLEREZZA-384
> Project: Clerezza
> Issue Type: Bug
> Reporter: Tsuyoshi Ito
> Assignee: Hasan
> Priority: Critical
>
> WARN qtp1345062578-23 - /admin/import org.apache.clerezza.triaxrs.JaxRsHandler - Exception (with no exception mapper)
> java.lang.OutOfMemoryError: Java heap space
> at java.util.Arrays.copyOf(Arrays.java:2882)
> at java.lang.AbstractStringBuilder.expandCapacity(AbstractStringBuilder.java:100)
> at java.lang.AbstractStringBuilder.append(AbstractStringBuilder.java:572)
> at java.lang.StringBuilder.append(StringBuilder.java:203)
> at org.openjena.riot.tokens.TokenizerText.insertCodepoint(TokenizerText.java:750)
> at org.openjena.riot.tokens.TokenizerText.allBetween(TokenizerText.java:743)
> at org.openjena.riot.tokens.TokenizerText.parseToken(TokenizerText.java:188)
> at org.openjena.riot.tokens.TokenizerText.hasNext(TokenizerText.java:69)
> at org.openjena.atlas.iterator.PeekIterator.fill(PeekIterator.java:37)
> at org.openjena.atlas.iterator.PeekIterator.next(PeekIterator.java:77)
> at org.openjena.riot.lang.LangBase.nextToken(LangBase.java:145)
> at org.openjena.riot.lang.LangTurtleBase.predicateObjectItem(LangTurtleBase.java:272)
> at org.openjena.riot.lang.LangTurtleBase.predicateObjectList(LangTurtleBase.java:265)
> at org.openjena.riot.lang.LangTurtleBase.triples(LangTurtleBase.java:245)
> at org.openjena.riot.lang.LangTurtleBase.triplesSameSubject(LangTurtleBase.java:206)
> at org.openjena.riot.lang.LangTurtle.oneTopLevelElement(LangTurtle.java:34)
> at org.openjena.riot.lang.LangTurtleBase.runParser(LangTurtleBase.java:132)
> at org.openjena.riot.lang.LangBase.parse(LangBase.java:75)
> at org.openjena.riot.system.JenaReaderTurtle2.readWorker(JenaReaderTurtle2.java:34)
> at org.openjena.riot.system.JenaReaderRIOT.readImpl(JenaReaderRIOT.java:124)
> at org.openjena.riot.system.JenaReaderRIOT.read(JenaReaderRIOT.java:79)
> at com.hp.hpl.jena.rdf.model.impl.ModelCom.read(ModelCom.java:226)
> at org.apache.clerezza.rdf.jena.parser.JenaParserProvider.parse(JenaParserProvider.java:68)
> at org.apache.clerezza.rdf.core.serializedform.Parser.parse(Parser.java:191)
> at org.apache.clerezza.rdf.core.serializedform.Parser.parse(Parser.java:144)
> at org.trialox.importer.Importer.importFiles(Importer.java:102)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.clerezza.triaxrs.RootResourceExecutorImpl.handleWithMethod(RootResourceExecutorImpl.java:469)
> at org.apache.clerezza.triaxrs.RootResourceExecutorImpl.execute(RootResourceExecutorImpl.java:119)
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (CLEREZZA-384) Parser.getInstance().parse(mGraph,
serializedGraph, formatidentifier) throws Exception
java.lang.OutOfMemoryError when parses several large turtle files
Posted by "Hasan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CLEREZZA-384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12982584#action_12982584 ]
Hasan commented on CLEREZZA-384:
--------------------------------
I think this is not the problem of the parser or the underlying parsingprovider itself, but rather the problem of maintaining bnodes mapping in JenaGraphAdaptor.
Although one cause of the memory leak in the bnodes mapping has been resolved in CLEREZZA-395, this issue requires another solution since the map will keep growing with increasing number of bnodes in the graph. I think, if we can avoid having this mapping, it would be ideal.
> Parser.getInstance().parse(mGraph, serializedGraph, formatidentifier) throws Exception java.lang.OutOfMemoryError when parses several large turtle files
> --------------------------------------------------------------------------------------------------------------------------------------------------------
>
> Key: CLEREZZA-384
> URL: https://issues.apache.org/jira/browse/CLEREZZA-384
> Project: Clerezza
> Issue Type: Bug
> Reporter: Tsuyoshi Ito
> Assignee: Reto Bachmann-Gmür
> Priority: Critical
>
> WARN qtp1345062578-23 - /admin/import org.apache.clerezza.triaxrs.JaxRsHandler - Exception (with no exception mapper)
> java.lang.OutOfMemoryError: Java heap space
> at java.util.Arrays.copyOf(Arrays.java:2882)
> at java.lang.AbstractStringBuilder.expandCapacity(AbstractStringBuilder.java:100)
> at java.lang.AbstractStringBuilder.append(AbstractStringBuilder.java:572)
> at java.lang.StringBuilder.append(StringBuilder.java:203)
> at org.openjena.riot.tokens.TokenizerText.insertCodepoint(TokenizerText.java:750)
> at org.openjena.riot.tokens.TokenizerText.allBetween(TokenizerText.java:743)
> at org.openjena.riot.tokens.TokenizerText.parseToken(TokenizerText.java:188)
> at org.openjena.riot.tokens.TokenizerText.hasNext(TokenizerText.java:69)
> at org.openjena.atlas.iterator.PeekIterator.fill(PeekIterator.java:37)
> at org.openjena.atlas.iterator.PeekIterator.next(PeekIterator.java:77)
> at org.openjena.riot.lang.LangBase.nextToken(LangBase.java:145)
> at org.openjena.riot.lang.LangTurtleBase.predicateObjectItem(LangTurtleBase.java:272)
> at org.openjena.riot.lang.LangTurtleBase.predicateObjectList(LangTurtleBase.java:265)
> at org.openjena.riot.lang.LangTurtleBase.triples(LangTurtleBase.java:245)
> at org.openjena.riot.lang.LangTurtleBase.triplesSameSubject(LangTurtleBase.java:206)
> at org.openjena.riot.lang.LangTurtle.oneTopLevelElement(LangTurtle.java:34)
> at org.openjena.riot.lang.LangTurtleBase.runParser(LangTurtleBase.java:132)
> at org.openjena.riot.lang.LangBase.parse(LangBase.java:75)
> at org.openjena.riot.system.JenaReaderTurtle2.readWorker(JenaReaderTurtle2.java:34)
> at org.openjena.riot.system.JenaReaderRIOT.readImpl(JenaReaderRIOT.java:124)
> at org.openjena.riot.system.JenaReaderRIOT.read(JenaReaderRIOT.java:79)
> at com.hp.hpl.jena.rdf.model.impl.ModelCom.read(ModelCom.java:226)
> at org.apache.clerezza.rdf.jena.parser.JenaParserProvider.parse(JenaParserProvider.java:68)
> at org.apache.clerezza.rdf.core.serializedform.Parser.parse(Parser.java:191)
> at org.apache.clerezza.rdf.core.serializedform.Parser.parse(Parser.java:144)
> at org.trialox.importer.Importer.importFiles(Importer.java:102)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.clerezza.triaxrs.RootResourceExecutorImpl.handleWithMethod(RootResourceExecutorImpl.java:469)
> at org.apache.clerezza.triaxrs.RootResourceExecutorImpl.execute(RootResourceExecutorImpl.java:119)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Assigned: (CLEREZZA-384) Parser.getInstance().parse(mGraph,
serializedGraph, formatidentifier) throws Exception
java.lang.OutOfMemoryError when parses several large turtle files
Posted by "Reto Bachmann-Gmür (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CLEREZZA-384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Reto Bachmann-Gmür reassigned CLEREZZA-384:
-------------------------------------------
Assignee: Reto Bachmann-Gmür
> Parser.getInstance().parse(mGraph, serializedGraph, formatidentifier) throws Exception java.lang.OutOfMemoryError when parses several large turtle files
> --------------------------------------------------------------------------------------------------------------------------------------------------------
>
> Key: CLEREZZA-384
> URL: https://issues.apache.org/jira/browse/CLEREZZA-384
> Project: Clerezza
> Issue Type: Bug
> Reporter: Tsuyoshi Ito
> Assignee: Reto Bachmann-Gmür
> Priority: Critical
>
> WARN qtp1345062578-23 - /admin/import org.apache.clerezza.triaxrs.JaxRsHandler - Exception (with no exception mapper)
> java.lang.OutOfMemoryError: Java heap space
> at java.util.Arrays.copyOf(Arrays.java:2882)
> at java.lang.AbstractStringBuilder.expandCapacity(AbstractStringBuilder.java:100)
> at java.lang.AbstractStringBuilder.append(AbstractStringBuilder.java:572)
> at java.lang.StringBuilder.append(StringBuilder.java:203)
> at org.openjena.riot.tokens.TokenizerText.insertCodepoint(TokenizerText.java:750)
> at org.openjena.riot.tokens.TokenizerText.allBetween(TokenizerText.java:743)
> at org.openjena.riot.tokens.TokenizerText.parseToken(TokenizerText.java:188)
> at org.openjena.riot.tokens.TokenizerText.hasNext(TokenizerText.java:69)
> at org.openjena.atlas.iterator.PeekIterator.fill(PeekIterator.java:37)
> at org.openjena.atlas.iterator.PeekIterator.next(PeekIterator.java:77)
> at org.openjena.riot.lang.LangBase.nextToken(LangBase.java:145)
> at org.openjena.riot.lang.LangTurtleBase.predicateObjectItem(LangTurtleBase.java:272)
> at org.openjena.riot.lang.LangTurtleBase.predicateObjectList(LangTurtleBase.java:265)
> at org.openjena.riot.lang.LangTurtleBase.triples(LangTurtleBase.java:245)
> at org.openjena.riot.lang.LangTurtleBase.triplesSameSubject(LangTurtleBase.java:206)
> at org.openjena.riot.lang.LangTurtle.oneTopLevelElement(LangTurtle.java:34)
> at org.openjena.riot.lang.LangTurtleBase.runParser(LangTurtleBase.java:132)
> at org.openjena.riot.lang.LangBase.parse(LangBase.java:75)
> at org.openjena.riot.system.JenaReaderTurtle2.readWorker(JenaReaderTurtle2.java:34)
> at org.openjena.riot.system.JenaReaderRIOT.readImpl(JenaReaderRIOT.java:124)
> at org.openjena.riot.system.JenaReaderRIOT.read(JenaReaderRIOT.java:79)
> at com.hp.hpl.jena.rdf.model.impl.ModelCom.read(ModelCom.java:226)
> at org.apache.clerezza.rdf.jena.parser.JenaParserProvider.parse(JenaParserProvider.java:68)
> at org.apache.clerezza.rdf.core.serializedform.Parser.parse(Parser.java:191)
> at org.apache.clerezza.rdf.core.serializedform.Parser.parse(Parser.java:144)
> at org.trialox.importer.Importer.importFiles(Importer.java:102)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.clerezza.triaxrs.RootResourceExecutorImpl.handleWithMethod(RootResourceExecutorImpl.java:469)
> at org.apache.clerezza.triaxrs.RootResourceExecutorImpl.execute(RootResourceExecutorImpl.java:119)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.