You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@jena.apache.org by Andy Seaborne <an...@epimorphics.com> on 2011/05/06 11:24:28 UTC
ANN: Joseki 3.4.4
This is release of Joseki to bring it into line with the current
versions of ARQ and of TDB and SDB.
Andy
Downloads:
http://sourceforge.net/projects/joseki/files/Joseki-SPARQL/Joseki-3.4.4/joseki-3.4.4.zip/download
and in the maven repository:
Maven details:
http://www.openjena.org/repo/org/joseki/joseki/3.4.4/
<dependency>
<groupId>org.joseki</groupId>
<artifactId>joseki</artifactId>
<version>3.4.4</version>
</dependency>
<repository>
<id>repo-jena</id>
<name>Jena Maven - Repository</name>
<layout>default</layout>
<url>http://openjena.org/repo</url>
<snapshots>
<enabled>false</enabled>
</snapshots>
</repository>
Re: ANN: Joseki 3.4.4
Posted by Andy Seaborne <an...@epimorphics.com>.
On 25/05/11 11:38, Michael Brunnbauer wrote:
> re
>
> The problem was caused by an error in my servlet mapping. I used
>
> <servlet-name>SPARQL service processor</servlet-name>
>
> for my SPARQL update serviceRef instead of
>
> <servlet-name>SPARQL/Update service processor</servlet-name>
>
> The SPARQL update service was working anyway but throwed the
> ConcurrentModificationException instead of waiting for a lock.
>
> Is there any chance this broken setup has caused TDB corruption with
> Joseki-3.4.3 ?
Going by some of the stacktraces you've shown, then yes. They are
caused by not locking correctly.
Thanks for letting everyone know the root cause.
Andy
>
> cu,
> brunni
Re: ANN: Joseki 3.4.4
Posted by Michael Brunnbauer <br...@netestate.de>.
re
The problem was caused by an error in my servlet mapping. I used
<servlet-name>SPARQL service processor</servlet-name>
for my SPARQL update serviceRef instead of
<servlet-name>SPARQL/Update service processor</servlet-name>
The SPARQL update service was working anyway but throwed the
ConcurrentModificationException instead of waiting for a lock.
Is there any chance this broken setup has caused TDB corruption with
Joseki-3.4.3 ?
cu,
brunni
On Fri, May 20, 2011 at 09:42:04AM +0100, Andy Seaborne wrote:
>
>
> On 18/05/11 12:48, Michael Brunnbauer wrote:
> >
> >re
> >
> >On Wed, May 18, 2011 at 12:33:34PM +0100, Andy Seaborne wrote:
> >>That was the reason in the msg I pointed to - charset on the
> >>application/x-www-form-urlencoded. Could you try the form version
> >>s-update-form.
> >
> >Now I get "400 Can't find request from 'request' parameter or POST body".
>
> This should include the URL
>
> >s-update-form is using the parameter update but Joseki is expecting
> >request.
> >If i change update= to request= in the script it works and I can still
> >reproduce the error.
> >
> >Is it possible that you tried to reproduce my error with Fuseki instead of
> >Joseki-3.4.4 ? I have no other explanation that s-update worked for you.
> >
> >cu,
> >brunni
> >
>
> I'm using the Joseki 3.4.4 distribution (bin/rdfserver), the test
> database you sent me and
>
> java version "1.6.0_22"
> OpenJDK Runtime Environment (IcedTea6 1.10.1) (6b22-1.10.1-0ubuntu1)
> OpenJDK 64-Bit Server VM (build 20.0-b11, mixed mode)
>
> I've tried two different machines, using the scripts I posted. I did
> have problems with the s-update-form script but s-update and s-query
> worked fine.
>
> Could you start from a clean download, the config and scripts I used?
> There may be some difference in environments - what's your setup?
>
> Andy
--
++ Michael Brunnbauer
++ netEstate GmbH
++ Geisenhausener Straße 11a
++ 81379 München
++ Tel +49 89 32 19 77 80
++ Fax +49 89 32 19 77 89
++ E-Mail brunni@netestate.de
++ http://www.netestate.de/
++
++ Sitz: München, HRB Nr.142452 (Handelsregister B München)
++ USt-IdNr. DE221033342
++ Geschäftsführer: Michael Brunnbauer, Franz Brunnbauer
++ Prokurist: Dipl. Kfm. (Univ.) Markus Hendel
Re: ANN: Joseki 3.4.4
Posted by Andy Seaborne <an...@epimorphics.com>.
On 18/05/11 12:48, Michael Brunnbauer wrote:
>
> re
>
> On Wed, May 18, 2011 at 12:33:34PM +0100, Andy Seaborne wrote:
>> That was the reason in the msg I pointed to - charset on the
>> application/x-www-form-urlencoded. Could you try the form version
>> s-update-form.
>
> Now I get "400 Can't find request from 'request' parameter or POST body".
This should include the URL
> s-update-form is using the parameter update but Joseki is expecting request.
> If i change update= to request= in the script it works and I can still
> reproduce the error.
>
> Is it possible that you tried to reproduce my error with Fuseki instead of
> Joseki-3.4.4 ? I have no other explanation that s-update worked for you.
>
> cu,
> brunni
>
I'm using the Joseki 3.4.4 distribution (bin/rdfserver), the test
database you sent me and
java version "1.6.0_22"
OpenJDK Runtime Environment (IcedTea6 1.10.1) (6b22-1.10.1-0ubuntu1)
OpenJDK 64-Bit Server VM (build 20.0-b11, mixed mode)
I've tried two different machines, using the scripts I posted. I did
have problems with the s-update-form script but s-update and s-query
worked fine.
Could you start from a clean download, the config and scripts I used?
There may be some difference in environments - what's your setup?
Andy
Re: ANN: Joseki 3.4.4
Posted by Michael Brunnbauer <br...@netestate.de>.
re
On Wed, May 18, 2011 at 12:33:34PM +0100, Andy Seaborne wrote:
> That was the reason in the msg I pointed to - charset on the
> application/x-www-form-urlencoded. Could you try the form version
> s-update-form.
Now I get "400 Can't find request from 'request' parameter or POST body".
s-update-form is using the parameter update but Joseki is expecting request.
If i change update= to request= in the script it works and I can still
reproduce the error.
Is it possible that you tried to reproduce my error with Fuseki instead of
Joseki-3.4.4 ? I have no other explanation that s-update worked for you.
cu,
brunni
--
++ Michael Brunnbauer
++ netEstate GmbH
++ Geisenhausener Straße 11a
++ 81379 München
++ Tel +49 89 32 19 77 80
++ Fax +49 89 32 19 77 89
++ E-Mail brunni@netestate.de
++ http://www.netestate.de/
++
++ Sitz: München, HRB Nr.142452 (Handelsregister B München)
++ USt-IdNr. DE221033342
++ Geschäftsführer: Michael Brunnbauer, Franz Brunnbauer
++ Prokurist: Dipl. Kfm. (Univ.) Markus Hendel
Re: ANN: Joseki 3.4.4
Posted by Andy Seaborne <an...@epimorphics.com>.
That was the reason in the msg I pointed to - charset on the
application/x-www-form-urlencoded. Could you try the form version
s-update-form.
I didn't think this area had changed but may a bug has been fixed since
0.2.0.
Andy
On 18/05/11 12:29, Michael Brunnbauer wrote:
>
> re
>
> On Wed, May 18, 2011 at 12:01:14PM +0100, Andy Seaborne wrote:
>> http://mail-archives.apache.org/mod_mbox/incubator-jena-users/201105.mbox/%3C69935.16679.qm@web161617.mail.bf1.yahoo.com%3E
>> which is fixed in SVN (caveat the wrong SVN - see email about code move)
>> As to why your ruby setup is setting charset and mine does not, I don't
>> know.
>
> Are you talking about the charset in the HTTP request ? There is none.
> This was sniffed from the lo network interface:
>
> POST /testupdate HTTP/1.1
> User-Agent: SOH/Fuseki 0.0.0
> Content-Type: application/sparql-update
> Host: localhost:2021
> Content-Length: 133
That isn't a application/x-www-form-urlencoded
>
> load<http://blogspace.com/swhack/chatlogs/rdflogs/2002-06-24.rdf> into<http://blogspace.com/swhack/chatlogs/rdflogs/2002-06-24.rdf>
>
> There is a charset in the HTTP response:
>
> HTTP/1.1 415 Must be application/x-www-form-urlencoded
> Content-Type: text/html; charset=iso-8859-1
> Cache-Control: must-revalidate,no-cache,no-store
> Content-Length: 1439
> Server: Jetty(6.1.25)
>
> <html>
> <head>
> <meta http-equiv="Content-Type" content="text/html; charset=ISO-8859-1"/>
> <title>Error 415 Must be application/x-www-form-urlencoded</title>
> </head>
> <body><h2>HTTP ERROR 415</h2>
> <p>Problem accessing /testupdate. Reason:
> <pre> Must be application/x-www-form-urlencoded</pre></p><hr /><i><small>Powered by Jetty://</small></i><br/>
> <br/>
> <br/>
> <br/>
> <br/>
> <br/>
> <br/>
> <br/>
> <br/>
> <br/>
> <br/>
> <br/>
> <br/>
> <br/>
> <br/>
> <br/>
> <br/>
> <br/>
> <br/>
> <br/>
>
> </body>
> </html>
>
>> I have:
>> LANG=C
>> GDM_LANG=en_GB.utf8
>
> I do not set any variables on this system which should be equivalent to LANG=C
>
> cu,
> brunni
>
Re: ANN: Joseki 3.4.4
Posted by Michael Brunnbauer <br...@netestate.de>.
re
On Wed, May 18, 2011 at 12:01:14PM +0100, Andy Seaborne wrote:
> http://mail-archives.apache.org/mod_mbox/incubator-jena-users/201105.mbox/%3C69935.16679.qm@web161617.mail.bf1.yahoo.com%3E
> which is fixed in SVN (caveat the wrong SVN - see email about code move)
> As to why your ruby setup is setting charset and mine does not, I don't
> know.
Are you talking about the charset in the HTTP request ? There is none.
This was sniffed from the lo network interface:
POST /testupdate HTTP/1.1
User-Agent: SOH/Fuseki 0.0.0
Content-Type: application/sparql-update
Host: localhost:2021
Content-Length: 133
load <http://blogspace.com/swhack/chatlogs/rdflogs/2002-06-24.rdf> into <http://blogspace.com/swhack/chatlogs/rdflogs/2002-06-24.rdf>
There is a charset in the HTTP response:
HTTP/1.1 415 Must be application/x-www-form-urlencoded
Content-Type: text/html; charset=iso-8859-1
Cache-Control: must-revalidate,no-cache,no-store
Content-Length: 1439
Server: Jetty(6.1.25)
<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=ISO-8859-1"/>
<title>Error 415 Must be application/x-www-form-urlencoded</title>
</head>
<body><h2>HTTP ERROR 415</h2>
<p>Problem accessing /testupdate. Reason:
<pre> Must be application/x-www-form-urlencoded</pre></p><hr /><i><small>Powered by Jetty://</small></i><br/>
<br/>
<br/>
<br/>
<br/>
<br/>
<br/>
<br/>
<br/>
<br/>
<br/>
<br/>
<br/>
<br/>
<br/>
<br/>
<br/>
<br/>
<br/>
<br/>
</body>
</html>
> I have:
> LANG=C
> GDM_LANG=en_GB.utf8
I do not set any variables on this system which should be equivalent to LANG=C
cu,
brunni
--
++ Michael Brunnbauer
++ netEstate GmbH
++ Geisenhausener Straße 11a
++ 81379 München
++ Tel +49 89 32 19 77 80
++ Fax +49 89 32 19 77 89
++ E-Mail brunni@netestate.de
++ http://www.netestate.de/
++
++ Sitz: München, HRB Nr.142452 (Handelsregister B München)
++ USt-IdNr. DE221033342
++ Geschäftsführer: Michael Brunnbauer, Franz Brunnbauer
++ Prokurist: Dipl. Kfm. (Univ.) Markus Hendel
Re: ANN: Joseki 3.4.4
Posted by Andy Seaborne <an...@epimorphics.com>.
See
http://mail-archives.apache.org/mod_mbox/incubator-jena-users/201105.mbox/%3C69935.16679.qm@web161617.mail.bf1.yahoo.com%3E
which is fixed in SVN (caveat the wrong SVN - see email about code move)
As to why your ruby setup is setting charset and mine does not, I don't
know.
I have:
LANG=C
GDM_LANG=en_GB.utf8
Andy
On 18/05/11 09:16, Michael Brunnbauer wrote:
>
> re
>
> I have installed ruby + fuseki-0.2.0-SOH.zip and can get the "query" shell
> script working but not the "load" shell script:
>
> chianti:~/Fuseki-0.2.0$ ./load
> 415 Must be application/x-www-form-urlencoded http://localhost:2021/testupdate
> chianti:~/Fuseki-0.2.0$ cat load
> #!/bin/sh
> X='load<http://blogspace.com/swhack/chatlogs/rdflogs/2002-06-24.rdf> into<http://blogspace.com/swhack/chatlogs/rdflogs/2002-06-24.rdf>'
> ./s-update --service http://localhost:2021/testupdate "$X"
>
> My ruby installation lives in /home/test/ruby so I had to change the first
> line of all s-* scripts from
>
> #!/usr/bin/env ruby
>
> to
>
> #!/usr/bin/env /home/test/ruby/bin/ruby
>
> Any idea what is going wrong ?
>
> cu,
> brunni
>
> On Tue, May 17, 2011 at 08:48:42PM +0100, Andy Seaborne wrote:
>> load:
>> -------------------------------------
>> #!/bin/bash
>>
>> X='load<http://blogspace.com/swhack/chatlogs/rdflogs/2002-06-24.rdf>
>> into<http://blogspace.com/swhack/chatlogs/rdflogs/2002-06-24.rdf>'
>>
>> ../s-update --service http://localhost:2020/update "$X"
>> -------------------------------------
>> query:
>> -------------------------------------
>> #!/bin/bash
>>
>> Q='select count(*) where { graph ?g { ?s ?p ?o }}'
>>
>> ../s-query --service http://localhost:2020/sparql "$Q"
>>
>> -------------------------------------
>>
>> s-* are the scripts from Fuseki.
>> http://openjena.org/repo/org/openjena/fuseki/0.2.0/fuseki-0.2.0-SOH.zip
>
Re: ANN: Joseki 3.4.4
Posted by Michael Brunnbauer <br...@netestate.de>.
re
I have installed ruby + fuseki-0.2.0-SOH.zip and can get the "query" shell
script working but not the "load" shell script:
chianti:~/Fuseki-0.2.0$ ./load
415 Must be application/x-www-form-urlencoded http://localhost:2021/testupdate
chianti:~/Fuseki-0.2.0$ cat load
#!/bin/sh
X='load <http://blogspace.com/swhack/chatlogs/rdflogs/2002-06-24.rdf> into <http://blogspace.com/swhack/chatlogs/rdflogs/2002-06-24.rdf>'
./s-update --service http://localhost:2021/testupdate "$X"
My ruby installation lives in /home/test/ruby so I had to change the first
line of all s-* scripts from
#!/usr/bin/env ruby
to
#!/usr/bin/env /home/test/ruby/bin/ruby
Any idea what is going wrong ?
cu,
brunni
On Tue, May 17, 2011 at 08:48:42PM +0100, Andy Seaborne wrote:
> load:
> -------------------------------------
> #!/bin/bash
>
> X='load <http://blogspace.com/swhack/chatlogs/rdflogs/2002-06-24.rdf>
> into <http://blogspace.com/swhack/chatlogs/rdflogs/2002-06-24.rdf>'
>
> ../s-update --service http://localhost:2020/update "$X"
> -------------------------------------
> query:
> -------------------------------------
> #!/bin/bash
>
> Q='select count(*) where { graph ?g { ?s ?p ?o }}'
>
> ../s-query --service http://localhost:2020/sparql "$Q"
>
> -------------------------------------
>
> s-* are the scripts from Fuseki.
> http://openjena.org/repo/org/openjena/fuseki/0.2.0/fuseki-0.2.0-SOH.zip
--
++ Michael Brunnbauer
++ netEstate GmbH
++ Geisenhausener Straße 11a
++ 81379 München
++ Tel +49 89 32 19 77 80
++ Fax +49 89 32 19 77 89
++ E-Mail brunni@netestate.de
++ http://www.netestate.de/
++
++ Sitz: München, HRB Nr.142452 (Handelsregister B München)
++ USt-IdNr. DE221033342
++ Geschäftsführer: Michael Brunnbauer, Franz Brunnbauer
++ Prokurist: Dipl. Kfm. (Univ.) Markus Hendel
Re: ANN: Joseki 3.4.4
Posted by Andy Seaborne <an...@epimorphics.com>.
Michael sent me a copy of his database.
cc'ed jena-users@incubator.apache.org
On 16/05/11 14:43, Michael Brunnbauer wrote:
>
> re
>
> On Thu, May 12, 2011 at 09:57:36PM +0100, Andy Seaborne wrote:
>> I can't reproduce the error - I'm running Joseki, breakpointing in a
>> query, issuing the update (using the SOH sripts s-query and s-update)
>> and the update is locked out.
>>
>> Could you give some more details - what's the update, what do the
>> concurrent queries look like?
>
> I can reproduce the ConcurrentModificationException with the attached TDB
> containing 100000 Quads and the attached config file. If I do
>
> load<http://blogspace.com/swhack/chatlogs/rdflogs/2002-06-24.rdf>
> into<http://blogspace.com/swhack/chatlogs/rdflogs/2002-06-24.rdf>
>
> on the testupdate service from a HTML form and then (quick)
>
> select count(*) where { graph ?g { ?s ?p ?o }}
>
> on the test service from another HTML form, I get the error for the
select.
>
> Does this help you ?
>
> Can you confirm that TDB 0.8.8 will have problems with TDBs modified
by TDB
> 0.8.10 ?
>
> cu,
> brunni
>
No luck I'm afraid. Works for me.
joseki-config attached. This is Joseki in CVS at the moment.
load:
-------------------------------------
#!/bin/bash
X='load <http://blogspace.com/swhack/chatlogs/rdflogs/2002-06-24.rdf>
into <http://blogspace.com/swhack/chatlogs/rdflogs/2002-06-24.rdf>'
../s-update --service http://localhost:2020/update "$X"
-------------------------------------
query:
-------------------------------------
#!/bin/bash
Q='select count(*) where { graph ?g { ?s ?p ?o }}'
../s-query --service http://localhost:2020/sparql "$Q"
-------------------------------------
s-* are the scripts from Fuseki.
http://openjena.org/repo/org/openjena/fuseki/0.2.0/fuseki-0.2.0-SOH.zip
using your database, I put 'query' in a loop to hammer the server, then
issued the 'load' multiple times. It worked - and when a load hit the
server I saw the query rate stutter as the load took a lock.
Andy
Re: ANN: Joseki 3.4.4
Posted by Michael Brunnbauer <br...@netestate.de>.
re
BTW: The graph http://blogspace.com/swhack/chatlogs/rdflogs/2002-06-24.rdf
was added to the TDB with Joseki-3.4.4. Perhaps datasets modified with
tdb-0.8.10 as in Joseki-3.4.4 are incompatible to tdb-0.8.8 as in Joseki-3.4.3?
cu,
brunni
On Thu, May 12, 2011 at 11:35:01AM +0200, Michael Brunnbauer wrote:
>
> re
>
> I think my TDB is broken now. I got a memory error on
>
> SELECT DISTINCT ?subj ?prop ?obj WHERE { GRAPH <http://blogspace.com/swhack/chatlogs/rdflogs/2002-06-24.rdf> { ?subj ?prop ?obj } }
>
> If I change -Xmx1G to -Xmx4G in bin/rdfserver, I do not get the memory error
> but lots of errors of this kind:
>
> 11:18:04 INFO SPARQL :: Query: SELECT DISTINCT ?subj ?prop ?obj W
> HERE { GRAPH <http://blogspace.com/swhack/chatlogs/rdflogs/2002-06-24.rdf> { ?subj ?prop ?obj } }
> 11:18:04 INFO SPARQL :: OK/select: SELECT DISTINCT ?subj ?prop ?obj WHERE { GRAPH <http://blogspace.com/swhack/chatlogs/rdfl
> ogs/2002-06-24.rdf> { ?subj ?prop ?obj } }
> 11:18:05 ERROR BindingTDB :: get1(?subj)
> com.hp.hpl.jena.tdb.base.file.FileException: ObjectFile.read: Failed to read the object (795439970 bytes) : got 149584 bytes
> at com.hp.hpl.jena.tdb.base.objectfile.ObjectFileDiskDirect.read(ObjectFileDiskDirect.java:182)
> at com.hp.hpl.jena.tdb.lib.NodeLib.fetchDecode(NodeLib.java:66)
> at com.hp.hpl.jena.tdb.nodetable.NodeTableNative.readNodeByNodeId(NodeTableNative.java:158)
> at com.hp.hpl.jena.tdb.nodetable.NodeTableNative._retrieveNodeByNodeId(NodeTableNative.java:85)
> at com.hp.hpl.jena.tdb.nodetable.NodeTableNative.getNodeForNodeId(NodeTableNative.java:58)
> at com.hp.hpl.jena.tdb.nodetable.NodeTableCache._retrieveNodeByNodeId(NodeTableCache.java:86)
> at com.hp.hpl.jena.tdb.nodetable.NodeTableCache.getNodeForNodeId(NodeTableCache.java:57)
> at com.hp.hpl.jena.tdb.nodetable.NodeTableWrapper.getNodeForNodeId(NodeTableWrapper.java:43)
> at com.hp.hpl.jena.tdb.nodetable.NodeTableInline.getNodeForNodeId(NodeTableInline.java:55)
> at com.hp.hpl.jena.tdb.solver.BindingTDB.get1(BindingTDB.java:96)
> at com.hp.hpl.jena.sparql.engine.binding.BindingBase.get(BindingBase.java:126)
> at com.hp.hpl.jena.sparql.engine.binding.BindingProject.get1(BindingProject.java:57)
> at com.hp.hpl.jena.sparql.engine.binding.BindingBase.get(BindingBase.java:126)
> at com.hp.hpl.jena.sparql.engine.binding.BindingWrapped.get(BindingWrapped.java:39)
> at com.hp.hpl.jena.sparql.engine.binding.BindingFixed.calcHashCode(BindingFixed.java:33)
> at com.hp.hpl.jena.sparql.engine.binding.BindingFixed.hashCode(BindingFixed.java:64)
> at java.util.HashMap.getEntry(HashMap.java:344)
> at java.util.HashMap.containsKey(HashMap.java:335)
> at java.util.HashSet.contains(HashSet.java:184)
> at com.hp.hpl.jena.sparql.engine.iterator.QueryIterDistinct.isDuplicate(QueryIterDistinct.java:39)
> at com.hp.hpl.jena.sparql.engine.iterator.QueryIterDistinctReduced.hasNextBinding(QueryIterDistinctReduced.java:39)
> at com.hp.hpl.jena.sparql.engine.iterator.QueryIteratorBase.hasNext(QueryIteratorBase.java:66)
> at com.hp.hpl.jena.sparql.engine.iterator.QueryIteratorWrapper.hasNextBinding(QueryIteratorWrapper.java:28)
> at com.hp.hpl.jena.sparql.engine.iterator.QueryIteratorBase.hasNext(QueryIteratorBase.java:66)
> at com.hp.hpl.jena.sparql.engine.iterator.QueryIteratorWrapper.hasNextBinding(QueryIteratorWrapper.java:28)
> at com.hp.hpl.jena.sparql.engine.iterator.QueryIteratorBase.hasNext(QueryIteratorBase.java:66)
> at com.hp.hpl.jena.sparql.engine.ResultSetStream.hasNext(ResultSetStream.java:57)
> at com.hp.hpl.jena.sparql.resultset.ResultSetMem.<init>(ResultSetMem.java:82)
> at com.hp.hpl.jena.sparql.resultset.TextOutput.write(TextOutput.java:133)
> at com.hp.hpl.jena.sparql.resultset.TextOutput.write(TextOutput.java:116)
> at com.hp.hpl.jena.sparql.resultset.TextOutput.write(TextOutput.java:104)
> at com.hp.hpl.jena.sparql.resultset.TextOutput.format(TextOutput.java:51)
> at com.hp.hpl.jena.query.ResultSetFormatter.out(ResultSetFormatter.java:96)
> at com.hp.hpl.jena.query.ResultSetFormatter.out(ResultSetFormatter.java:48)
> at org.joseki.http.ResponseHttp$3.output(ResponseHttp.java:349)
> at org.joseki.http.ResponseHttp.output(ResponseHttp.java:471)
> at org.joseki.http.ResponseHttp.textOutput(ResponseHttp.java:502)
> at org.joseki.http.ResponseHttp.doResponseResult(ResponseHttp.java:345)
> at org.joseki.http.ResponseHttp.doResponseResultSet(ResponseHttp.java:169)
> at org.joseki.Response.sendResponse(Response.java:87)
> at org.joseki.Dispatcher.dispatch(Dispatcher.java:60)
> at org.joseki.http.Servlet.doCommon(Servlet.java:178)
> at org.joseki.http.Servlet.doPost(Servlet.java:247)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:727)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
> at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511)
> at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:390)
> at org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
> at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
> at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:765)
> at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:440)
> at org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114)
> at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
> at org.mortbay.jetty.Server.handle(Server.java:326)
> at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
> at org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:943)
> at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:756)
> at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:218)
> at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
> at org.mortbay.jetty.nio.BlockingChannelConnector$Connection.run(BlockingChannelConnector.java:164)
> at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
> 11:18:06 ERROR BindingTDB :: get1(?subj)
> com.hp.hpl.jena.tdb.base.file.FileException: ObjectFile.read: Failed to read the object (795439970 bytes) : got 149584 bytes
> at com.hp.hpl.jena.tdb.base.objectfile.ObjectFileDiskDirect.read(ObjectFileDiskDirect.java:182)
> at com.hp.hpl.jena.tdb.lib.NodeLib.fetchDecode(NodeLib.java:66)
> at com.hp.hpl.jena.tdb.nodetable.NodeTableNative.readNodeByNodeId(NodeTableNative.java:158)
> at com.hp.hpl.jena.tdb.nodetable.NodeTableNative._retrieveNodeByNodeId(NodeTableNative.java:85)
> at com.hp.hpl.jena.tdb.nodetable.NodeTableNative.getNodeForNodeId(NodeTableNative.java:58)
> at com.hp.hpl.jena.tdb.nodetable.NodeTableCache._retrieveNodeByNodeId(NodeTableCache.java:86)
> at com.hp.hpl.jena.tdb.nodetable.NodeTableCache.getNodeForNodeId(NodeTableCache.java:57)
> at com.hp.hpl.jena.tdb.nodetable.NodeTableWrapper.getNodeForNodeId(NodeTableWrapper.java:43)
> at com.hp.hpl.jena.tdb.nodetable.NodeTableInline.getNodeForNodeId(NodeTableInline.java:55)
> at com.hp.hpl.jena.tdb.solver.BindingTDB.get1(BindingTDB.java:96)
> at com.hp.hpl.jena.sparql.engine.binding.BindingBase.get(BindingBase.java:126)
> at com.hp.hpl.jena.sparql.engine.binding.BindingProject.get1(BindingProject.java:57)
> at com.hp.hpl.jena.sparql.engine.binding.BindingBase.get(BindingBase.java:126)
> at com.hp.hpl.jena.sparql.engine.binding.BindingWrapped.get(BindingWrapped.java:39)
> at com.hp.hpl.jena.sparql.engine.binding.BindingFixed.calcHashCode(BindingFixed.java:33)
> at com.hp.hpl.jena.sparql.engine.binding.BindingFixed.hashCode(BindingFixed.java:64)
> at java.util.HashMap.getEntry(HashMap.java:344)
> at java.util.HashMap.containsKey(HashMap.java:335)
> at java.util.HashSet.contains(HashSet.java:184)
> at com.hp.hpl.jena.sparql.engine.iterator.QueryIterDistinct.isDuplicate(QueryIterDistinct.java:39)
> at com.hp.hpl.jena.sparql.engine.iterator.QueryIterDistinctReduced.hasNextBinding(QueryIterDistinctReduced.java:39)
> at com.hp.hpl.jena.sparql.engine.iterator.QueryIteratorBase.hasNext(QueryIteratorBase.java:66)
> at com.hp.hpl.jena.sparql.engine.iterator.QueryIteratorWrapper.hasNextBinding(QueryIteratorWrapper.java:28)
> at com.hp.hpl.jena.sparql.engine.iterator.QueryIteratorBase.hasNext(QueryIteratorBase.java:66)
> at com.hp.hpl.jena.sparql.engine.iterator.QueryIteratorWrapper.hasNextBinding(QueryIteratorWrapper.java:28)
> at com.hp.hpl.jena.sparql.engine.iterator.QueryIteratorBase.hasNext(QueryIteratorBase.java:66)
> at com.hp.hpl.jena.sparql.engine.ResultSetStream.hasNext(ResultSetStream.java:57)
> [...]
>
> I have a recent backup of that TDB that has not been introduced to
> Joseki-3.4.4.
>
> cu,
> brunni
>
> On Thu, May 12, 2011 at 11:00:28AM +0200, Michael Brunnbauer wrote:
> >
> > re
> >
> > On Thu, May 12, 2011 at 09:46:13AM +0100, Andy Seaborne wrote:
> > > Your config file looks fine to me - two services over the same dataset.
> > > It's two services because SPARQL update and SPARQL query are different
> > > languages (and you can protect the update endpoint separately from the
> > > query endpoint - no injection attacks on the query service). It looks to
> > > me like a Joseki bug in the internal locking.
> >
> > I have downgraded to Joseki-3.4.3 and the problem is gone. Please contact me
> > if you need any cooperation to find the bug.
> >
> > cu,
> > brunni
> >
> > --
> > ++ Michael Brunnbauer
> > ++ netEstate GmbH
> > ++ Geisenhausener Straße 11a
> > ++ 81379 München
> > ++ Tel +49 89 32 19 77 80
> > ++ Fax +49 89 32 19 77 89
> > ++ E-Mail brunni@netestate.de
> > ++ http://www.netestate.de/
> > ++
> > ++ Sitz: München, HRB Nr.142452 (Handelsregister B München)
> > ++ USt-IdNr. DE221033342
> > ++ Geschäftsführer: Michael Brunnbauer, Franz Brunnbauer
> > ++ Prokurist: Dipl. Kfm. (Univ.) Markus Hendel
>
> --
> ++ Michael Brunnbauer
> ++ netEstate GmbH
> ++ Geisenhausener Straße 11a
> ++ 81379 München
> ++ Tel +49 89 32 19 77 80
> ++ Fax +49 89 32 19 77 89
> ++ E-Mail brunni@netestate.de
> ++ http://www.netestate.de/
> ++
> ++ Sitz: München, HRB Nr.142452 (Handelsregister B München)
> ++ USt-IdNr. DE221033342
> ++ Geschäftsführer: Michael Brunnbauer, Franz Brunnbauer
> ++ Prokurist: Dipl. Kfm. (Univ.) Markus Hendel
--
++ Michael Brunnbauer
++ netEstate GmbH
++ Geisenhausener Straße 11a
++ 81379 München
++ Tel +49 89 32 19 77 80
++ Fax +49 89 32 19 77 89
++ E-Mail brunni@netestate.de
++ http://www.netestate.de/
++
++ Sitz: München, HRB Nr.142452 (Handelsregister B München)
++ USt-IdNr. DE221033342
++ Geschäftsführer: Michael Brunnbauer, Franz Brunnbauer
++ Prokurist: Dipl. Kfm. (Univ.) Markus Hendel
Re: ANN: Joseki 3.4.4
Posted by Michael Brunnbauer <br...@netestate.de>.
re
I think my TDB is broken now. I got a memory error on
SELECT DISTINCT ?subj ?prop ?obj WHERE { GRAPH <http://blogspace.com/swhack/chatlogs/rdflogs/2002-06-24.rdf> { ?subj ?prop ?obj } }
If I change -Xmx1G to -Xmx4G in bin/rdfserver, I do not get the memory error
but lots of errors of this kind:
11:18:04 INFO SPARQL :: Query: SELECT DISTINCT ?subj ?prop ?obj W
HERE { GRAPH <http://blogspace.com/swhack/chatlogs/rdflogs/2002-06-24.rdf> { ?subj ?prop ?obj } }
11:18:04 INFO SPARQL :: OK/select: SELECT DISTINCT ?subj ?prop ?obj WHERE { GRAPH <http://blogspace.com/swhack/chatlogs/rdfl
ogs/2002-06-24.rdf> { ?subj ?prop ?obj } }
11:18:05 ERROR BindingTDB :: get1(?subj)
com.hp.hpl.jena.tdb.base.file.FileException: ObjectFile.read: Failed to read the object (795439970 bytes) : got 149584 bytes
at com.hp.hpl.jena.tdb.base.objectfile.ObjectFileDiskDirect.read(ObjectFileDiskDirect.java:182)
at com.hp.hpl.jena.tdb.lib.NodeLib.fetchDecode(NodeLib.java:66)
at com.hp.hpl.jena.tdb.nodetable.NodeTableNative.readNodeByNodeId(NodeTableNative.java:158)
at com.hp.hpl.jena.tdb.nodetable.NodeTableNative._retrieveNodeByNodeId(NodeTableNative.java:85)
at com.hp.hpl.jena.tdb.nodetable.NodeTableNative.getNodeForNodeId(NodeTableNative.java:58)
at com.hp.hpl.jena.tdb.nodetable.NodeTableCache._retrieveNodeByNodeId(NodeTableCache.java:86)
at com.hp.hpl.jena.tdb.nodetable.NodeTableCache.getNodeForNodeId(NodeTableCache.java:57)
at com.hp.hpl.jena.tdb.nodetable.NodeTableWrapper.getNodeForNodeId(NodeTableWrapper.java:43)
at com.hp.hpl.jena.tdb.nodetable.NodeTableInline.getNodeForNodeId(NodeTableInline.java:55)
at com.hp.hpl.jena.tdb.solver.BindingTDB.get1(BindingTDB.java:96)
at com.hp.hpl.jena.sparql.engine.binding.BindingBase.get(BindingBase.java:126)
at com.hp.hpl.jena.sparql.engine.binding.BindingProject.get1(BindingProject.java:57)
at com.hp.hpl.jena.sparql.engine.binding.BindingBase.get(BindingBase.java:126)
at com.hp.hpl.jena.sparql.engine.binding.BindingWrapped.get(BindingWrapped.java:39)
at com.hp.hpl.jena.sparql.engine.binding.BindingFixed.calcHashCode(BindingFixed.java:33)
at com.hp.hpl.jena.sparql.engine.binding.BindingFixed.hashCode(BindingFixed.java:64)
at java.util.HashMap.getEntry(HashMap.java:344)
at java.util.HashMap.containsKey(HashMap.java:335)
at java.util.HashSet.contains(HashSet.java:184)
at com.hp.hpl.jena.sparql.engine.iterator.QueryIterDistinct.isDuplicate(QueryIterDistinct.java:39)
at com.hp.hpl.jena.sparql.engine.iterator.QueryIterDistinctReduced.hasNextBinding(QueryIterDistinctReduced.java:39)
at com.hp.hpl.jena.sparql.engine.iterator.QueryIteratorBase.hasNext(QueryIteratorBase.java:66)
at com.hp.hpl.jena.sparql.engine.iterator.QueryIteratorWrapper.hasNextBinding(QueryIteratorWrapper.java:28)
at com.hp.hpl.jena.sparql.engine.iterator.QueryIteratorBase.hasNext(QueryIteratorBase.java:66)
at com.hp.hpl.jena.sparql.engine.iterator.QueryIteratorWrapper.hasNextBinding(QueryIteratorWrapper.java:28)
at com.hp.hpl.jena.sparql.engine.iterator.QueryIteratorBase.hasNext(QueryIteratorBase.java:66)
at com.hp.hpl.jena.sparql.engine.ResultSetStream.hasNext(ResultSetStream.java:57)
at com.hp.hpl.jena.sparql.resultset.ResultSetMem.<init>(ResultSetMem.java:82)
at com.hp.hpl.jena.sparql.resultset.TextOutput.write(TextOutput.java:133)
at com.hp.hpl.jena.sparql.resultset.TextOutput.write(TextOutput.java:116)
at com.hp.hpl.jena.sparql.resultset.TextOutput.write(TextOutput.java:104)
at com.hp.hpl.jena.sparql.resultset.TextOutput.format(TextOutput.java:51)
at com.hp.hpl.jena.query.ResultSetFormatter.out(ResultSetFormatter.java:96)
at com.hp.hpl.jena.query.ResultSetFormatter.out(ResultSetFormatter.java:48)
at org.joseki.http.ResponseHttp$3.output(ResponseHttp.java:349)
at org.joseki.http.ResponseHttp.output(ResponseHttp.java:471)
at org.joseki.http.ResponseHttp.textOutput(ResponseHttp.java:502)
at org.joseki.http.ResponseHttp.doResponseResult(ResponseHttp.java:345)
at org.joseki.http.ResponseHttp.doResponseResultSet(ResponseHttp.java:169)
at org.joseki.Response.sendResponse(Response.java:87)
at org.joseki.Dispatcher.dispatch(Dispatcher.java:60)
at org.joseki.http.Servlet.doCommon(Servlet.java:178)
at org.joseki.http.Servlet.doPost(Servlet.java:247)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:727)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511)
at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:390)
at org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:765)
at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:440)
at org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114)
at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
at org.mortbay.jetty.Server.handle(Server.java:326)
at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
at org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:943)
at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:756)
at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:218)
at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
at org.mortbay.jetty.nio.BlockingChannelConnector$Connection.run(BlockingChannelConnector.java:164)
at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
11:18:06 ERROR BindingTDB :: get1(?subj)
com.hp.hpl.jena.tdb.base.file.FileException: ObjectFile.read: Failed to read the object (795439970 bytes) : got 149584 bytes
at com.hp.hpl.jena.tdb.base.objectfile.ObjectFileDiskDirect.read(ObjectFileDiskDirect.java:182)
at com.hp.hpl.jena.tdb.lib.NodeLib.fetchDecode(NodeLib.java:66)
at com.hp.hpl.jena.tdb.nodetable.NodeTableNative.readNodeByNodeId(NodeTableNative.java:158)
at com.hp.hpl.jena.tdb.nodetable.NodeTableNative._retrieveNodeByNodeId(NodeTableNative.java:85)
at com.hp.hpl.jena.tdb.nodetable.NodeTableNative.getNodeForNodeId(NodeTableNative.java:58)
at com.hp.hpl.jena.tdb.nodetable.NodeTableCache._retrieveNodeByNodeId(NodeTableCache.java:86)
at com.hp.hpl.jena.tdb.nodetable.NodeTableCache.getNodeForNodeId(NodeTableCache.java:57)
at com.hp.hpl.jena.tdb.nodetable.NodeTableWrapper.getNodeForNodeId(NodeTableWrapper.java:43)
at com.hp.hpl.jena.tdb.nodetable.NodeTableInline.getNodeForNodeId(NodeTableInline.java:55)
at com.hp.hpl.jena.tdb.solver.BindingTDB.get1(BindingTDB.java:96)
at com.hp.hpl.jena.sparql.engine.binding.BindingBase.get(BindingBase.java:126)
at com.hp.hpl.jena.sparql.engine.binding.BindingProject.get1(BindingProject.java:57)
at com.hp.hpl.jena.sparql.engine.binding.BindingBase.get(BindingBase.java:126)
at com.hp.hpl.jena.sparql.engine.binding.BindingWrapped.get(BindingWrapped.java:39)
at com.hp.hpl.jena.sparql.engine.binding.BindingFixed.calcHashCode(BindingFixed.java:33)
at com.hp.hpl.jena.sparql.engine.binding.BindingFixed.hashCode(BindingFixed.java:64)
at java.util.HashMap.getEntry(HashMap.java:344)
at java.util.HashMap.containsKey(HashMap.java:335)
at java.util.HashSet.contains(HashSet.java:184)
at com.hp.hpl.jena.sparql.engine.iterator.QueryIterDistinct.isDuplicate(QueryIterDistinct.java:39)
at com.hp.hpl.jena.sparql.engine.iterator.QueryIterDistinctReduced.hasNextBinding(QueryIterDistinctReduced.java:39)
at com.hp.hpl.jena.sparql.engine.iterator.QueryIteratorBase.hasNext(QueryIteratorBase.java:66)
at com.hp.hpl.jena.sparql.engine.iterator.QueryIteratorWrapper.hasNextBinding(QueryIteratorWrapper.java:28)
at com.hp.hpl.jena.sparql.engine.iterator.QueryIteratorBase.hasNext(QueryIteratorBase.java:66)
at com.hp.hpl.jena.sparql.engine.iterator.QueryIteratorWrapper.hasNextBinding(QueryIteratorWrapper.java:28)
at com.hp.hpl.jena.sparql.engine.iterator.QueryIteratorBase.hasNext(QueryIteratorBase.java:66)
at com.hp.hpl.jena.sparql.engine.ResultSetStream.hasNext(ResultSetStream.java:57)
[...]
I have a recent backup of that TDB that has not been introduced to
Joseki-3.4.4.
cu,
brunni
On Thu, May 12, 2011 at 11:00:28AM +0200, Michael Brunnbauer wrote:
>
> re
>
> On Thu, May 12, 2011 at 09:46:13AM +0100, Andy Seaborne wrote:
> > Your config file looks fine to me - two services over the same dataset.
> > It's two services because SPARQL update and SPARQL query are different
> > languages (and you can protect the update endpoint separately from the
> > query endpoint - no injection attacks on the query service). It looks to
> > me like a Joseki bug in the internal locking.
>
> I have downgraded to Joseki-3.4.3 and the problem is gone. Please contact me
> if you need any cooperation to find the bug.
>
> cu,
> brunni
>
> --
> ++ Michael Brunnbauer
> ++ netEstate GmbH
> ++ Geisenhausener Straße 11a
> ++ 81379 München
> ++ Tel +49 89 32 19 77 80
> ++ Fax +49 89 32 19 77 89
> ++ E-Mail brunni@netestate.de
> ++ http://www.netestate.de/
> ++
> ++ Sitz: München, HRB Nr.142452 (Handelsregister B München)
> ++ USt-IdNr. DE221033342
> ++ Geschäftsführer: Michael Brunnbauer, Franz Brunnbauer
> ++ Prokurist: Dipl. Kfm. (Univ.) Markus Hendel
--
++ Michael Brunnbauer
++ netEstate GmbH
++ Geisenhausener Straße 11a
++ 81379 München
++ Tel +49 89 32 19 77 80
++ Fax +49 89 32 19 77 89
++ E-Mail brunni@netestate.de
++ http://www.netestate.de/
++
++ Sitz: München, HRB Nr.142452 (Handelsregister B München)
++ USt-IdNr. DE221033342
++ Geschäftsführer: Michael Brunnbauer, Franz Brunnbauer
++ Prokurist: Dipl. Kfm. (Univ.) Markus Hendel
Re: ANN: Joseki 3.4.4
Posted by Michael Brunnbauer <br...@netestate.de>.
re
On Thu, May 12, 2011 at 09:46:13AM +0100, Andy Seaborne wrote:
> Your config file looks fine to me - two services over the same dataset.
> It's two services because SPARQL update and SPARQL query are different
> languages (and you can protect the update endpoint separately from the
> query endpoint - no injection attacks on the query service). It looks to
> me like a Joseki bug in the internal locking.
I have downgraded to Joseki-3.4.3 and the problem is gone. Please contact me
if you need any cooperation to find the bug.
cu,
brunni
--
++ Michael Brunnbauer
++ netEstate GmbH
++ Geisenhausener Straße 11a
++ 81379 München
++ Tel +49 89 32 19 77 80
++ Fax +49 89 32 19 77 89
++ E-Mail brunni@netestate.de
++ http://www.netestate.de/
++
++ Sitz: München, HRB Nr.142452 (Handelsregister B München)
++ USt-IdNr. DE221033342
++ Geschäftsführer: Michael Brunnbauer, Franz Brunnbauer
++ Prokurist: Dipl. Kfm. (Univ.) Markus Hendel
Re: ANN: Joseki 3.4.4
Posted by Andy Seaborne <an...@epimorphics.com>.
Your config file looks fine to me - two services over the same dataset.
It's two services because SPARQL update and SPARQL query are different
languages (and you can protect the update endpoint separately from the
query endpoint - no injection attacks on the query service). It looks to
me like a Joseki bug in the internal locking.
Andy
On 12/05/11 09:37, Michael Brunnbauer wrote:
>
> re
>
>> On Wed, May 11, 2011 at 09:45:49PM +0100, Andy Seaborne wrote:
>>>> Yes. The dataset has a SPARQL and an update service. Is it possible to
>>>> configure a service that can do both ?
>>> Yes - it's supposed to work.
>
> I have studied http://www.joseki.org/configuration.html and
> joseki-config-example.ttl but don't know how to do it. Maybe by specifying
> 2x joseki:processor in the service ?
>
> joseki:processor joseki:ProcessorSPARQL_FixedDS ;
> joseki:processor joseki:ProcessorSPARQLUpdate ;
>
> Or 2x module:implementation in the processor ?
>
> module:implementation joseki:ImplSPARQL ;
> module:implementation joseki:ImplSPARQLUpdate ;
>
> Or 2x module:className in the implementation ?
>
> module:className<java:org.joseki.processors.SPARQL> ;
> module:className<java:org.joseki.processors.SPARQLUpdate> ;
>
> Please help.
>
> cu,
> brunni
>
Re: ANN: Joseki 3.4.4
Posted by Michael Brunnbauer <br...@netestate.de>.
re
> On Wed, May 11, 2011 at 09:45:49PM +0100, Andy Seaborne wrote:
> > >Yes. The dataset has a SPARQL and an update service. Is it possible to
> > >configure a service that can do both ?
> > Yes - it's supposed to work.
I have studied http://www.joseki.org/configuration.html and
joseki-config-example.ttl but don't know how to do it. Maybe by specifying
2x joseki:processor in the service ?
joseki:processor joseki:ProcessorSPARQL_FixedDS ;
joseki:processor joseki:ProcessorSPARQLUpdate ;
Or 2x module:implementation in the processor ?
module:implementation joseki:ImplSPARQL ;
module:implementation joseki:ImplSPARQLUpdate ;
Or 2x module:className in the implementation ?
module:className <java:org.joseki.processors.SPARQL> ;
module:className <java:org.joseki.processors.SPARQLUpdate> ;
Please help.
cu,
brunni
--
++ Michael Brunnbauer
++ netEstate GmbH
++ Geisenhausener Straße 11a
++ 81379 München
++ Tel +49 89 32 19 77 80
++ Fax +49 89 32 19 77 89
++ E-Mail brunni@netestate.de
++ http://www.netestate.de/
++
++ Sitz: München, HRB Nr.142452 (Handelsregister B München)
++ USt-IdNr. DE221033342
++ Geschäftsführer: Michael Brunnbauer, Franz Brunnbauer
++ Prokurist: Dipl. Kfm. (Univ.) Markus Hendel
Re: ANN: Joseki 3.4.4
Posted by Michael Brunnbauer <br...@netestate.de>.
re
On Wed, May 11, 2011 at 09:45:49PM +0100, Andy Seaborne wrote:
> >Yes. The dataset has a SPARQL and an update service. Is it possible to
> >configure a service that can do both ?
> Yes - it's supposed to work.
So if I configure it with one service I should get rid of the error ?
I will try.
> One more question - an update on it's own, without overlapping read,
> works I presume (just in case it's the update conflicting with itself as
> it has a read and write parts).
Yes - updates are working most of the time. I got an error on an update only
once because a select was running.
cu,
brunni
--
++ Michael Brunnbauer
++ netEstate GmbH
++ Geisenhausener Straße 11a
++ 81379 München
++ Tel +49 89 32 19 77 80
++ Fax +49 89 32 19 77 89
++ E-Mail brunni@netestate.de
++ http://www.netestate.de/
++
++ Sitz: München, HRB Nr.142452 (Handelsregister B München)
++ USt-IdNr. DE221033342
++ Geschäftsführer: Michael Brunnbauer, Franz Brunnbauer
++ Prokurist: Dipl. Kfm. (Univ.) Markus Hendel
Re: ANN: Joseki 3.4.4
Posted by Andy Seaborne <an...@epimorphics.com>.
On 11/05/11 18:18, Michael Brunnbauer wrote:
>
> re
>
> On Wed, May 11, 2011 at 05:44:08PM +0100, Andy Seaborne wrote:
>> However, the locking works in other situations - could the same TDB
>> daatbase be shared between services in some way?
>
> Yes. The dataset has a SPARQL and an update service. Is it possible to
> configure a service that can do both ?
Yes - it's supposed to work.
>
>> What's the joseki
>> config file?
Thanks.
One more question - an update on it's own, without overlapping read,
works I presume (just in case it's the update conflicting with itself as
it has a read and write parts).
Andy
Re: ANN: Joseki 3.4.4
Posted by Andy Seaborne <an...@epimorphics.com>.
I can't reproduce the error - I'm running Joseki, breakpointing in a
query, issuing the update (using the SOH sripts s-query and s-update)
and the update is locked out.
Could you give some more details - what's the update, what do the
concurrent queries look like?
Andy
The joseki-config file I'm using has two services on one dataset:
@prefix rdfs: <http://www.w3.org/2000/01/rdf-schema#> .
@prefix rdf: <http://www.w3.org/1999/02/22-rdf-syntax-ns#> .
@prefix xsd: <http://www.w3.org/2001/XMLSchema#> .
@prefix module: <http://joseki.org/2003/06/module#> .
@prefix joseki: <http://joseki.org/2005/06/configuration#> .
@prefix ja: <http://jena.hpl.hp.com/2005/11/Assembler#> .
[] rdf:type joseki:Server .
<#service1>
rdf:type joseki:Service ;
rdfs:label "TDB/Query" ;
joseki:serviceRef "sparql" ;
joseki:dataset <#tdb> ;
joseki:processor joseki:ProcessorSPARQL_FixedDS ;
.
<#service2>
rdf:type joseki:Service ;
rdfs:label "TDB/Update" ;
joseki:serviceRef "update" ;
joseki:dataset <#tdb> ;
joseki:processor joseki:ProcessorSPARQLUpdate ;
.
@prefix tdb: <http://jena.hpl.hp.com/2008/tdb#> .
[] ja:loadClass "com.hp.hpl.jena.tdb.TDB" .
tdb:DatasetTDB rdfs:subClassOf ja:RDFDataset .
tdb:GraphTDB rdfs:subClassOf ja:Model .
<#tdb> rdf:type tdb:DatasetTDB ;
tdb:location "TDB" ;
.
+ Processors
Re: ANN: Joseki 3.4.4
Posted by Michael Brunnbauer <br...@netestate.de>.
re
On Wed, May 11, 2011 at 05:44:08PM +0100, Andy Seaborne wrote:
> However, the locking works in other situations - could the same TDB
> daatbase be shared between services in some way?
Yes. The dataset has a SPARQL and an update service. Is it possible to
configure a service that can do both ?
> What's the joseki
> config file?
# This file is written in N3 / Turtle
@prefix rdfs: <http://www.w3.org/2000/01/rdf-schema#> .
@prefix rdf: <http://www.w3.org/1999/02/22-rdf-syntax-ns#> .
@prefix xsd: <http://www.w3.org/2001/XMLSchema#> .
@prefix module: <http://joseki.org/2003/06/module#> .
@prefix joseki: <http://joseki.org/2005/06/configuration#> .
@prefix ja: <http://jena.hpl.hp.com/2005/11/Assembler#> .
@prefix tdb: <http://jena.hpl.hp.com/2008/tdb#> .
## --------------------------------------------------------------
## This file is written in N3 / Turtle
## It is an RDF graph - order of RDF triples does not matter
## to the machine but it does help people who need to edit this file.
## Note: web.xml must be in-step with this file.
## for each service,
## Note: adding rdfs:label to blank nodes will cause Joseki
## to print that in log messages.
## See also file:joseki-config-example.ttl
## --------------------------------------------------------------
## About this configuration
<> rdfs:label "Joseki Configuration File" .
## --------------------------------------------------------------
## About this server
<#server> rdf:type joseki:Server ;
# Example of some initialization code.
joseki:initialization
[ module:implementation
[ module:className <java:org.joseki.util.ServiceInitSimple> ;
rdfs:label "Example initializer" ; ]
] ;
.
## --------------------------------------------------------------
## Services
## Services are the points that request are sent to.
## serviceRef that will be used to match requests to services,
## not some resource URI for the description.
## Note that the service reference and the routing of incoming
## requests by URI as defined by web.xml have to align.
# Service 1
# General purpose SPARQL processor, no dataset, expects the
# request to specify the dataset (either by parameters in the
# protocol request or in the query itself).
<#service1>
rdf:type joseki:Service ;
rdfs:label "service point" ;
joseki:serviceRef "sparql" ; # web.xml must route this name to Joseki
joseki:processor joseki:ProcessorSPARQL ;
.
<#service2>
rdf:type joseki:Service ;
rdfs:label "Update on the foaf model" ;
joseki:serviceRef "foafupdate" ; # web.xml must route this name to Joseki
# dataset part
joseki:dataset <#foaf> ;
# Service part.
# This processor will not allow either the protocol,
# nor the query, to specify the dataset.
# joseki:processor joseki:ProcessorSPARQL_FixedDS ;
joseki:processor joseki:ProcessorSPARQLUpdate ;
.
<#service3>
rdf:type joseki:Service ;
rdfs:label "SPARQL on the foaf model" ;
joseki:serviceRef "foaf" ; # web.xml must route this name to Joseki
# dataset part
joseki:dataset <#foaf> ;
# Service part.
# This processor will not allow either the protocol,
# nor the query, to specify the dataset.
joseki:processor joseki:ProcessorSPARQL_FixedDS ;
.
<#service4>
rdf:type joseki:Service ;
rdfs:label "Update on the crawl model" ;
joseki:serviceRef "crawlupdate" ; # web.xml must route this name
# dataset part
joseki:dataset <#crawl> ;
# Service part.
# This processor will not allow either the protocol,
# nor the query, to specify the dataset.
# joseki:processor joseki:ProcessorSPARQL_FixedDS ;
joseki:processor joseki:ProcessorSPARQLUpdate ;
.
<#service5>
rdf:type joseki:Service ;
rdfs:label "SPARQL on the crawl model" ;
joseki:serviceRef "crawl"; # web.xml must route this name to Joseki
# dataset part
joseki:dataset <#crawl> ;
# Service part.
# This processor will not allow either the protocol,
# nor the query, to specify the dataset.
joseki:processor joseki:ProcessorSPARQL_FixedDS ;
.
<#service6>
rdf:type joseki:Service ;
rdfs:label "Update on the ontology model" ;
joseki:serviceRef "ontologyupdate" ; # web.xml must route this name
# dataset part
joseki:dataset <#ontology> ;
# Service part.
# This processor will not allow either the protocol,
# nor the query, to specify the dataset.
# joseki:processor joseki:ProcessorSPARQL_FixedDS ;
joseki:processor joseki:ProcessorSPARQLUpdate ;
.
<#service7>
rdf:type joseki:Service ;
rdfs:label "SPARQL on the ontology model" ;
joseki:serviceRef "ontology"; # web.xml must route this name to Joseki
# dataset part
joseki:dataset <#ontology> ;
# Service part.
# This processor will not allow either the protocol,
# nor the query, to specify the dataset.
joseki:processor joseki:ProcessorSPARQL_FixedDS ;
.
<#service8>
rdf:type joseki:Service ;
rdfs:label "SPARQL on the dbpedia model" ;
joseki:serviceRef "dbpedia"; # web.xml must route this name to Joseki
# dataset part
joseki:dataset <#dbpedia> ;
# Service part.
# This processor will not allow either the protocol,
# nor the query, to specify the dataset.
joseki:processor joseki:ProcessorSPARQL_FixedDS ;
.
## ---- SPARQL/Update
## A pair of services - one for SPARQL queries, one for SPARQL/Update
## Previous web.xml must also be updated to include a defintion for the
## servlet "SPARQL/Update service processor" and update requests must
## be routed to this servlet.
## <#serviceUpdate>
## rdf:type joseki:Service ;
## rdfs:label "SPARQL/Update" ;
## joseki:serviceRef "update/service" ;
## # dataset part
## joseki:dataset <#mem>;
## # Service part.
## # This processor will not allow either the protocol,
## # nor the query, to specify the dataset.
## joseki:processor joseki:ProcessorSPARQLUpdate
## .
##
## <#serviceRead>
## rdf:type joseki:Service ;
## rdfs:label "SPARQL" ;
## joseki:serviceRef "sparql/read" ;
## # dataset part
## joseki:dataset <#mem> ; ## Same dataset
## # Service part.
## # This processor will not allow either the protocol,
## # nor the query, to specify the dataset.
## joseki:processor joseki:ProcessorSPARQL_FixedDS ;
## .
## --------------------------------------------------------------
## Datasets
[] ja:loadClass "com.hp.hpl.jena.tdb.TDB" .
tdb:DatasetTDB rdfs:subClassOf ja:RDFDataset .
tdb:GraphTDB rdfs:subClassOf ja:Model .
<#foaf> rdf:type tdb:DatasetTDB ;
rdfs:label "foaf" ;
tdb:location "foaf" ;
.
<#crawl> rdf:type tdb:DatasetTDB ;
rdfs:label "crawl" ;
tdb:location "crawl" ;
.
<#ontology> rdf:type tdb:DatasetTDB ;
rdfs:label "ontology" ;
tdb:location "ontology" ;
.
<#dbpedia> rdf:type tdb:DatasetTDB ;
rdfs:label "dbpedia" ;
tdb:location "dbpedia" ;
.
## --------------------------------------------------------------
## Processors
joseki:ProcessorSPARQL
rdfs:label "General SPARQL processor" ;
rdf:type joseki:Processor ;
module:implementation joseki:ImplSPARQL ;
# Parameters - this processor processes FROM/FROM NAMED
joseki:allowExplicitDataset "true"^^xsd:boolean ;
joseki:allowWebLoading "true"^^xsd:boolean ;
## And has no locking policy (it loads data each time).
## The default is mutex (one request at a time)
joseki:lockingPolicy joseki:lockingPolicyNone ;
.
joseki:ProcessorSPARQL_FixedDS
rdfs:label "SPARQL processor for fixed datasets" ;
rdf:type joseki:Processor ;
module:implementation joseki:ImplSPARQL ;
# This processor does not accept queries with FROM/FROM NAMED
joseki:allowExplicitDataset "false"^^xsd:boolean ;
joseki:allowWebLoading "false"^^xsd:boolean ;
joseki:lockingPolicy joseki:lockingPolicyMRSW ;
.
joseki:ProcessorSPARQLUpdate
rdfs:label "SPARQL Update processor" ;
rdf:type joseki:Processor ;
module:implementation joseki:ImplSPARQLUpdate ;
joseki:lockingPolicy joseki:lockingPolicyMRSW ;
.
joseki:ImplSPARQL
rdf:type joseki:ServiceImpl ;
module:className
<java:org.joseki.processors.SPARQL> .
joseki:ImplSPARQLUpdate
rdf:type joseki:ServiceImpl ;
module:className
<java:org.joseki.processors.SPARQLUpdate> .
# Local Variables:
# tab-width: 4
# indent-tabs-mode: nil
# End:
cu,
brunni
--
++ Michael Brunnbauer
++ netEstate GmbH
++ Geisenhausener Straße 11a
++ 81379 München
++ Tel +49 89 32 19 77 80
++ Fax +49 89 32 19 77 89
++ E-Mail brunni@netestate.de
++ http://www.netestate.de/
++
++ Sitz: München, HRB Nr.142452 (Handelsregister B München)
++ USt-IdNr. DE221033342
++ Geschäftsführer: Michael Brunnbauer, Franz Brunnbauer
++ Prokurist: Dipl. Kfm. (Univ.) Markus Hendel
Re: ANN: Joseki 3.4.4
Posted by Andy Seaborne <an...@epimorphics.com>.
On 11/05/11 15:59, Michael Brunnbauer wrote:
>
> re
>
> This seems to be new with 3.4.4:
>
> 16:52:43 INFO SPARQL :: Throwable: Reader = 1, Writer = 1
> java.util.ConcurrentModificationException: Reader = 1, Writer = 1
> at com.hp.hpl.jena.tdb.sys.ConcurrencyPolicyMRSW.policyError(ConcurrencyPolicyMRSW.java:132)
>
> Got it from a SELECT submitted while an UPDATE was running.
>
> I think earlier versions would delay the SELECT until the UPDATE was finished.
> Is there a way to restore this behavior ?
This is not good. (tm)
It is likely the chnage is merely that the system notices the problem,
rather than was doing anything different. TDB has had some trackign
added to help warn of potential problems.
However, the locking works in other situations - could the same TDB
daatbase be shared between services in some way? What's the joseki
config file?
Andy
>
> Regards,
>
> Michael Brunnbauer
>
> On Fri, May 06, 2011 at 10:24:28AM +0100, Andy Seaborne wrote:
>> This is release of Joseki to bring it into line with the current
>> versions of ARQ and of TDB and SDB.
>>
>> Andy
>>
>> Downloads:
>> http://sourceforge.net/projects/joseki/files/Joseki-SPARQL/Joseki-3.4.4/joseki-3.4.4.zip/download
>>
>> and in the maven repository:
>>
>> Maven details:
>> http://www.openjena.org/repo/org/joseki/joseki/3.4.4/
>>
>> <dependency>
>> <groupId>org.joseki</groupId>
>> <artifactId>joseki</artifactId>
>> <version>3.4.4</version>
>> </dependency>
>>
>> <repository>
>> <id>repo-jena</id>
>> <name>Jena Maven - Repository</name>
>> <layout>default</layout>
>> <url>http://openjena.org/repo</url>
>> <snapshots>
>> <enabled>false</enabled>
>> </snapshots>
>> </repository>
>
Re: ANN: Joseki 3.4.4
Posted by Michael Brunnbauer <br...@netestate.de>.
re
This seems to be new with 3.4.4:
16:52:43 INFO SPARQL :: Throwable: Reader = 1, Writer = 1
java.util.ConcurrentModificationException: Reader = 1, Writer = 1
at com.hp.hpl.jena.tdb.sys.ConcurrencyPolicyMRSW.policyError(ConcurrencyPolicyMRSW.java:132)
Got it from a SELECT submitted while an UPDATE was running.
I think earlier versions would delay the SELECT until the UPDATE was finished.
Is there a way to restore this behavior ?
Regards,
Michael Brunnbauer
On Fri, May 06, 2011 at 10:24:28AM +0100, Andy Seaborne wrote:
> This is release of Joseki to bring it into line with the current
> versions of ARQ and of TDB and SDB.
>
> Andy
>
> Downloads:
> http://sourceforge.net/projects/joseki/files/Joseki-SPARQL/Joseki-3.4.4/joseki-3.4.4.zip/download
>
> and in the maven repository:
>
> Maven details:
> http://www.openjena.org/repo/org/joseki/joseki/3.4.4/
>
> <dependency>
> <groupId>org.joseki</groupId>
> <artifactId>joseki</artifactId>
> <version>3.4.4</version>
> </dependency>
>
> <repository>
> <id>repo-jena</id>
> <name>Jena Maven - Repository</name>
> <layout>default</layout>
> <url>http://openjena.org/repo</url>
> <snapshots>
> <enabled>false</enabled>
> </snapshots>
> </repository>
--
++ Michael Brunnbauer
++ netEstate GmbH
++ Geisenhausener Straße 11a
++ 81379 München
++ Tel +49 89 32 19 77 80
++ Fax +49 89 32 19 77 89
++ E-Mail brunni@netestate.de
++ http://www.netestate.de/
++
++ Sitz: München, HRB Nr.142452 (Handelsregister B München)
++ USt-IdNr. DE221033342
++ Geschäftsführer: Michael Brunnbauer, Franz Brunnbauer
++ Prokurist: Dipl. Kfm. (Univ.) Markus Hendel