You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@jena.apache.org by Andy Seaborne <an...@epimorphics.com> on 2011/05/06 11:24:28 UTC

ANN: Joseki 3.4.4

This is release of Joseki to bring it into line with the current 
versions of ARQ and of TDB and SDB.

	Andy

Downloads:
http://sourceforge.net/projects/joseki/files/Joseki-SPARQL/Joseki-3.4.4/joseki-3.4.4.zip/download

and in the maven repository:

Maven details:
http://www.openjena.org/repo/org/joseki/joseki/3.4.4/

      <dependency>
        <groupId>org.joseki</groupId>
        <artifactId>joseki</artifactId>
        <version>3.4.4</version>
      </dependency>

      <repository>
        <id>repo-jena</id>
        <name>Jena Maven - Repository</name>
        <layout>default</layout>
        <url>http://openjena.org/repo</url>
        <snapshots>
          <enabled>false</enabled>
        </snapshots>
      </repository>

Re: ANN: Joseki 3.4.4

Posted by Andy Seaborne <an...@epimorphics.com>.

On 25/05/11 11:38, Michael Brunnbauer wrote:
> re
>
> The problem was caused by an error in my servlet mapping. I used
>
>   <servlet-name>SPARQL service processor</servlet-name>
>
> for my SPARQL update serviceRef instead of
>
>   <servlet-name>SPARQL/Update service processor</servlet-name>
 >
> The SPARQL update service was working anyway but throwed the
> ConcurrentModificationException instead of waiting for a lock.
>
> Is there any chance this broken setup has caused TDB corruption with
> Joseki-3.4.3 ?

Going by some of the stacktraces you've shown, then yes.  They are 
caused by not locking correctly.

Thanks for letting everyone know the root cause.

	Andy

>
> cu,
> brunni

Re: ANN: Joseki 3.4.4

Posted by Michael Brunnbauer <br...@netestate.de>.
re

The problem was caused by an error in my servlet mapping. I used

 <servlet-name>SPARQL service processor</servlet-name> 

for my SPARQL update serviceRef instead of

 <servlet-name>SPARQL/Update service processor</servlet-name>

The SPARQL update service was working anyway but throwed the 
ConcurrentModificationException instead of waiting for a lock.

Is there any chance this broken setup has caused TDB corruption with
Joseki-3.4.3 ?

cu,
brunni

On Fri, May 20, 2011 at 09:42:04AM +0100, Andy Seaborne wrote:
> 
> 
> On 18/05/11 12:48, Michael Brunnbauer wrote:
> >
> >re
> >
> >On Wed, May 18, 2011 at 12:33:34PM +0100, Andy Seaborne wrote:
> >>That was the reason in the msg I pointed to - charset on the
> >>application/x-www-form-urlencoded.  Could you try the form version
> >>s-update-form.
> >
> >Now I get "400 Can't find request from 'request' parameter or POST body".
> 
> This should include the URL
> 
> >s-update-form is using the parameter update but Joseki is expecting 
> >request.
> >If i change update= to request= in the script it works and I can still
> >reproduce the error.
> >
> >Is it possible that you tried to reproduce my error with Fuseki instead of
> >Joseki-3.4.4 ? I have no other explanation that s-update worked for you.
> >
> >cu,
> >brunni
> >
> 
> I'm using the Joseki 3.4.4 distribution (bin/rdfserver), the test 
> database you sent me and
> 
> java version "1.6.0_22"
> OpenJDK Runtime Environment (IcedTea6 1.10.1) (6b22-1.10.1-0ubuntu1)
> OpenJDK 64-Bit Server VM (build 20.0-b11, mixed mode)
> 
> I've tried two different machines, using the scripts I posted.  I did 
> have problems with the s-update-form script but s-update and s-query 
> worked fine.
> 
> Could you start from a clean download, the config and scripts I used? 
> There may be some difference in environments - what's your setup?
> 
> 	Andy

-- 
++  Michael Brunnbauer
++  netEstate GmbH
++  Geisenhausener Straße 11a
++  81379 München
++  Tel +49 89 32 19 77 80
++  Fax +49 89 32 19 77 89 
++  E-Mail brunni@netestate.de
++  http://www.netestate.de/
++
++  Sitz: München, HRB Nr.142452 (Handelsregister B München)
++  USt-IdNr. DE221033342
++  Geschäftsführer: Michael Brunnbauer, Franz Brunnbauer
++  Prokurist: Dipl. Kfm. (Univ.) Markus Hendel

Re: ANN: Joseki 3.4.4

Posted by Andy Seaborne <an...@epimorphics.com>.

On 18/05/11 12:48, Michael Brunnbauer wrote:
>
> re
>
> On Wed, May 18, 2011 at 12:33:34PM +0100, Andy Seaborne wrote:
>> That was the reason in the msg I pointed to - charset on the
>> application/x-www-form-urlencoded.  Could you try the form version
>> s-update-form.
>
> Now I get "400 Can't find request from 'request' parameter or POST body".

This should include the URL

> s-update-form is using the parameter update but Joseki is expecting request.
> If i change update= to request= in the script it works and I can still
> reproduce the error.
>
> Is it possible that you tried to reproduce my error with Fuseki instead of
> Joseki-3.4.4 ? I have no other explanation that s-update worked for you.
>
> cu,
> brunni
>

I'm using the Joseki 3.4.4 distribution (bin/rdfserver), the test 
database you sent me and

java version "1.6.0_22"
OpenJDK Runtime Environment (IcedTea6 1.10.1) (6b22-1.10.1-0ubuntu1)
OpenJDK 64-Bit Server VM (build 20.0-b11, mixed mode)

I've tried two different machines, using the scripts I posted.  I did 
have problems with the s-update-form script but s-update and s-query 
worked fine.

Could you start from a clean download, the config and scripts I used? 
There may be some difference in environments - what's your setup?

	Andy

Re: ANN: Joseki 3.4.4

Posted by Michael Brunnbauer <br...@netestate.de>.
re

On Wed, May 18, 2011 at 12:33:34PM +0100, Andy Seaborne wrote:
> That was the reason in the msg I pointed to - charset on the 
> application/x-www-form-urlencoded.  Could you try the form version 
> s-update-form.

Now I get "400 Can't find request from 'request' parameter or POST body".

s-update-form is using the parameter update but Joseki is expecting request.
If i change update= to request= in the script it works and I can still
reproduce the error.

Is it possible that you tried to reproduce my error with Fuseki instead of
Joseki-3.4.4 ? I have no other explanation that s-update worked for you.

cu,
brunni

-- 
++  Michael Brunnbauer
++  netEstate GmbH
++  Geisenhausener Straße 11a
++  81379 München
++  Tel +49 89 32 19 77 80
++  Fax +49 89 32 19 77 89 
++  E-Mail brunni@netestate.de
++  http://www.netestate.de/
++
++  Sitz: München, HRB Nr.142452 (Handelsregister B München)
++  USt-IdNr. DE221033342
++  Geschäftsführer: Michael Brunnbauer, Franz Brunnbauer
++  Prokurist: Dipl. Kfm. (Univ.) Markus Hendel

Re: ANN: Joseki 3.4.4

Posted by Andy Seaborne <an...@epimorphics.com>.
That was the reason in the msg I pointed to - charset on the 
application/x-www-form-urlencoded.  Could you try the form version 
s-update-form.

I didn't think this area had changed but may a bug has been fixed since 
0.2.0.

	Andy

On 18/05/11 12:29, Michael Brunnbauer wrote:
>
> re
>
> On Wed, May 18, 2011 at 12:01:14PM +0100, Andy Seaborne wrote:
>> http://mail-archives.apache.org/mod_mbox/incubator-jena-users/201105.mbox/%3C69935.16679.qm@web161617.mail.bf1.yahoo.com%3E
>> which is fixed in SVN (caveat the wrong SVN - see email about code move)
>> As to why your ruby setup is setting charset and mine does not, I don't
>> know.
>
> Are you talking about the charset in the HTTP request ? There is none.
> This was sniffed from the lo network interface:
>
> POST /testupdate HTTP/1.1
> User-Agent: SOH/Fuseki 0.0.0
> Content-Type: application/sparql-update
> Host: localhost:2021
> Content-Length: 133

That isn't a application/x-www-form-urlencoded

>
> load<http://blogspace.com/swhack/chatlogs/rdflogs/2002-06-24.rdf>  into<http://blogspace.com/swhack/chatlogs/rdflogs/2002-06-24.rdf>
>
> There is a charset in the HTTP response:
>
> HTTP/1.1 415 Must be application/x-www-form-urlencoded
> Content-Type: text/html; charset=iso-8859-1
> Cache-Control: must-revalidate,no-cache,no-store
> Content-Length: 1439
> Server: Jetty(6.1.25)
>
> <html>
> <head>
> <meta http-equiv="Content-Type" content="text/html; charset=ISO-8859-1"/>
> <title>Error 415 Must be application/x-www-form-urlencoded</title>
> </head>
> <body><h2>HTTP ERROR 415</h2>
> <p>Problem accessing /testupdate. Reason:
> <pre>     Must be application/x-www-form-urlencoded</pre></p><hr /><i><small>Powered by Jetty://</small></i><br/>
> <br/>
> <br/>
> <br/>
> <br/>
> <br/>
> <br/>
> <br/>
> <br/>
> <br/>
> <br/>
> <br/>
> <br/>
> <br/>
> <br/>
> <br/>
> <br/>
> <br/>
> <br/>
> <br/>
>
> </body>
> </html>
>
>> I have:
>> LANG=C
>> GDM_LANG=en_GB.utf8
>
> I do not set any variables on this system which should be equivalent to LANG=C
>
> cu,
> brunni
>

Re: ANN: Joseki 3.4.4

Posted by Michael Brunnbauer <br...@netestate.de>.
re

On Wed, May 18, 2011 at 12:01:14PM +0100, Andy Seaborne wrote:
> http://mail-archives.apache.org/mod_mbox/incubator-jena-users/201105.mbox/%3C69935.16679.qm@web161617.mail.bf1.yahoo.com%3E
> which is fixed in SVN (caveat the wrong SVN - see email about code move)
> As to why your ruby setup is setting charset and mine does not, I don't 
> know.

Are you talking about the charset in the HTTP request ? There is none.
This was sniffed from the lo network interface:

POST /testupdate HTTP/1.1
User-Agent: SOH/Fuseki 0.0.0
Content-Type: application/sparql-update
Host: localhost:2021
Content-Length: 133

load <http://blogspace.com/swhack/chatlogs/rdflogs/2002-06-24.rdf> into <http://blogspace.com/swhack/chatlogs/rdflogs/2002-06-24.rdf>

There is a charset in the HTTP response:

HTTP/1.1 415 Must be application/x-www-form-urlencoded
Content-Type: text/html; charset=iso-8859-1
Cache-Control: must-revalidate,no-cache,no-store
Content-Length: 1439
Server: Jetty(6.1.25)

<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=ISO-8859-1"/>
<title>Error 415 Must be application/x-www-form-urlencoded</title>
</head>
<body><h2>HTTP ERROR 415</h2>
<p>Problem accessing /testupdate. Reason:
<pre>    Must be application/x-www-form-urlencoded</pre></p><hr /><i><small>Powered by Jetty://</small></i><br/>                                                
<br/>                                                
<br/>                                                
<br/>                                                
<br/>                                                
<br/>                                                
<br/>                                                
<br/>                                                
<br/>                                                
<br/>                                                
<br/>                                                
<br/>                                                
<br/>                                                
<br/>                                                
<br/>                                                
<br/>                                                
<br/>                                                
<br/>                                                
<br/>                                                
<br/>                                                

</body>
</html>

> I have:
> LANG=C
> GDM_LANG=en_GB.utf8

I do not set any variables on this system which should be equivalent to LANG=C

cu,
brunni

-- 
++  Michael Brunnbauer
++  netEstate GmbH
++  Geisenhausener Straße 11a
++  81379 München
++  Tel +49 89 32 19 77 80
++  Fax +49 89 32 19 77 89 
++  E-Mail brunni@netestate.de
++  http://www.netestate.de/
++
++  Sitz: München, HRB Nr.142452 (Handelsregister B München)
++  USt-IdNr. DE221033342
++  Geschäftsführer: Michael Brunnbauer, Franz Brunnbauer
++  Prokurist: Dipl. Kfm. (Univ.) Markus Hendel

Re: ANN: Joseki 3.4.4

Posted by Andy Seaborne <an...@epimorphics.com>.
See

http://mail-archives.apache.org/mod_mbox/incubator-jena-users/201105.mbox/%3C69935.16679.qm@web161617.mail.bf1.yahoo.com%3E

which is fixed in SVN (caveat the wrong SVN - see email about code move)

As to why your ruby setup is setting charset and mine does not, I don't 
know.

I have:

LANG=C
GDM_LANG=en_GB.utf8

	Andy


On 18/05/11 09:16, Michael Brunnbauer wrote:
>
> re
>
> I have installed ruby + fuseki-0.2.0-SOH.zip and can get the "query" shell
> script working but not the "load" shell script:
>
> chianti:~/Fuseki-0.2.0$ ./load
> 415 Must be application/x-www-form-urlencoded http://localhost:2021/testupdate
> chianti:~/Fuseki-0.2.0$ cat load
> #!/bin/sh
> X='load<http://blogspace.com/swhack/chatlogs/rdflogs/2002-06-24.rdf>  into<http://blogspace.com/swhack/chatlogs/rdflogs/2002-06-24.rdf>'
> ./s-update --service http://localhost:2021/testupdate "$X"
>
> My ruby installation lives in /home/test/ruby so I had to change the first
> line of all s-* scripts from
>
>   #!/usr/bin/env ruby
>
> to
>
>   #!/usr/bin/env /home/test/ruby/bin/ruby
>
> Any idea what is going wrong ?
>
> cu,
> brunni
>
> On Tue, May 17, 2011 at 08:48:42PM +0100, Andy Seaborne wrote:
>> load:
>> -------------------------------------
>> #!/bin/bash
>>
>> X='load<http://blogspace.com/swhack/chatlogs/rdflogs/2002-06-24.rdf>
>> into<http://blogspace.com/swhack/chatlogs/rdflogs/2002-06-24.rdf>'
>>
>> ../s-update --service http://localhost:2020/update "$X"
>> -------------------------------------
>> query:
>> -------------------------------------
>> #!/bin/bash
>>
>> Q='select count(*) where { graph ?g { ?s ?p ?o }}'
>>
>> ../s-query --service http://localhost:2020/sparql "$Q"
>>
>> -------------------------------------
>>
>> s-* are the scripts from Fuseki.
>> http://openjena.org/repo/org/openjena/fuseki/0.2.0/fuseki-0.2.0-SOH.zip
>

Re: ANN: Joseki 3.4.4

Posted by Michael Brunnbauer <br...@netestate.de>.
re

I have installed ruby + fuseki-0.2.0-SOH.zip and can get the "query" shell
script working but not the "load" shell script:

chianti:~/Fuseki-0.2.0$ ./load
415 Must be application/x-www-form-urlencoded http://localhost:2021/testupdate
chianti:~/Fuseki-0.2.0$ cat load
#!/bin/sh
X='load <http://blogspace.com/swhack/chatlogs/rdflogs/2002-06-24.rdf> into <http://blogspace.com/swhack/chatlogs/rdflogs/2002-06-24.rdf>'
./s-update --service http://localhost:2021/testupdate "$X"

My ruby installation lives in /home/test/ruby so I had to change the first
line of all s-* scripts from

 #!/usr/bin/env ruby

to

 #!/usr/bin/env /home/test/ruby/bin/ruby

Any idea what is going wrong ?

cu,
brunni

On Tue, May 17, 2011 at 08:48:42PM +0100, Andy Seaborne wrote:
> load:
> -------------------------------------
> #!/bin/bash
> 
> X='load <http://blogspace.com/swhack/chatlogs/rdflogs/2002-06-24.rdf> 
> into <http://blogspace.com/swhack/chatlogs/rdflogs/2002-06-24.rdf>'
> 
> ../s-update --service http://localhost:2020/update "$X"
> -------------------------------------
> query:
> -------------------------------------
> #!/bin/bash
> 
> Q='select count(*) where { graph ?g { ?s ?p ?o }}'
> 
> ../s-query --service http://localhost:2020/sparql "$Q"
> 
> -------------------------------------
> 
> s-* are the scripts from Fuseki.
> http://openjena.org/repo/org/openjena/fuseki/0.2.0/fuseki-0.2.0-SOH.zip

-- 
++  Michael Brunnbauer
++  netEstate GmbH
++  Geisenhausener Straße 11a
++  81379 München
++  Tel +49 89 32 19 77 80
++  Fax +49 89 32 19 77 89 
++  E-Mail brunni@netestate.de
++  http://www.netestate.de/
++
++  Sitz: München, HRB Nr.142452 (Handelsregister B München)
++  USt-IdNr. DE221033342
++  Geschäftsführer: Michael Brunnbauer, Franz Brunnbauer
++  Prokurist: Dipl. Kfm. (Univ.) Markus Hendel

Re: ANN: Joseki 3.4.4

Posted by Andy Seaborne <an...@epimorphics.com>.
Michael sent me a copy of his database.

cc'ed jena-users@incubator.apache.org
On 16/05/11 14:43, Michael Brunnbauer wrote:
 >
 > re
 >
 > On Thu, May 12, 2011 at 09:57:36PM +0100, Andy Seaborne wrote:
 >> I can't reproduce the error - I'm running Joseki, breakpointing in a
 >> query, issuing the update (using the SOH sripts s-query and s-update)
 >> and the update is locked out.
 >>
 >> Could you give some more details - what's the update, what do the
 >> concurrent queries look like?
 >
 > I can reproduce the ConcurrentModificationException with the attached TDB
 > containing 100000 Quads and the attached config file. If I do
 >
 >   load<http://blogspace.com/swhack/chatlogs/rdflogs/2002-06-24.rdf>
 >   into<http://blogspace.com/swhack/chatlogs/rdflogs/2002-06-24.rdf>
 >
 > on the testupdate service from a HTML form and then (quick)
 >
 >   select count(*) where { graph ?g { ?s ?p ?o }}
 >
 > on the test service from another HTML form, I get the error for the 
select.
 >
 > Does this help you ?
 >
 > Can you confirm that TDB 0.8.8 will have problems with TDBs modified 
by TDB
 > 0.8.10 ?
 >
 > cu,
 > brunni
 >

No luck I'm afraid.  Works for me.

joseki-config attached.  This is Joseki in CVS at the moment.


load:
-------------------------------------
#!/bin/bash

X='load <http://blogspace.com/swhack/chatlogs/rdflogs/2002-06-24.rdf> 
into <http://blogspace.com/swhack/chatlogs/rdflogs/2002-06-24.rdf>'

../s-update --service http://localhost:2020/update "$X"
-------------------------------------
query:
-------------------------------------
#!/bin/bash

Q='select count(*) where { graph ?g { ?s ?p ?o }}'

../s-query --service http://localhost:2020/sparql "$Q"

-------------------------------------

s-* are the scripts from Fuseki.
http://openjena.org/repo/org/openjena/fuseki/0.2.0/fuseki-0.2.0-SOH.zip


using your database, I put 'query' in a loop to hammer the server, then 
issued the 'load' multiple times.  It worked - and when a load hit the 
server I saw the query rate stutter as the load took a lock.

	Andy


Re: ANN: Joseki 3.4.4

Posted by Michael Brunnbauer <br...@netestate.de>.
re

BTW: The graph http://blogspace.com/swhack/chatlogs/rdflogs/2002-06-24.rdf
was added to the TDB with Joseki-3.4.4. Perhaps datasets modified with
tdb-0.8.10 as in Joseki-3.4.4 are incompatible to tdb-0.8.8 as in Joseki-3.4.3?

cu,
brunni

On Thu, May 12, 2011 at 11:35:01AM +0200, Michael Brunnbauer wrote:
> 
> re
> 
> I think my TDB is broken now. I got a memory error on
> 
>  SELECT DISTINCT ?subj ?prop ?obj WHERE { GRAPH <http://blogspace.com/swhack/chatlogs/rdflogs/2002-06-24.rdf> { ?subj ?prop ?obj } }
> 
> If I change -Xmx1G to -Xmx4G in bin/rdfserver, I do not get the memory error
> but lots of errors of this kind:
> 
> 11:18:04 INFO  SPARQL               :: Query: SELECT DISTINCT ?subj ?prop ?obj W
> HERE { GRAPH <http://blogspace.com/swhack/chatlogs/rdflogs/2002-06-24.rdf> { ?subj ?prop ?obj } }  
> 11:18:04 INFO  SPARQL               :: OK/select: SELECT DISTINCT ?subj ?prop ?obj WHERE { GRAPH <http://blogspace.com/swhack/chatlogs/rdfl
> ogs/2002-06-24.rdf> { ?subj ?prop ?obj } }  
> 11:18:05 ERROR BindingTDB           :: get1(?subj)
> com.hp.hpl.jena.tdb.base.file.FileException: ObjectFile.read: Failed to read the object (795439970 bytes) : got 149584 bytes
>         at com.hp.hpl.jena.tdb.base.objectfile.ObjectFileDiskDirect.read(ObjectFileDiskDirect.java:182)
>         at com.hp.hpl.jena.tdb.lib.NodeLib.fetchDecode(NodeLib.java:66)
>         at com.hp.hpl.jena.tdb.nodetable.NodeTableNative.readNodeByNodeId(NodeTableNative.java:158)
>         at com.hp.hpl.jena.tdb.nodetable.NodeTableNative._retrieveNodeByNodeId(NodeTableNative.java:85)
>         at com.hp.hpl.jena.tdb.nodetable.NodeTableNative.getNodeForNodeId(NodeTableNative.java:58)
>         at com.hp.hpl.jena.tdb.nodetable.NodeTableCache._retrieveNodeByNodeId(NodeTableCache.java:86)
>         at com.hp.hpl.jena.tdb.nodetable.NodeTableCache.getNodeForNodeId(NodeTableCache.java:57)
>         at com.hp.hpl.jena.tdb.nodetable.NodeTableWrapper.getNodeForNodeId(NodeTableWrapper.java:43)
>         at com.hp.hpl.jena.tdb.nodetable.NodeTableInline.getNodeForNodeId(NodeTableInline.java:55)
>         at com.hp.hpl.jena.tdb.solver.BindingTDB.get1(BindingTDB.java:96)
>         at com.hp.hpl.jena.sparql.engine.binding.BindingBase.get(BindingBase.java:126)
>         at com.hp.hpl.jena.sparql.engine.binding.BindingProject.get1(BindingProject.java:57)
>         at com.hp.hpl.jena.sparql.engine.binding.BindingBase.get(BindingBase.java:126)
>         at com.hp.hpl.jena.sparql.engine.binding.BindingWrapped.get(BindingWrapped.java:39)
>         at com.hp.hpl.jena.sparql.engine.binding.BindingFixed.calcHashCode(BindingFixed.java:33)
>         at com.hp.hpl.jena.sparql.engine.binding.BindingFixed.hashCode(BindingFixed.java:64)
>         at java.util.HashMap.getEntry(HashMap.java:344)
>         at java.util.HashMap.containsKey(HashMap.java:335)
>         at java.util.HashSet.contains(HashSet.java:184)
>         at com.hp.hpl.jena.sparql.engine.iterator.QueryIterDistinct.isDuplicate(QueryIterDistinct.java:39)
>         at com.hp.hpl.jena.sparql.engine.iterator.QueryIterDistinctReduced.hasNextBinding(QueryIterDistinctReduced.java:39)
>         at com.hp.hpl.jena.sparql.engine.iterator.QueryIteratorBase.hasNext(QueryIteratorBase.java:66)
>         at com.hp.hpl.jena.sparql.engine.iterator.QueryIteratorWrapper.hasNextBinding(QueryIteratorWrapper.java:28)
>         at com.hp.hpl.jena.sparql.engine.iterator.QueryIteratorBase.hasNext(QueryIteratorBase.java:66)
>         at com.hp.hpl.jena.sparql.engine.iterator.QueryIteratorWrapper.hasNextBinding(QueryIteratorWrapper.java:28)
>         at com.hp.hpl.jena.sparql.engine.iterator.QueryIteratorBase.hasNext(QueryIteratorBase.java:66)
>         at com.hp.hpl.jena.sparql.engine.ResultSetStream.hasNext(ResultSetStream.java:57)
>         at com.hp.hpl.jena.sparql.resultset.ResultSetMem.<init>(ResultSetMem.java:82)
>         at com.hp.hpl.jena.sparql.resultset.TextOutput.write(TextOutput.java:133)
>         at com.hp.hpl.jena.sparql.resultset.TextOutput.write(TextOutput.java:116)
>         at com.hp.hpl.jena.sparql.resultset.TextOutput.write(TextOutput.java:104)
>         at com.hp.hpl.jena.sparql.resultset.TextOutput.format(TextOutput.java:51)
>         at com.hp.hpl.jena.query.ResultSetFormatter.out(ResultSetFormatter.java:96)
>         at com.hp.hpl.jena.query.ResultSetFormatter.out(ResultSetFormatter.java:48)
>         at org.joseki.http.ResponseHttp$3.output(ResponseHttp.java:349)
>         at org.joseki.http.ResponseHttp.output(ResponseHttp.java:471)
>         at org.joseki.http.ResponseHttp.textOutput(ResponseHttp.java:502)
>         at org.joseki.http.ResponseHttp.doResponseResult(ResponseHttp.java:345)
>         at org.joseki.http.ResponseHttp.doResponseResultSet(ResponseHttp.java:169)
>         at org.joseki.Response.sendResponse(Response.java:87)
>         at org.joseki.Dispatcher.dispatch(Dispatcher.java:60)
>         at org.joseki.http.Servlet.doCommon(Servlet.java:178)
>         at org.joseki.http.Servlet.doPost(Servlet.java:247)
>         at javax.servlet.http.HttpServlet.service(HttpServlet.java:727)
>         at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
>         at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511)
>         at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:390)
>         at org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
>         at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
>         at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:765)
>         at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:440)
>         at org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114)
>         at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
>         at org.mortbay.jetty.Server.handle(Server.java:326)
>         at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
>         at org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:943)
>         at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:756)
>         at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:218)
>         at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
>         at org.mortbay.jetty.nio.BlockingChannelConnector$Connection.run(BlockingChannelConnector.java:164)
>         at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
> 11:18:06 ERROR BindingTDB           :: get1(?subj)
> com.hp.hpl.jena.tdb.base.file.FileException: ObjectFile.read: Failed to read the object (795439970 bytes) : got 149584 bytes
>         at com.hp.hpl.jena.tdb.base.objectfile.ObjectFileDiskDirect.read(ObjectFileDiskDirect.java:182)
>         at com.hp.hpl.jena.tdb.lib.NodeLib.fetchDecode(NodeLib.java:66)
>         at com.hp.hpl.jena.tdb.nodetable.NodeTableNative.readNodeByNodeId(NodeTableNative.java:158)
>         at com.hp.hpl.jena.tdb.nodetable.NodeTableNative._retrieveNodeByNodeId(NodeTableNative.java:85)
>         at com.hp.hpl.jena.tdb.nodetable.NodeTableNative.getNodeForNodeId(NodeTableNative.java:58)
>         at com.hp.hpl.jena.tdb.nodetable.NodeTableCache._retrieveNodeByNodeId(NodeTableCache.java:86)
>         at com.hp.hpl.jena.tdb.nodetable.NodeTableCache.getNodeForNodeId(NodeTableCache.java:57)
>         at com.hp.hpl.jena.tdb.nodetable.NodeTableWrapper.getNodeForNodeId(NodeTableWrapper.java:43)
>         at com.hp.hpl.jena.tdb.nodetable.NodeTableInline.getNodeForNodeId(NodeTableInline.java:55)
>         at com.hp.hpl.jena.tdb.solver.BindingTDB.get1(BindingTDB.java:96)
>         at com.hp.hpl.jena.sparql.engine.binding.BindingBase.get(BindingBase.java:126)
>         at com.hp.hpl.jena.sparql.engine.binding.BindingProject.get1(BindingProject.java:57)
>         at com.hp.hpl.jena.sparql.engine.binding.BindingBase.get(BindingBase.java:126)
>         at com.hp.hpl.jena.sparql.engine.binding.BindingWrapped.get(BindingWrapped.java:39)
>         at com.hp.hpl.jena.sparql.engine.binding.BindingFixed.calcHashCode(BindingFixed.java:33)
>         at com.hp.hpl.jena.sparql.engine.binding.BindingFixed.hashCode(BindingFixed.java:64)
>         at java.util.HashMap.getEntry(HashMap.java:344)
>         at java.util.HashMap.containsKey(HashMap.java:335)
>         at java.util.HashSet.contains(HashSet.java:184)
>         at com.hp.hpl.jena.sparql.engine.iterator.QueryIterDistinct.isDuplicate(QueryIterDistinct.java:39)
>         at com.hp.hpl.jena.sparql.engine.iterator.QueryIterDistinctReduced.hasNextBinding(QueryIterDistinctReduced.java:39)
>         at com.hp.hpl.jena.sparql.engine.iterator.QueryIteratorBase.hasNext(QueryIteratorBase.java:66)
>         at com.hp.hpl.jena.sparql.engine.iterator.QueryIteratorWrapper.hasNextBinding(QueryIteratorWrapper.java:28)
>         at com.hp.hpl.jena.sparql.engine.iterator.QueryIteratorBase.hasNext(QueryIteratorBase.java:66)
>         at com.hp.hpl.jena.sparql.engine.iterator.QueryIteratorWrapper.hasNextBinding(QueryIteratorWrapper.java:28)
>         at com.hp.hpl.jena.sparql.engine.iterator.QueryIteratorBase.hasNext(QueryIteratorBase.java:66)
>         at com.hp.hpl.jena.sparql.engine.ResultSetStream.hasNext(ResultSetStream.java:57)
> [...]
> 
> I have a recent backup of that TDB that has not been introduced to
> Joseki-3.4.4.
> 
> cu,
> brunni
> 
> On Thu, May 12, 2011 at 11:00:28AM +0200, Michael Brunnbauer wrote:
> > 
> > re
> > 
> > On Thu, May 12, 2011 at 09:46:13AM +0100, Andy Seaborne wrote:
> > > Your config file looks fine to me - two services over the same dataset. 
> > >  It's two services because SPARQL update and SPARQL query are different 
> > > languages (and you can protect the update endpoint separately from the 
> > > query endpoint - no injection attacks on the query service). It looks to 
> > > me like a Joseki bug in the internal locking.
> > 
> > I have downgraded to Joseki-3.4.3 and the problem is gone. Please contact me
> > if you need any cooperation to find the bug.
> > 
> > cu,
> > brunni
> > 
> > -- 
> > ++  Michael Brunnbauer
> > ++  netEstate GmbH
> > ++  Geisenhausener Straße 11a
> > ++  81379 München
> > ++  Tel +49 89 32 19 77 80
> > ++  Fax +49 89 32 19 77 89 
> > ++  E-Mail brunni@netestate.de
> > ++  http://www.netestate.de/
> > ++
> > ++  Sitz: München, HRB Nr.142452 (Handelsregister B München)
> > ++  USt-IdNr. DE221033342
> > ++  Geschäftsführer: Michael Brunnbauer, Franz Brunnbauer
> > ++  Prokurist: Dipl. Kfm. (Univ.) Markus Hendel
> 
> -- 
> ++  Michael Brunnbauer
> ++  netEstate GmbH
> ++  Geisenhausener Straße 11a
> ++  81379 München
> ++  Tel +49 89 32 19 77 80
> ++  Fax +49 89 32 19 77 89 
> ++  E-Mail brunni@netestate.de
> ++  http://www.netestate.de/
> ++
> ++  Sitz: München, HRB Nr.142452 (Handelsregister B München)
> ++  USt-IdNr. DE221033342
> ++  Geschäftsführer: Michael Brunnbauer, Franz Brunnbauer
> ++  Prokurist: Dipl. Kfm. (Univ.) Markus Hendel

-- 
++  Michael Brunnbauer
++  netEstate GmbH
++  Geisenhausener Straße 11a
++  81379 München
++  Tel +49 89 32 19 77 80
++  Fax +49 89 32 19 77 89 
++  E-Mail brunni@netestate.de
++  http://www.netestate.de/
++
++  Sitz: München, HRB Nr.142452 (Handelsregister B München)
++  USt-IdNr. DE221033342
++  Geschäftsführer: Michael Brunnbauer, Franz Brunnbauer
++  Prokurist: Dipl. Kfm. (Univ.) Markus Hendel

Re: ANN: Joseki 3.4.4

Posted by Michael Brunnbauer <br...@netestate.de>.
re

I think my TDB is broken now. I got a memory error on

 SELECT DISTINCT ?subj ?prop ?obj WHERE { GRAPH <http://blogspace.com/swhack/chatlogs/rdflogs/2002-06-24.rdf> { ?subj ?prop ?obj } }

If I change -Xmx1G to -Xmx4G in bin/rdfserver, I do not get the memory error
but lots of errors of this kind:

11:18:04 INFO  SPARQL               :: Query: SELECT DISTINCT ?subj ?prop ?obj W
HERE { GRAPH <http://blogspace.com/swhack/chatlogs/rdflogs/2002-06-24.rdf> { ?subj ?prop ?obj } }  
11:18:04 INFO  SPARQL               :: OK/select: SELECT DISTINCT ?subj ?prop ?obj WHERE { GRAPH <http://blogspace.com/swhack/chatlogs/rdfl
ogs/2002-06-24.rdf> { ?subj ?prop ?obj } }  
11:18:05 ERROR BindingTDB           :: get1(?subj)
com.hp.hpl.jena.tdb.base.file.FileException: ObjectFile.read: Failed to read the object (795439970 bytes) : got 149584 bytes
        at com.hp.hpl.jena.tdb.base.objectfile.ObjectFileDiskDirect.read(ObjectFileDiskDirect.java:182)
        at com.hp.hpl.jena.tdb.lib.NodeLib.fetchDecode(NodeLib.java:66)
        at com.hp.hpl.jena.tdb.nodetable.NodeTableNative.readNodeByNodeId(NodeTableNative.java:158)
        at com.hp.hpl.jena.tdb.nodetable.NodeTableNative._retrieveNodeByNodeId(NodeTableNative.java:85)
        at com.hp.hpl.jena.tdb.nodetable.NodeTableNative.getNodeForNodeId(NodeTableNative.java:58)
        at com.hp.hpl.jena.tdb.nodetable.NodeTableCache._retrieveNodeByNodeId(NodeTableCache.java:86)
        at com.hp.hpl.jena.tdb.nodetable.NodeTableCache.getNodeForNodeId(NodeTableCache.java:57)
        at com.hp.hpl.jena.tdb.nodetable.NodeTableWrapper.getNodeForNodeId(NodeTableWrapper.java:43)
        at com.hp.hpl.jena.tdb.nodetable.NodeTableInline.getNodeForNodeId(NodeTableInline.java:55)
        at com.hp.hpl.jena.tdb.solver.BindingTDB.get1(BindingTDB.java:96)
        at com.hp.hpl.jena.sparql.engine.binding.BindingBase.get(BindingBase.java:126)
        at com.hp.hpl.jena.sparql.engine.binding.BindingProject.get1(BindingProject.java:57)
        at com.hp.hpl.jena.sparql.engine.binding.BindingBase.get(BindingBase.java:126)
        at com.hp.hpl.jena.sparql.engine.binding.BindingWrapped.get(BindingWrapped.java:39)
        at com.hp.hpl.jena.sparql.engine.binding.BindingFixed.calcHashCode(BindingFixed.java:33)
        at com.hp.hpl.jena.sparql.engine.binding.BindingFixed.hashCode(BindingFixed.java:64)
        at java.util.HashMap.getEntry(HashMap.java:344)
        at java.util.HashMap.containsKey(HashMap.java:335)
        at java.util.HashSet.contains(HashSet.java:184)
        at com.hp.hpl.jena.sparql.engine.iterator.QueryIterDistinct.isDuplicate(QueryIterDistinct.java:39)
        at com.hp.hpl.jena.sparql.engine.iterator.QueryIterDistinctReduced.hasNextBinding(QueryIterDistinctReduced.java:39)
        at com.hp.hpl.jena.sparql.engine.iterator.QueryIteratorBase.hasNext(QueryIteratorBase.java:66)
        at com.hp.hpl.jena.sparql.engine.iterator.QueryIteratorWrapper.hasNextBinding(QueryIteratorWrapper.java:28)
        at com.hp.hpl.jena.sparql.engine.iterator.QueryIteratorBase.hasNext(QueryIteratorBase.java:66)
        at com.hp.hpl.jena.sparql.engine.iterator.QueryIteratorWrapper.hasNextBinding(QueryIteratorWrapper.java:28)
        at com.hp.hpl.jena.sparql.engine.iterator.QueryIteratorBase.hasNext(QueryIteratorBase.java:66)
        at com.hp.hpl.jena.sparql.engine.ResultSetStream.hasNext(ResultSetStream.java:57)
        at com.hp.hpl.jena.sparql.resultset.ResultSetMem.<init>(ResultSetMem.java:82)
        at com.hp.hpl.jena.sparql.resultset.TextOutput.write(TextOutput.java:133)
        at com.hp.hpl.jena.sparql.resultset.TextOutput.write(TextOutput.java:116)
        at com.hp.hpl.jena.sparql.resultset.TextOutput.write(TextOutput.java:104)
        at com.hp.hpl.jena.sparql.resultset.TextOutput.format(TextOutput.java:51)
        at com.hp.hpl.jena.query.ResultSetFormatter.out(ResultSetFormatter.java:96)
        at com.hp.hpl.jena.query.ResultSetFormatter.out(ResultSetFormatter.java:48)
        at org.joseki.http.ResponseHttp$3.output(ResponseHttp.java:349)
        at org.joseki.http.ResponseHttp.output(ResponseHttp.java:471)
        at org.joseki.http.ResponseHttp.textOutput(ResponseHttp.java:502)
        at org.joseki.http.ResponseHttp.doResponseResult(ResponseHttp.java:345)
        at org.joseki.http.ResponseHttp.doResponseResultSet(ResponseHttp.java:169)
        at org.joseki.Response.sendResponse(Response.java:87)
        at org.joseki.Dispatcher.dispatch(Dispatcher.java:60)
        at org.joseki.http.Servlet.doCommon(Servlet.java:178)
        at org.joseki.http.Servlet.doPost(Servlet.java:247)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:727)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
        at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511)
        at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:390)
        at org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
        at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
        at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:765)
        at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:440)
        at org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114)
        at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
        at org.mortbay.jetty.Server.handle(Server.java:326)
        at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
        at org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:943)
        at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:756)
        at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:218)
        at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
        at org.mortbay.jetty.nio.BlockingChannelConnector$Connection.run(BlockingChannelConnector.java:164)
        at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
11:18:06 ERROR BindingTDB           :: get1(?subj)
com.hp.hpl.jena.tdb.base.file.FileException: ObjectFile.read: Failed to read the object (795439970 bytes) : got 149584 bytes
        at com.hp.hpl.jena.tdb.base.objectfile.ObjectFileDiskDirect.read(ObjectFileDiskDirect.java:182)
        at com.hp.hpl.jena.tdb.lib.NodeLib.fetchDecode(NodeLib.java:66)
        at com.hp.hpl.jena.tdb.nodetable.NodeTableNative.readNodeByNodeId(NodeTableNative.java:158)
        at com.hp.hpl.jena.tdb.nodetable.NodeTableNative._retrieveNodeByNodeId(NodeTableNative.java:85)
        at com.hp.hpl.jena.tdb.nodetable.NodeTableNative.getNodeForNodeId(NodeTableNative.java:58)
        at com.hp.hpl.jena.tdb.nodetable.NodeTableCache._retrieveNodeByNodeId(NodeTableCache.java:86)
        at com.hp.hpl.jena.tdb.nodetable.NodeTableCache.getNodeForNodeId(NodeTableCache.java:57)
        at com.hp.hpl.jena.tdb.nodetable.NodeTableWrapper.getNodeForNodeId(NodeTableWrapper.java:43)
        at com.hp.hpl.jena.tdb.nodetable.NodeTableInline.getNodeForNodeId(NodeTableInline.java:55)
        at com.hp.hpl.jena.tdb.solver.BindingTDB.get1(BindingTDB.java:96)
        at com.hp.hpl.jena.sparql.engine.binding.BindingBase.get(BindingBase.java:126)
        at com.hp.hpl.jena.sparql.engine.binding.BindingProject.get1(BindingProject.java:57)
        at com.hp.hpl.jena.sparql.engine.binding.BindingBase.get(BindingBase.java:126)
        at com.hp.hpl.jena.sparql.engine.binding.BindingWrapped.get(BindingWrapped.java:39)
        at com.hp.hpl.jena.sparql.engine.binding.BindingFixed.calcHashCode(BindingFixed.java:33)
        at com.hp.hpl.jena.sparql.engine.binding.BindingFixed.hashCode(BindingFixed.java:64)
        at java.util.HashMap.getEntry(HashMap.java:344)
        at java.util.HashMap.containsKey(HashMap.java:335)
        at java.util.HashSet.contains(HashSet.java:184)
        at com.hp.hpl.jena.sparql.engine.iterator.QueryIterDistinct.isDuplicate(QueryIterDistinct.java:39)
        at com.hp.hpl.jena.sparql.engine.iterator.QueryIterDistinctReduced.hasNextBinding(QueryIterDistinctReduced.java:39)
        at com.hp.hpl.jena.sparql.engine.iterator.QueryIteratorBase.hasNext(QueryIteratorBase.java:66)
        at com.hp.hpl.jena.sparql.engine.iterator.QueryIteratorWrapper.hasNextBinding(QueryIteratorWrapper.java:28)
        at com.hp.hpl.jena.sparql.engine.iterator.QueryIteratorBase.hasNext(QueryIteratorBase.java:66)
        at com.hp.hpl.jena.sparql.engine.iterator.QueryIteratorWrapper.hasNextBinding(QueryIteratorWrapper.java:28)
        at com.hp.hpl.jena.sparql.engine.iterator.QueryIteratorBase.hasNext(QueryIteratorBase.java:66)
        at com.hp.hpl.jena.sparql.engine.ResultSetStream.hasNext(ResultSetStream.java:57)
[...]

I have a recent backup of that TDB that has not been introduced to
Joseki-3.4.4.

cu,
brunni

On Thu, May 12, 2011 at 11:00:28AM +0200, Michael Brunnbauer wrote:
> 
> re
> 
> On Thu, May 12, 2011 at 09:46:13AM +0100, Andy Seaborne wrote:
> > Your config file looks fine to me - two services over the same dataset. 
> >  It's two services because SPARQL update and SPARQL query are different 
> > languages (and you can protect the update endpoint separately from the 
> > query endpoint - no injection attacks on the query service). It looks to 
> > me like a Joseki bug in the internal locking.
> 
> I have downgraded to Joseki-3.4.3 and the problem is gone. Please contact me
> if you need any cooperation to find the bug.
> 
> cu,
> brunni
> 
> -- 
> ++  Michael Brunnbauer
> ++  netEstate GmbH
> ++  Geisenhausener Straße 11a
> ++  81379 München
> ++  Tel +49 89 32 19 77 80
> ++  Fax +49 89 32 19 77 89 
> ++  E-Mail brunni@netestate.de
> ++  http://www.netestate.de/
> ++
> ++  Sitz: München, HRB Nr.142452 (Handelsregister B München)
> ++  USt-IdNr. DE221033342
> ++  Geschäftsführer: Michael Brunnbauer, Franz Brunnbauer
> ++  Prokurist: Dipl. Kfm. (Univ.) Markus Hendel

-- 
++  Michael Brunnbauer
++  netEstate GmbH
++  Geisenhausener Straße 11a
++  81379 München
++  Tel +49 89 32 19 77 80
++  Fax +49 89 32 19 77 89 
++  E-Mail brunni@netestate.de
++  http://www.netestate.de/
++
++  Sitz: München, HRB Nr.142452 (Handelsregister B München)
++  USt-IdNr. DE221033342
++  Geschäftsführer: Michael Brunnbauer, Franz Brunnbauer
++  Prokurist: Dipl. Kfm. (Univ.) Markus Hendel

Re: ANN: Joseki 3.4.4

Posted by Michael Brunnbauer <br...@netestate.de>.
re

On Thu, May 12, 2011 at 09:46:13AM +0100, Andy Seaborne wrote:
> Your config file looks fine to me - two services over the same dataset. 
>  It's two services because SPARQL update and SPARQL query are different 
> languages (and you can protect the update endpoint separately from the 
> query endpoint - no injection attacks on the query service). It looks to 
> me like a Joseki bug in the internal locking.

I have downgraded to Joseki-3.4.3 and the problem is gone. Please contact me
if you need any cooperation to find the bug.

cu,
brunni

-- 
++  Michael Brunnbauer
++  netEstate GmbH
++  Geisenhausener Straße 11a
++  81379 München
++  Tel +49 89 32 19 77 80
++  Fax +49 89 32 19 77 89 
++  E-Mail brunni@netestate.de
++  http://www.netestate.de/
++
++  Sitz: München, HRB Nr.142452 (Handelsregister B München)
++  USt-IdNr. DE221033342
++  Geschäftsführer: Michael Brunnbauer, Franz Brunnbauer
++  Prokurist: Dipl. Kfm. (Univ.) Markus Hendel

Re: ANN: Joseki 3.4.4

Posted by Andy Seaborne <an...@epimorphics.com>.
Your config file looks fine to me - two services over the same dataset. 
  It's two services because SPARQL update and SPARQL query are different 
languages (and you can protect the update endpoint separately from the 
query endpoint - no injection attacks on the query service). It looks to 
me like a Joseki bug in the internal locking.

	Andy

On 12/05/11 09:37, Michael Brunnbauer wrote:
>
> re
>
>> On Wed, May 11, 2011 at 09:45:49PM +0100, Andy Seaborne wrote:
>>>> Yes. The dataset has a SPARQL and an update service. Is it possible to
>>>> configure a service that can do both ?
>>> Yes - it's supposed to work.
>
> I have studied http://www.joseki.org/configuration.html and
> joseki-config-example.ttl but don't know how to do it. Maybe by specifying
> 2x joseki:processor in the service ?
>
> joseki:processor joseki:ProcessorSPARQL_FixedDS ;
> joseki:processor joseki:ProcessorSPARQLUpdate ;
>
> Or 2x module:implementation in the processor ?
>
> module:implementation joseki:ImplSPARQL ;
> module:implementation joseki:ImplSPARQLUpdate ;
>
> Or 2x module:className in the implementation ?
>
> module:className<java:org.joseki.processors.SPARQL>  ;
> module:className<java:org.joseki.processors.SPARQLUpdate>  ;
>
> Please help.
>
> cu,
> brunni
>

Re: ANN: Joseki 3.4.4

Posted by Michael Brunnbauer <br...@netestate.de>.
re

> On Wed, May 11, 2011 at 09:45:49PM +0100, Andy Seaborne wrote:
> > >Yes. The dataset has a SPARQL and an update service. Is it possible to
> > >configure a service that can do both ?
> > Yes - it's supposed to work.

I have studied http://www.joseki.org/configuration.html and
joseki-config-example.ttl but don't know how to do it. Maybe by specifying
2x joseki:processor in the service ?

joseki:processor joseki:ProcessorSPARQL_FixedDS ;
joseki:processor joseki:ProcessorSPARQLUpdate ;

Or 2x module:implementation in the processor ?

module:implementation joseki:ImplSPARQL ;
module:implementation joseki:ImplSPARQLUpdate ;

Or 2x module:className in the implementation ?

module:className <java:org.joseki.processors.SPARQL> ;
module:className <java:org.joseki.processors.SPARQLUpdate> ;

Please help.

cu,
brunni

-- 
++  Michael Brunnbauer
++  netEstate GmbH
++  Geisenhausener Straße 11a
++  81379 München
++  Tel +49 89 32 19 77 80
++  Fax +49 89 32 19 77 89 
++  E-Mail brunni@netestate.de
++  http://www.netestate.de/
++
++  Sitz: München, HRB Nr.142452 (Handelsregister B München)
++  USt-IdNr. DE221033342
++  Geschäftsführer: Michael Brunnbauer, Franz Brunnbauer
++  Prokurist: Dipl. Kfm. (Univ.) Markus Hendel

Re: ANN: Joseki 3.4.4

Posted by Michael Brunnbauer <br...@netestate.de>.
re

On Wed, May 11, 2011 at 09:45:49PM +0100, Andy Seaborne wrote:
> >Yes. The dataset has a SPARQL and an update service. Is it possible to
> >configure a service that can do both ?
> Yes - it's supposed to work.

So if I configure it with one service I should get rid of the error ?
I will try.

> One more question - an update on it's own, without overlapping read, 
> works I presume (just in case it's the update conflicting with itself as 
> it has a read and write parts).

Yes - updates are working most of the time. I got an error on an update only
once because a select was running.

cu,
brunni

-- 
++  Michael Brunnbauer
++  netEstate GmbH
++  Geisenhausener Straße 11a
++  81379 München
++  Tel +49 89 32 19 77 80
++  Fax +49 89 32 19 77 89 
++  E-Mail brunni@netestate.de
++  http://www.netestate.de/
++
++  Sitz: München, HRB Nr.142452 (Handelsregister B München)
++  USt-IdNr. DE221033342
++  Geschäftsführer: Michael Brunnbauer, Franz Brunnbauer
++  Prokurist: Dipl. Kfm. (Univ.) Markus Hendel

Re: ANN: Joseki 3.4.4

Posted by Andy Seaborne <an...@epimorphics.com>.

On 11/05/11 18:18, Michael Brunnbauer wrote:
>
> re
>
> On Wed, May 11, 2011 at 05:44:08PM +0100, Andy Seaborne wrote:
>> However, the locking works in other situations - could the same TDB
>> daatbase be shared between services in some way?
>
> Yes. The dataset has a SPARQL and an update service. Is it possible to
> configure a service that can do both ?

Yes - it's supposed to work.

>
>>   What's the joseki
>> config file?

Thanks.

One more question - an update on it's own, without overlapping read, 
works I presume (just in case it's the update conflicting with itself as 
it has a read and write parts).

	Andy



Re: ANN: Joseki 3.4.4

Posted by Andy Seaborne <an...@epimorphics.com>.
I can't reproduce the error - I'm running Joseki, breakpointing in a 
query, issuing the update (using the SOH sripts s-query and s-update) 
and the update is locked out.

Could you give some more details - what's the update, what do the 
concurrent queries look like?

	Andy

The joseki-config file I'm using has two services on one dataset:

@prefix rdfs:   <http://www.w3.org/2000/01/rdf-schema#> .
@prefix rdf:    <http://www.w3.org/1999/02/22-rdf-syntax-ns#> .
@prefix xsd:    <http://www.w3.org/2001/XMLSchema#> .

@prefix module: <http://joseki.org/2003/06/module#> .
@prefix joseki: <http://joseki.org/2005/06/configuration#> .
@prefix ja:     <http://jena.hpl.hp.com/2005/11/Assembler#> .

[]  rdf:type joseki:Server .

<#service1>
     rdf:type            joseki:Service ;
     rdfs:label          "TDB/Query" ;
     joseki:serviceRef   "sparql" ;
     joseki:dataset      <#tdb> ;
     joseki:processor    joseki:ProcessorSPARQL_FixedDS ;
     .
<#service2>
     rdf:type            joseki:Service ;
     rdfs:label          "TDB/Update" ;
     joseki:serviceRef   "update" ;
     joseki:dataset      <#tdb> ;
     joseki:processor     joseki:ProcessorSPARQLUpdate ;
     .

@prefix tdb:     <http://jena.hpl.hp.com/2008/tdb#> .
[] ja:loadClass "com.hp.hpl.jena.tdb.TDB" .
tdb:DatasetTDB  rdfs:subClassOf  ja:RDFDataset .
tdb:GraphTDB    rdfs:subClassOf  ja:Model .

<#tdb> rdf:type      tdb:DatasetTDB ;
     tdb:location "TDB" ;
     .
+ Processors

Re: ANN: Joseki 3.4.4

Posted by Michael Brunnbauer <br...@netestate.de>.
re

On Wed, May 11, 2011 at 05:44:08PM +0100, Andy Seaborne wrote:
> However, the locking works in other situations - could the same TDB 
> daatbase be shared between services in some way?

Yes. The dataset has a SPARQL and an update service. Is it possible to
configure a service that can do both ?

>  What's the joseki 
> config file?

# This file is written in N3 / Turtle

@prefix rdfs:   <http://www.w3.org/2000/01/rdf-schema#> .
@prefix rdf:    <http://www.w3.org/1999/02/22-rdf-syntax-ns#> .
@prefix xsd:    <http://www.w3.org/2001/XMLSchema#> .

@prefix module: <http://joseki.org/2003/06/module#> .
@prefix joseki: <http://joseki.org/2005/06/configuration#> .
@prefix ja:     <http://jena.hpl.hp.com/2005/11/Assembler#> .

@prefix tdb:     <http://jena.hpl.hp.com/2008/tdb#> .

## --------------------------------------------------------------
## This file is written in N3 / Turtle
## It is an RDF graph - order of RDF triples does not matter
## to the machine but it does help people who need to edit this file.

## Note: web.xml must be in-step with this file.
## for each service, 

## Note: adding rdfs:label to blank nodes will cause Joseki 
## to print that in log messages.

## See also file:joseki-config-example.ttl


## --------------------------------------------------------------
## About this configuration

<> rdfs:label "Joseki Configuration File" .

## --------------------------------------------------------------
## About this server

<#server>  rdf:type joseki:Server ;
    # Example of some initialization code.
    joseki:initialization
        [ module:implementation 
            [ module:className <java:org.joseki.util.ServiceInitSimple> ;
              rdfs:label "Example initializer" ; ]
        ] ;
    .

## --------------------------------------------------------------
## Services

## Services are the points that request are sent to.
## serviceRef that will be used to match requests to services,
## not some resource URI for the description.

## Note that the service reference and the routing of incoming
## requests by URI as defined by web.xml have to align.

# Service 1
# General purpose SPARQL processor, no dataset, expects the
# request to specify the dataset (either by parameters in the
# protocol request or in the query itself).

<#service1>
    rdf:type            joseki:Service ;
    rdfs:label          "service point" ;
    joseki:serviceRef   "sparql" ;  # web.xml must route this name to Joseki
    joseki:processor    joseki:ProcessorSPARQL ;
    .

<#service2>
    rdf:type            joseki:Service ;
    rdfs:label          "Update on the foaf model" ;
    joseki:serviceRef   "foafupdate" ;   # web.xml must route this name to Joseki
    # dataset part
    joseki:dataset      <#foaf> ;
    # Service part.
    # This processor will not allow either the protocol,
    # nor the query, to specify the dataset.
    # joseki:processor    joseki:ProcessorSPARQL_FixedDS ;
    joseki:processor	joseki:ProcessorSPARQLUpdate ;
    .

<#service3>
    rdf:type            joseki:Service ;
    rdfs:label          "SPARQL on the foaf model" ;
    joseki:serviceRef   "foaf" ;   # web.xml must route this name to Joseki
    # dataset part
    joseki:dataset      <#foaf> ;
    # Service part.
    # This processor will not allow either the protocol,
    # nor the query, to specify the dataset.
    joseki:processor    joseki:ProcessorSPARQL_FixedDS ;
    .

<#service4>
    rdf:type            joseki:Service ;   
    rdfs:label          "Update on the crawl model" ;
    joseki:serviceRef   "crawlupdate" ;   # web.xml must route this name
    # dataset part
    joseki:dataset      <#crawl> ;
    # Service part.
    # This processor will not allow either the protocol,
    # nor the query, to specify the dataset.
    # joseki:processor    joseki:ProcessorSPARQL_FixedDS ;
    joseki:processor    joseki:ProcessorSPARQLUpdate ;
    .

<#service5>
    rdf:type            joseki:Service ;
    rdfs:label          "SPARQL on the crawl model" ;
    joseki:serviceRef   "crawl";  # web.xml must route this name to Joseki
    # dataset part
    joseki:dataset      <#crawl> ;
    # Service part.
    # This processor will not allow either the protocol,
    # nor the query, to specify the dataset.
    joseki:processor    joseki:ProcessorSPARQL_FixedDS ;
    .

<#service6>
    rdf:type            joseki:Service ;
    rdfs:label          "Update on the ontology model" ;
    joseki:serviceRef   "ontologyupdate" ;   # web.xml must route this name
    # dataset part
    joseki:dataset      <#ontology> ;
    # Service part.
    # This processor will not allow either the protocol,
    # nor the query, to specify the dataset.
    # joseki:processor    joseki:ProcessorSPARQL_FixedDS ;
    joseki:processor    joseki:ProcessorSPARQLUpdate ;
    .

<#service7>
    rdf:type            joseki:Service ;
    rdfs:label          "SPARQL on the ontology model" ;   
    joseki:serviceRef   "ontology";  # web.xml must route this name to Joseki
    # dataset part
    joseki:dataset      <#ontology> ;
    # Service part.
    # This processor will not allow either the protocol,
    # nor the query, to specify the dataset.
    joseki:processor    joseki:ProcessorSPARQL_FixedDS ;
    .

<#service8>
    rdf:type            joseki:Service ;
    rdfs:label          "SPARQL on the dbpedia model" ;
    joseki:serviceRef   "dbpedia";  # web.xml must route this name to Joseki
    # dataset part
    joseki:dataset      <#dbpedia> ;
    # Service part.
    # This processor will not allow either the protocol,
    # nor the query, to specify the dataset.
    joseki:processor    joseki:ProcessorSPARQL_FixedDS ;
    .

## ---- SPARQL/Update
## A pair of services - one for SPARQL queries, one for SPARQL/Update
## Previous web.xml must also be updated to include a defintion for the
## servlet "SPARQL/Update service processor" and update requests must
## be routed to this servlet.


## <#serviceUpdate>
##     rdf:type            joseki:Service ;
##     rdfs:label          "SPARQL/Update" ;
##     joseki:serviceRef   "update/service" ;
##     # dataset part
##     joseki:dataset      <#mem>;
##     # Service part.
##     # This processor will not allow either the protocol,
##     # nor the query, to specify the dataset.
##     joseki:processor    joseki:ProcessorSPARQLUpdate
##     .
## 
## <#serviceRead>
##     rdf:type            joseki:Service ;
##     rdfs:label          "SPARQL" ;
##     joseki:serviceRef   "sparql/read" ;
##     # dataset part
##     joseki:dataset      <#mem> ;     ## Same dataset
##     # Service part.
##     # This processor will not allow either the protocol,
##     # nor the query, to specify the dataset.
##     joseki:processor    joseki:ProcessorSPARQL_FixedDS ;
##     .

## --------------------------------------------------------------
## Datasets

[] ja:loadClass "com.hp.hpl.jena.tdb.TDB" .
tdb:DatasetTDB  rdfs:subClassOf  ja:RDFDataset .
tdb:GraphTDB    rdfs:subClassOf  ja:Model .

<#foaf> rdf:type         tdb:DatasetTDB ;
    rdfs:label "foaf" ;
    tdb:location "foaf" ;
    .

<#crawl> rdf:type         tdb:DatasetTDB ;
    rdfs:label "crawl" ;
    tdb:location "crawl" ;
    .

<#ontology> rdf:type         tdb:DatasetTDB ;
    rdfs:label "ontology" ;
    tdb:location "ontology" ;
    .

<#dbpedia> rdf:type         tdb:DatasetTDB ;
    rdfs:label "dbpedia" ;
    tdb:location "dbpedia" ;
    .

## --------------------------------------------------------------
## Processors

joseki:ProcessorSPARQL
    rdfs:label "General SPARQL processor" ;
    rdf:type joseki:Processor ;
    module:implementation joseki:ImplSPARQL ;

    # Parameters - this processor processes FROM/FROM NAMED
    joseki:allowExplicitDataset       "true"^^xsd:boolean ;
    joseki:allowWebLoading            "true"^^xsd:boolean ;
    ## And has no locking policy (it loads data each time).
    ## The default is mutex (one request at a time)
    joseki:lockingPolicy                joseki:lockingPolicyNone ;
    .

joseki:ProcessorSPARQL_FixedDS
    rdfs:label "SPARQL processor for fixed datasets" ;
    rdf:type joseki:Processor ;
    module:implementation joseki:ImplSPARQL ;

    # This processor does not accept queries with FROM/FROM NAMED
    joseki:allowExplicitDataset       "false"^^xsd:boolean ;
    joseki:allowWebLoading            "false"^^xsd:boolean ;
    joseki:lockingPolicy              joseki:lockingPolicyMRSW ;
    .

joseki:ProcessorSPARQLUpdate
    rdfs:label "SPARQL Update processor" ;
    rdf:type joseki:Processor ;
    module:implementation joseki:ImplSPARQLUpdate ;
    joseki:lockingPolicy              joseki:lockingPolicyMRSW ;
    .

joseki:ImplSPARQL
    rdf:type   joseki:ServiceImpl ;
    module:className
        <java:org.joseki.processors.SPARQL> .

joseki:ImplSPARQLUpdate
    rdf:type   joseki:ServiceImpl ;
    module:className
        <java:org.joseki.processors.SPARQLUpdate> .

# Local Variables:        
# tab-width: 4
# indent-tabs-mode: nil
# End:

cu,
brunni

-- 
++  Michael Brunnbauer
++  netEstate GmbH
++  Geisenhausener Straße 11a
++  81379 München
++  Tel +49 89 32 19 77 80
++  Fax +49 89 32 19 77 89 
++  E-Mail brunni@netestate.de
++  http://www.netestate.de/
++
++  Sitz: München, HRB Nr.142452 (Handelsregister B München)
++  USt-IdNr. DE221033342
++  Geschäftsführer: Michael Brunnbauer, Franz Brunnbauer
++  Prokurist: Dipl. Kfm. (Univ.) Markus Hendel

Re: ANN: Joseki 3.4.4

Posted by Andy Seaborne <an...@epimorphics.com>.

On 11/05/11 15:59, Michael Brunnbauer wrote:
>
> re
>
> This seems to be new with 3.4.4:
>
> 16:52:43 INFO  SPARQL               :: Throwable: Reader = 1, Writer = 1
> java.util.ConcurrentModificationException: Reader = 1, Writer = 1
>          at com.hp.hpl.jena.tdb.sys.ConcurrencyPolicyMRSW.policyError(ConcurrencyPolicyMRSW.java:132)
>
> Got it from a SELECT submitted while an UPDATE was running.
>
> I think earlier versions would delay the SELECT until the UPDATE was finished.
> Is there a way to restore this behavior ?

This is not good. (tm)

It is likely the chnage is merely that the system notices the problem, 
rather than was doing anything different.  TDB has had some trackign 
added to help warn of potential problems.

However, the locking works in other situations - could the same TDB 
daatbase be shared between services in some way?  What's the joseki 
config file?

	Andy

>
> Regards,
>
> Michael Brunnbauer
>
> On Fri, May 06, 2011 at 10:24:28AM +0100, Andy Seaborne wrote:
>> This is release of Joseki to bring it into line with the current
>> versions of ARQ and of TDB and SDB.
>>
>> 	Andy
>>
>> Downloads:
>> http://sourceforge.net/projects/joseki/files/Joseki-SPARQL/Joseki-3.4.4/joseki-3.4.4.zip/download
>>
>> and in the maven repository:
>>
>> Maven details:
>> http://www.openjena.org/repo/org/joseki/joseki/3.4.4/
>>
>>       <dependency>
>>         <groupId>org.joseki</groupId>
>>         <artifactId>joseki</artifactId>
>>         <version>3.4.4</version>
>>       </dependency>
>>
>>       <repository>
>>         <id>repo-jena</id>
>>         <name>Jena Maven - Repository</name>
>>         <layout>default</layout>
>>         <url>http://openjena.org/repo</url>
>>         <snapshots>
>>           <enabled>false</enabled>
>>         </snapshots>
>>       </repository>
>

Re: ANN: Joseki 3.4.4

Posted by Michael Brunnbauer <br...@netestate.de>.
re

This seems to be new with 3.4.4:

16:52:43 INFO  SPARQL               :: Throwable: Reader = 1, Writer = 1
java.util.ConcurrentModificationException: Reader = 1, Writer = 1
        at com.hp.hpl.jena.tdb.sys.ConcurrencyPolicyMRSW.policyError(ConcurrencyPolicyMRSW.java:132)

Got it from a SELECT submitted while an UPDATE was running.

I think earlier versions would delay the SELECT until the UPDATE was finished.
Is there a way to restore this behavior ?

Regards,

Michael Brunnbauer

On Fri, May 06, 2011 at 10:24:28AM +0100, Andy Seaborne wrote:
> This is release of Joseki to bring it into line with the current 
> versions of ARQ and of TDB and SDB.
> 
> 	Andy
> 
> Downloads:
> http://sourceforge.net/projects/joseki/files/Joseki-SPARQL/Joseki-3.4.4/joseki-3.4.4.zip/download
> 
> and in the maven repository:
> 
> Maven details:
> http://www.openjena.org/repo/org/joseki/joseki/3.4.4/
> 
>      <dependency>
>        <groupId>org.joseki</groupId>
>        <artifactId>joseki</artifactId>
>        <version>3.4.4</version>
>      </dependency>
> 
>      <repository>
>        <id>repo-jena</id>
>        <name>Jena Maven - Repository</name>
>        <layout>default</layout>
>        <url>http://openjena.org/repo</url>
>        <snapshots>
>          <enabled>false</enabled>
>        </snapshots>
>      </repository>

-- 
++  Michael Brunnbauer
++  netEstate GmbH
++  Geisenhausener Straße 11a
++  81379 München
++  Tel +49 89 32 19 77 80
++  Fax +49 89 32 19 77 89 
++  E-Mail brunni@netestate.de
++  http://www.netestate.de/
++
++  Sitz: München, HRB Nr.142452 (Handelsregister B München)
++  USt-IdNr. DE221033342
++  Geschäftsführer: Michael Brunnbauer, Franz Brunnbauer
++  Prokurist: Dipl. Kfm. (Univ.) Markus Hendel