You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@jena.apache.org by Paolo Castagna <ca...@googlemail.com> on 2012/04/23 23:43:27 UTC
[ANN] Release of Apache Jena LARQ 1.0.0-incubating
LARQ 1.0.0-incubating has been released, this is the first release of LARQ as
separate module and under the Apache License.
LARQ is a combination of ARQ and Lucene aimed at providing developers with the
ability to perform free text searches within their SPARQL queries.
Documentation for LARQ is available here:
- http://incubator.apache.org/jena/documentation/larq/
- http://incubator.apache.org/jena/documentation/javadoc/larq/
== Mailing lists
The user mailing list for Jena is jena-users@incubator.apache.org
Send email to jena-users-subscribe@incubator.apache.org to subscribe.
See also:
http://incubator.apache.org/jena/help_and_support/index.html
== About This Release
The main new feature in this release is support for updating the Lucene index as
RDF statements are added/removed to the Jena Model via the Jena APIs.
Moreover, LARQ now depends on Apache Lucene 3.5.0.
== Download
Maven artifacts are here:
http://repo1.maven.org/maven2/org/apache/jena/jena-larq/1.0.0-incubating/
Source release is here:
http://www.apache.org/dyn/closer.cgi/incubator/jena/jena-larq-1.0.0-incubating
== Status
Apache Jena is an effort undergoing incubation at the Apache
Software Foundation (ASF), sponsored by the Apache Incubator PMC.
Incubation is required of all newly accepted projects until a
further review indicates that the infrastructure, communications,
and decision making process have stabilized in a manner consistent
with other successful ASF projects.
While incubation status is not necessarily a reflection of
the completeness or stability of the code, it does indicate
that the project has yet to be fully endorsed by the ASF.
For more information about the incubation status of the
Jena project you can go to the following page:
http://incubator.apache.org/projects/jena.html
Re: [ANN] Release of Apache Jena LARQ 1.0.0-incubating
Posted by Paolo Castagna <ca...@googlemail.com>.
Venkat Krishnamurthy wrote:
> Tao
>
> The latter. This assemblerspec just tells it where to find an already
> created index.
>
> Keeping it in sync with tdb is your responsibility at this stage. You have
> to figure out a way to trigger re-indexing or incremental indexing on
> updates/bulk-load.
Hi Venkat,
yes and not, it depends on where the updates come from.
If your updates are coming from SPARQL Update requests, then you are right: the
Lucene index is not kept in sync.
However, if updates are via Jena Model APIs, LARQ 1.0.0 do add/remove data
from the Lucene index.
I'd like to make life as easy as possible for users, but at the moment I did not
find a way to be notified as RDF statements are added/removed which works well
for all the possible 'update code paths'.
For more details on this, please, look at:
https://issues.apache.org/jira/browse/JENA-164
... and if there is anyone who wants to help me on this, you are welcome. :-)
I also want to add support for Solr as well as Elastic Search (and refactor the
LARQ code to make it easy to plugin different indexes). An experimental
prototype for this (now old and not up-to-date) is here:
https://github.com/castagna/EARQ
If you have a look, let me know what you think.
Cheers,
Paolo
>
> Venkat
>
> 2012/4/25 Tao(陶信东) <ta...@myhexin.com>
>
>> Hi Paolo,
>>
>> This is great! I've been waiting for it since several weeks ago.
>>
>> However, after I configured Fuseki for it by adding LARQ to my class path
>> and the following lines to the assembly file, pf:textMatch doesn't work
>> (the
>> usual sparql query works).
>>
>> <#dataset> rdf:type tdb:DatasetTDB ;
>> tdb:location "/path/to/my/tdb/indexes/" ;
>> ja:textIndex "/path/to/lucene/index/" ;
>> .
>>
>> Is Fuseki supported by this LARQ release? Or should I build the lucene
>> index
>> by myself when Fuseki started?
>>
>> Thanks
>> Tao
>>
>> -----Original Message-----
>> From: Paolo Castagna [mailto:castagna.lists@googlemail.com]
>> Sent: Tuesday, April 24, 2012 5:43 AM
>> To: jena-users@incubator.apache.org
>> Subject: [ANN] Release of Apache Jena LARQ 1.0.0-incubating
>>
>> LARQ 1.0.0-incubating has been released, this is the first release of LARQ
>> as separate module and under the Apache License.
>>
>> LARQ is a combination of ARQ and Lucene aimed at providing developers with
>> the ability to perform free text searches within their SPARQL queries.
>>
>> Documentation for LARQ is available here:
>>
>> - http://incubator.apache.org/jena/documentation/larq/
>> - http://incubator.apache.org/jena/documentation/javadoc/larq/
>>
>>
>> == Mailing lists
>>
>> The user mailing list for Jena is jena-users@incubator.apache.org Send
>> email to jena-users-subscribe@incubator.apache.org to subscribe.
>>
>> See also:
>> http://incubator.apache.org/jena/help_and_support/index.html
>>
>>
>> == About This Release
>>
>> The main new feature in this release is support for updating the Lucene
>> index as RDF statements are added/removed to the Jena Model via the Jena
>> APIs.
>> Moreover, LARQ now depends on Apache Lucene 3.5.0.
>>
>>
>> == Download
>>
>> Maven artifacts are here:
>> http://repo1.maven.org/maven2/org/apache/jena/jena-larq/1.0.0-incubating/
>>
>> Source release is here:
>>
>> http://www.apache.org/dyn/closer.cgi/incubator/jena/jena-larq-1.0.0-incubati
>> ng
>>
>>
>> == Status
>>
>> Apache Jena is an effort undergoing incubation at the Apache Software
>> Foundation (ASF), sponsored by the Apache Incubator PMC.
>>
>> Incubation is required of all newly accepted projects until a further
>> review
>> indicates that the infrastructure, communications, and decision making
>> process have stabilized in a manner consistent with other successful ASF
>> projects.
>>
>> While incubation status is not necessarily a reflection of the completeness
>> or stability of the code, it does indicate that the project has yet to be
>> fully endorsed by the ASF.
>>
>> For more information about the incubation status of the Jena project you
>> can
>> go to the following page:
>> http://incubator.apache.org/projects/jena.html
>>
>>
>
Re: [ANN] Release of Apache Jena LARQ 1.0.0-incubating
Posted by Venkat Krishnamurthy <ni...@gmail.com>.
Tao
The latter. This assemblerspec just tells it where to find an already
created index.
Keeping it in sync with tdb is your responsibility at this stage. You have
to figure out a way to trigger re-indexing or incremental indexing on
updates/bulk-load.
Venkat
2012/4/25 Tao(陶信东) <ta...@myhexin.com>
> Hi Paolo,
>
> This is great! I've been waiting for it since several weeks ago.
>
> However, after I configured Fuseki for it by adding LARQ to my class path
> and the following lines to the assembly file, pf:textMatch doesn't work
> (the
> usual sparql query works).
>
> <#dataset> rdf:type tdb:DatasetTDB ;
> tdb:location "/path/to/my/tdb/indexes/" ;
> ja:textIndex "/path/to/lucene/index/" ;
> .
>
> Is Fuseki supported by this LARQ release? Or should I build the lucene
> index
> by myself when Fuseki started?
>
> Thanks
> Tao
>
> -----Original Message-----
> From: Paolo Castagna [mailto:castagna.lists@googlemail.com]
> Sent: Tuesday, April 24, 2012 5:43 AM
> To: jena-users@incubator.apache.org
> Subject: [ANN] Release of Apache Jena LARQ 1.0.0-incubating
>
> LARQ 1.0.0-incubating has been released, this is the first release of LARQ
> as separate module and under the Apache License.
>
> LARQ is a combination of ARQ and Lucene aimed at providing developers with
> the ability to perform free text searches within their SPARQL queries.
>
> Documentation for LARQ is available here:
>
> - http://incubator.apache.org/jena/documentation/larq/
> - http://incubator.apache.org/jena/documentation/javadoc/larq/
>
>
> == Mailing lists
>
> The user mailing list for Jena is jena-users@incubator.apache.org Send
> email to jena-users-subscribe@incubator.apache.org to subscribe.
>
> See also:
> http://incubator.apache.org/jena/help_and_support/index.html
>
>
> == About This Release
>
> The main new feature in this release is support for updating the Lucene
> index as RDF statements are added/removed to the Jena Model via the Jena
> APIs.
> Moreover, LARQ now depends on Apache Lucene 3.5.0.
>
>
> == Download
>
> Maven artifacts are here:
> http://repo1.maven.org/maven2/org/apache/jena/jena-larq/1.0.0-incubating/
>
> Source release is here:
>
> http://www.apache.org/dyn/closer.cgi/incubator/jena/jena-larq-1.0.0-incubati
> ng
>
>
> == Status
>
> Apache Jena is an effort undergoing incubation at the Apache Software
> Foundation (ASF), sponsored by the Apache Incubator PMC.
>
> Incubation is required of all newly accepted projects until a further
> review
> indicates that the infrastructure, communications, and decision making
> process have stabilized in a manner consistent with other successful ASF
> projects.
>
> While incubation status is not necessarily a reflection of the completeness
> or stability of the code, it does indicate that the project has yet to be
> fully endorsed by the ASF.
>
> For more information about the incubation status of the Jena project you
> can
> go to the following page:
> http://incubator.apache.org/projects/jena.html
>
>
RE: [ANN] Release of Apache Jena LARQ 1.0.0-incubating
Posted by "Tao (陶信东)" <ta...@myhexin.com>.
Hi Paolo,
Just noticed some change in the LARQ score. Originally the score seemed to
be normalized to range [0, 1]. Now the score can be higher than 1. Is this a
change of Lucene or LARQ?
How can I get the old good [0, 1] LARQ score now?
Thanks
Tao
-----Original Message-----
From: Tao (陶信东) [mailto:taoxindong@myhexin.com]
Sent: Saturday, April 28, 2012 10:43 AM
To: jena-users@incubator.apache.org
Subject: RE: [ANN] Release of Apache Jena LARQ 1.0.0-incubating
Thanks Paolo! This finally works!!
-----Original Message-----
From: Paolo Castagna [mailto:castagna.lists@googlemail.com]
Sent: Friday, April 27, 2012 11:06 PM
To: jena-users@incubator.apache.org
Subject: Re: [ANN] Release of Apache Jena LARQ 1.0.0-incubating
Hi Tao,
could you try this for me:
svn co http://svn.apache.org/repos/asf/incubator/jena/Jena2/Fuseki/trunk/
fuseki cd fuseki
edit pom.xml adding LARQ dependency:
<dependency>
<groupId>org.apache.jena</groupId>
<artifactId>jena-larq</artifactId>
<version>1.0.0-incubating</version>
</dependency>
mvn clean package
java -jar target/jena-fuseki-0.2.2-incubating-SNAPSHOT-server.jar
--config=config.ttl
---- config.ttl ----
@prefix : <#> .
@prefix fuseki: <http://jena.apache.org/fuseki#> .
@prefix rdf: <http://www.w3.org/1999/02/22-rdf-syntax-ns#> .
@prefix rdfs: <http://www.w3.org/2000/01/rdf-schema#> .
@prefix tdb: <http://jena.hpl.hp.com/2008/tdb#> .
@prefix ja: <http://jena.hpl.hp.com/2005/11/Assembler#> .
[] rdf:type fuseki:Server ;
fuseki:services (
<#service1>
) .
<#service1> rdf:type fuseki:Service ;
fuseki:name "ds" ;
fuseki:serviceQuery "sparql" ;
fuseki:serviceQuery "query" ;
fuseki:serviceUpdate "update" ;
fuseki:serviceUpload "upload" ;
fuseki:serviceReadWriteGraphStore "data" ;
fuseki:serviceReadGraphStore "get" ;
fuseki:serviceReadGraphStore "" ;
fuseki:dataset <#dataset1> ;
.
<#dataset1> rdf:type tdb:DatasetTDB ;
tdb:location "/tmp/tdb" ;
ja:textIndex "/tmp/lucene"
.
----
I get results when I query with:
s-query --service=http://127.0.0.1:3030/ds/sparql "PREFIX pf:
<http://jena.hpl.hp.com/ARQ/property#> SELECT * { ?s pf:textMatch 'word'}
LIMIT 10"
Now, I have done the exactly the same with:
http://svn.apache.org/repos/asf/incubator/jena/Jena2/Fuseki/tags/jena-fuseki
-0.2.1-incubating-RC-1/
and
http://svn.apache.org/repos/asf/incubator/jena/Jena2/Fuseki/tags/jena-fuseki
-0.2.1-incubating/
and I experience your problem. (I checked both since I was not 100% which
tag corresponds to the actual release, it should be
jena-fuseki-0.2.1-incubating,
right?)
The Lucene index is created correctly and it's there, I can query in using
the larq.larq command line:
java -cp target/jena-fuseki-0.2.1-incubating-server.jar larq.larq
--larq=/tmp/lucene "word"
The only hypothesis I have is that somehow something goes wrong with the
assembler which initialize LARQ. I am sorry not being able to be more
helpful at the moment.
The only suggestion I have for you is to try using Fuseki from trunk:
http://svn.apache.org/repos/asf/incubator/jena/Jena2/Fuseki/trunk/
and let me know if you experience problems with that. That works for me.
In the meantime, I'll see if I can find what's the cause of this problem.
Paolo
Tao (陶信东) wrote:
> Hi Paolo,
> The index files seem ok (see below). It was obviously created by
> Fuseki (It didn't exist before I create it). It seems that LARQ is not
> called when performing the pf:textMatch search.
>
> -rw-r--r-- 1 17459784 Apr 27 14:32 _2.fdt
> -rw-r--r-- 1 2325668 Apr 27 14:32 _2.fdx
> -rw-r--r-- 1 40 Apr 27 14:32 _2.fnm
> -rw-r--r-- 1 2269211 Apr 27 14:32 _2.frq
> -rw-r--r-- 1 581420 Apr 27 14:32 _2.nrm
> -rw-r--r-- 1 1414550 Apr 27 14:32 _2.prx
> -rw-r--r-- 1 40894 Apr 27 14:32 _2.tii
> -rw-r--r-- 1 4475539 Apr 27 14:32 _2.tis
> -rw-r--r-- 1 253 Apr 27 14:32 segments_1
> -rw-r--r-- 1 20 Apr 27 14:32 segments.gen
> -rw-r--r-- 1 0 Apr 27 14:32 write.lock
>
> -----Original Message-----
> From: Paolo Castagna [mailto:castagna.lists@googlemail.com]
> Sent: Friday, April 27, 2012 3:26 PM
> To: jena-users@incubator.apache.org
> Subject: Re: [ANN] Release of Apache Jena LARQ 1.0.0-incubating
>
> Hi Tao,
> can you share the bit of your Fuseki configuration where you point at
> the path for your Lucene indexes?
>
> #dataset> rdf:type tdb:DatasetTDB ;
> ...
> ja:textIndex "/path/to/lucene/index/" ;
> .
>
> Can you do an ls -la of that directory to see the file sizes?
>
> Can you try to point to a non existing directory and restart Fuseki?
>
> If the directory exists an empty index will be created (this is a side
> effect of opening a Lucene Directory when your Lucene index does not
exist).
> If the directory does not exist your dataset will be indexed.
>
> Let's see if you can sort this out and let me know if you have ideas
> on how to improve this.
>
> Paolo
>
> Tao (陶信东) wrote:
>> Thanks Paolo. Now I can find the lucene files. But pf:textMatch still
>> doesn't seem to work. See details below.
>>
>> select * where {?s rdfs:label ?o} limit 10
>> ---------------------------------------------------------------------
>> -
>> ------
>> -
>> | s | o
>> |
>> =====================================================================
>> =
>> ======
>> =
>> | <http://xmlns.com/foaf/0.1/LabelProperty> | "Label
> Property"
>> |
>> | <http://xmlns.com/foaf/0.1/Person> | "Person"
>> |
>> | <http://www.w3.org/2000/10/swap/pim/contact#Person> | "Person"
>> |
>> | <http://www.w3.org/2003/01/geo/wgs84_pos#SpatialThing> | "Spatial
Thing"
>> |
>> | <http://xmlns.com/foaf/0.1/Document> | "Document"
>> |
>> | <http://xmlns.com/foaf/0.1/Organization> | "Organization"
>> |
>> | <http://xmlns.com/foaf/0.1/Group> | "Group"
>> |
>> | <http://xmlns.com/foaf/0.1/Agent> | "Agent"
>> |
>> | <http://xmlns.com/foaf/0.1/Project> | "Project"
>> |
>> | <http://xmlns.com/foaf/0.1/Image> | "Image"
>> |
>> ---------------------------------------------------------------------
>> -
>> ------
>> -
>>
>> prefix pf: <http://jena.hpl.hp.com/ARQ/property#>
>> select * where {?s pf:textMatch "+Label"} limit 10
>> -----
>> | s |
>> =====
>> -----
>>
>>
>> -----Original Message-----
>> From: Paolo Castagna [mailto:castagna.lists@googlemail.com]
>> Sent: Thursday, April 26, 2012 10:26 PM
>> To: jena-users@incubator.apache.org
>> Subject: Re: [ANN] Release of Apache Jena LARQ 1.0.0-incubating
>>
>> Tao (陶信东) wrote:
>>> Thanks Paolo, I'll try that.
>>>
>>> Meanwhile, would you please clarify whether Fuseki will build LARQ
>>> index automatically, after the patch?
>> Yes, if the directory does not exist LARQ will create it and build
>> the Lucene index automatically, if a directory exists a Lucene index
>> will be opened pointing to that directory (however, if the directory
>> exists and it's empty, you'll have an empty Lucene index as result):
>>
>> if ( indexPath != null )
>> {
>> File path = new File(indexPath) ;
>> if ( !path.exists() )
>> {
>> log.debug("Directory {} does not exist, building
>> Lucene
>> index...") ;
>> path.mkdirs() ;
>> build ( dataset, path ) ;
>> }
>> directory = FSDirectory.open(path);
>> } else {
>> directory = new RAMDirectory();
>> }
>>
>> http://svn.apache.org/repos/asf/incubator/jena/Jena2/LARQ/tags/jena-l
>> a
>> rq-1.0
>> .0-incubating/src/main/java/org/apache/jena/larq/assembler/AssemblerL
>> A
>> RQ.jav
>> a
>>
>>> Your reply and Venkat's seemed different regarding this.
>> This is because things have been improved since the latest release.
>>
>> Paolo
>>
>>> Thanks
>>> Tao
>>>
>>> -----Original Message-----
>>> From: Paolo Castagna [mailto:castagna.lists@googlemail.com]
>>> Sent: Wednesday, April 25, 2012 6:51 PM
>>> To: jena-users@incubator.apache.org
>>> Subject: Re: [ANN] Release of Apache Jena LARQ 1.0.0-incubating
>>>
>>> Hi Tao
>>>
>>> Tao(陶信东) wrote:
>>>> Hi Paolo,
>>>>
>>>> This is great! I've been waiting for it since several weeks ago.
>>> Good to know.
>>>
>>>> However, after I configured Fuseki for it by adding LARQ to my
>>>> class path and the following lines to the assembly file,
>>>> pf:textMatch doesn't work (the usual sparql query works).
>>>>
>>>> <#dataset> rdf:type tdb:DatasetTDB ;
>>>> tdb:location "/path/to/my/tdb/indexes/" ;
>>>> ja:textIndex "/path/to/lucene/index/" ;
>>>> .
>>>>
>>>> Is Fuseki supported by this LARQ release?
>>> Fuseki does not include LARQ.
>>>
>>> For more details, please, see also:
>>> https://issues.apache.org/jira/browse/JENA-63
>>> https://issues.apache.org/jira/browse/JENA-164
>>>
>>> The good news is that it is extremely easy to check out Fuseki
>>> sources, patch the pom.xml file and repackage it (i.e. mvn package).
See:
>>> https://issues.apache.org/jira/secure/attachment/12504042/JENA-63_Fu
>>> s
>>> e
>>> ki_r12
>>> 03107.patch
>>> (be warned, that patch might not be up-to-date, but you see it's
>>> just a new dependency on LARQ).
>>>
>>>> Or should I build the lucene index
>>>> by myself when Fuseki started?
>>> No, you do not need that.
>>>
>>> 1. Checkout Fuseki source code.
>>> 2. Add LARQ dependency to the Fuseki pom.xml file 3. mvn package
>>>
>>> Let me know how it goes and if you have problems.
>>>
>>> Cheers,
>>> Paolo
>>>
>>>> Thanks
>>>> Tao
>>>>
>>>> -----Original Message-----
>>>> From: Paolo Castagna [mailto:castagna.lists@googlemail.com]
>>>> Sent: Tuesday, April 24, 2012 5:43 AM
>>>> To: jena-users@incubator.apache.org
>>>> Subject: [ANN] Release of Apache Jena LARQ 1.0.0-incubating
>>>>
>>>> LARQ 1.0.0-incubating has been released, this is the first release
>>>> of LARQ as separate module and under the Apache License.
>>>>
>>>> LARQ is a combination of ARQ and Lucene aimed at providing
>>>> developers with the ability to perform free text searches within
>>>> their SPARQL
>>> queries.
>>>> Documentation for LARQ is available here:
>>>>
>>>> - http://incubator.apache.org/jena/documentation/larq/
>>>> - http://incubator.apache.org/jena/documentation/javadoc/larq/
>>>>
>>>>
>>>> == Mailing lists
>>>>
>>>> The user mailing list for Jena is jena-users@incubator.apache.org
>>>> Send email to jena-users-subscribe@incubator.apache.org to subscribe.
>>>>
>>>> See also:
>>>> http://incubator.apache.org/jena/help_and_support/index.html
>>>>
>>>>
>>>> == About This Release
>>>>
>>>> The main new feature in this release is support for updating the
>>>> Lucene index as RDF statements are added/removed to the Jena Model
>>>> via the Jena APIs.
>>>> Moreover, LARQ now depends on Apache Lucene 3.5.0.
>>>>
>>>>
>>>> == Download
>>>>
>>>> Maven artifacts are here:
>>>> http://repo1.maven.org/maven2/org/apache/jena/jena-larq/1.0.0-incub
>>>> a
>>>> t
>>>> i
>>>> ng/
>>>>
>>>> Source release is here:
>>>> http://www.apache.org/dyn/closer.cgi/incubator/jena/jena-larq-1.0.0
>>>> -
>>>> i
>>>> n
>>>> cubati
>>>> ng
>>>>
>>>>
>>>> == Status
>>>>
>>>> Apache Jena is an effort undergoing incubation at the Apache
>>>> Software Foundation (ASF), sponsored by the Apache Incubator PMC.
>>>>
>>>> Incubation is required of all newly accepted projects until a
>>>> further review indicates that the infrastructure, communications,
>>>> and decision making process have stabilized in a manner consistent
>>>> with other successful ASF projects.
>>>>
>>>> While incubation status is not necessarily a reflection of the
>>>> completeness or stability of the code, it does indicate that the
>>>> project has yet to be fully endorsed by the ASF.
>>>>
>>>> For more information about the incubation status of the Jena
>>>> project you can go to the following page:
>>>> http://incubator.apache.org/projects/jena.html
>>>>
>
RE: [ANN] Release of Apache Jena LARQ 1.0.0-incubating
Posted by "Tao (陶信东)" <ta...@myhexin.com>.
Thanks Paolo! This finally works!!
-----Original Message-----
From: Paolo Castagna [mailto:castagna.lists@googlemail.com]
Sent: Friday, April 27, 2012 11:06 PM
To: jena-users@incubator.apache.org
Subject: Re: [ANN] Release of Apache Jena LARQ 1.0.0-incubating
Hi Tao,
could you try this for me:
svn co http://svn.apache.org/repos/asf/incubator/jena/Jena2/Fuseki/trunk/
fuseki cd fuseki
edit pom.xml adding LARQ dependency:
<dependency>
<groupId>org.apache.jena</groupId>
<artifactId>jena-larq</artifactId>
<version>1.0.0-incubating</version>
</dependency>
mvn clean package
java -jar target/jena-fuseki-0.2.2-incubating-SNAPSHOT-server.jar
--config=config.ttl
---- config.ttl ----
@prefix : <#> .
@prefix fuseki: <http://jena.apache.org/fuseki#> .
@prefix rdf: <http://www.w3.org/1999/02/22-rdf-syntax-ns#> .
@prefix rdfs: <http://www.w3.org/2000/01/rdf-schema#> .
@prefix tdb: <http://jena.hpl.hp.com/2008/tdb#> .
@prefix ja: <http://jena.hpl.hp.com/2005/11/Assembler#> .
[] rdf:type fuseki:Server ;
fuseki:services (
<#service1>
) .
<#service1> rdf:type fuseki:Service ;
fuseki:name "ds" ;
fuseki:serviceQuery "sparql" ;
fuseki:serviceQuery "query" ;
fuseki:serviceUpdate "update" ;
fuseki:serviceUpload "upload" ;
fuseki:serviceReadWriteGraphStore "data" ;
fuseki:serviceReadGraphStore "get" ;
fuseki:serviceReadGraphStore "" ;
fuseki:dataset <#dataset1> ;
.
<#dataset1> rdf:type tdb:DatasetTDB ;
tdb:location "/tmp/tdb" ;
ja:textIndex "/tmp/lucene"
.
----
I get results when I query with:
s-query --service=http://127.0.0.1:3030/ds/sparql "PREFIX pf:
<http://jena.hpl.hp.com/ARQ/property#> SELECT * { ?s pf:textMatch 'word'}
LIMIT 10"
Now, I have done the exactly the same with:
http://svn.apache.org/repos/asf/incubator/jena/Jena2/Fuseki/tags/jena-fuseki
-0.2.1-incubating-RC-1/
and
http://svn.apache.org/repos/asf/incubator/jena/Jena2/Fuseki/tags/jena-fuseki
-0.2.1-incubating/
and I experience your problem. (I checked both since I was not 100% which
tag corresponds to the actual release, it should be
jena-fuseki-0.2.1-incubating,
right?)
The Lucene index is created correctly and it's there, I can query in using
the larq.larq command line:
java -cp target/jena-fuseki-0.2.1-incubating-server.jar larq.larq
--larq=/tmp/lucene "word"
The only hypothesis I have is that somehow something goes wrong with the
assembler which initialize LARQ. I am sorry not being able to be more
helpful at the moment.
The only suggestion I have for you is to try using Fuseki from trunk:
http://svn.apache.org/repos/asf/incubator/jena/Jena2/Fuseki/trunk/
and let me know if you experience problems with that. That works for me.
In the meantime, I'll see if I can find what's the cause of this problem.
Paolo
Tao (陶信东) wrote:
> Hi Paolo,
> The index files seem ok (see below). It was obviously created by
> Fuseki (It didn't exist before I create it). It seems that LARQ is not
> called when performing the pf:textMatch search.
>
> -rw-r--r-- 1 17459784 Apr 27 14:32 _2.fdt
> -rw-r--r-- 1 2325668 Apr 27 14:32 _2.fdx
> -rw-r--r-- 1 40 Apr 27 14:32 _2.fnm
> -rw-r--r-- 1 2269211 Apr 27 14:32 _2.frq
> -rw-r--r-- 1 581420 Apr 27 14:32 _2.nrm
> -rw-r--r-- 1 1414550 Apr 27 14:32 _2.prx
> -rw-r--r-- 1 40894 Apr 27 14:32 _2.tii
> -rw-r--r-- 1 4475539 Apr 27 14:32 _2.tis
> -rw-r--r-- 1 253 Apr 27 14:32 segments_1
> -rw-r--r-- 1 20 Apr 27 14:32 segments.gen
> -rw-r--r-- 1 0 Apr 27 14:32 write.lock
>
> -----Original Message-----
> From: Paolo Castagna [mailto:castagna.lists@googlemail.com]
> Sent: Friday, April 27, 2012 3:26 PM
> To: jena-users@incubator.apache.org
> Subject: Re: [ANN] Release of Apache Jena LARQ 1.0.0-incubating
>
> Hi Tao,
> can you share the bit of your Fuseki configuration where you point at
> the path for your Lucene indexes?
>
> #dataset> rdf:type tdb:DatasetTDB ;
> ...
> ja:textIndex "/path/to/lucene/index/" ;
> .
>
> Can you do an ls -la of that directory to see the file sizes?
>
> Can you try to point to a non existing directory and restart Fuseki?
>
> If the directory exists an empty index will be created (this is a side
> effect of opening a Lucene Directory when your Lucene index does not
exist).
> If the directory does not exist your dataset will be indexed.
>
> Let's see if you can sort this out and let me know if you have ideas
> on how to improve this.
>
> Paolo
>
> Tao (陶信东) wrote:
>> Thanks Paolo. Now I can find the lucene files. But pf:textMatch still
>> doesn't seem to work. See details below.
>>
>> select * where {?s rdfs:label ?o} limit 10
>> ---------------------------------------------------------------------
>> -
>> ------
>> -
>> | s | o
>> |
>> =====================================================================
>> =
>> ======
>> =
>> | <http://xmlns.com/foaf/0.1/LabelProperty> | "Label
> Property"
>> |
>> | <http://xmlns.com/foaf/0.1/Person> | "Person"
>> |
>> | <http://www.w3.org/2000/10/swap/pim/contact#Person> | "Person"
>> |
>> | <http://www.w3.org/2003/01/geo/wgs84_pos#SpatialThing> | "Spatial
Thing"
>> |
>> | <http://xmlns.com/foaf/0.1/Document> | "Document"
>> |
>> | <http://xmlns.com/foaf/0.1/Organization> | "Organization"
>> |
>> | <http://xmlns.com/foaf/0.1/Group> | "Group"
>> |
>> | <http://xmlns.com/foaf/0.1/Agent> | "Agent"
>> |
>> | <http://xmlns.com/foaf/0.1/Project> | "Project"
>> |
>> | <http://xmlns.com/foaf/0.1/Image> | "Image"
>> |
>> ---------------------------------------------------------------------
>> -
>> ------
>> -
>>
>> prefix pf: <http://jena.hpl.hp.com/ARQ/property#>
>> select * where {?s pf:textMatch "+Label"} limit 10
>> -----
>> | s |
>> =====
>> -----
>>
>>
>> -----Original Message-----
>> From: Paolo Castagna [mailto:castagna.lists@googlemail.com]
>> Sent: Thursday, April 26, 2012 10:26 PM
>> To: jena-users@incubator.apache.org
>> Subject: Re: [ANN] Release of Apache Jena LARQ 1.0.0-incubating
>>
>> Tao (陶信东) wrote:
>>> Thanks Paolo, I'll try that.
>>>
>>> Meanwhile, would you please clarify whether Fuseki will build LARQ
>>> index automatically, after the patch?
>> Yes, if the directory does not exist LARQ will create it and build
>> the Lucene index automatically, if a directory exists a Lucene index
>> will be opened pointing to that directory (however, if the directory
>> exists and it's empty, you'll have an empty Lucene index as result):
>>
>> if ( indexPath != null )
>> {
>> File path = new File(indexPath) ;
>> if ( !path.exists() )
>> {
>> log.debug("Directory {} does not exist, building
>> Lucene
>> index...") ;
>> path.mkdirs() ;
>> build ( dataset, path ) ;
>> }
>> directory = FSDirectory.open(path);
>> } else {
>> directory = new RAMDirectory();
>> }
>>
>> http://svn.apache.org/repos/asf/incubator/jena/Jena2/LARQ/tags/jena-l
>> a
>> rq-1.0
>> .0-incubating/src/main/java/org/apache/jena/larq/assembler/AssemblerL
>> A
>> RQ.jav
>> a
>>
>>> Your reply and Venkat's seemed different regarding this.
>> This is because things have been improved since the latest release.
>>
>> Paolo
>>
>>> Thanks
>>> Tao
>>>
>>> -----Original Message-----
>>> From: Paolo Castagna [mailto:castagna.lists@googlemail.com]
>>> Sent: Wednesday, April 25, 2012 6:51 PM
>>> To: jena-users@incubator.apache.org
>>> Subject: Re: [ANN] Release of Apache Jena LARQ 1.0.0-incubating
>>>
>>> Hi Tao
>>>
>>> Tao(陶信东) wrote:
>>>> Hi Paolo,
>>>>
>>>> This is great! I've been waiting for it since several weeks ago.
>>> Good to know.
>>>
>>>> However, after I configured Fuseki for it by adding LARQ to my
>>>> class path and the following lines to the assembly file,
>>>> pf:textMatch doesn't work (the usual sparql query works).
>>>>
>>>> <#dataset> rdf:type tdb:DatasetTDB ;
>>>> tdb:location "/path/to/my/tdb/indexes/" ;
>>>> ja:textIndex "/path/to/lucene/index/" ;
>>>> .
>>>>
>>>> Is Fuseki supported by this LARQ release?
>>> Fuseki does not include LARQ.
>>>
>>> For more details, please, see also:
>>> https://issues.apache.org/jira/browse/JENA-63
>>> https://issues.apache.org/jira/browse/JENA-164
>>>
>>> The good news is that it is extremely easy to check out Fuseki
>>> sources, patch the pom.xml file and repackage it (i.e. mvn package).
See:
>>> https://issues.apache.org/jira/secure/attachment/12504042/JENA-63_Fu
>>> s
>>> e
>>> ki_r12
>>> 03107.patch
>>> (be warned, that patch might not be up-to-date, but you see it's
>>> just a new dependency on LARQ).
>>>
>>>> Or should I build the lucene index
>>>> by myself when Fuseki started?
>>> No, you do not need that.
>>>
>>> 1. Checkout Fuseki source code.
>>> 2. Add LARQ dependency to the Fuseki pom.xml file 3. mvn package
>>>
>>> Let me know how it goes and if you have problems.
>>>
>>> Cheers,
>>> Paolo
>>>
>>>> Thanks
>>>> Tao
>>>>
>>>> -----Original Message-----
>>>> From: Paolo Castagna [mailto:castagna.lists@googlemail.com]
>>>> Sent: Tuesday, April 24, 2012 5:43 AM
>>>> To: jena-users@incubator.apache.org
>>>> Subject: [ANN] Release of Apache Jena LARQ 1.0.0-incubating
>>>>
>>>> LARQ 1.0.0-incubating has been released, this is the first release
>>>> of LARQ as separate module and under the Apache License.
>>>>
>>>> LARQ is a combination of ARQ and Lucene aimed at providing
>>>> developers with the ability to perform free text searches within
>>>> their SPARQL
>>> queries.
>>>> Documentation for LARQ is available here:
>>>>
>>>> - http://incubator.apache.org/jena/documentation/larq/
>>>> - http://incubator.apache.org/jena/documentation/javadoc/larq/
>>>>
>>>>
>>>> == Mailing lists
>>>>
>>>> The user mailing list for Jena is jena-users@incubator.apache.org
>>>> Send email to jena-users-subscribe@incubator.apache.org to subscribe.
>>>>
>>>> See also:
>>>> http://incubator.apache.org/jena/help_and_support/index.html
>>>>
>>>>
>>>> == About This Release
>>>>
>>>> The main new feature in this release is support for updating the
>>>> Lucene index as RDF statements are added/removed to the Jena Model
>>>> via the Jena APIs.
>>>> Moreover, LARQ now depends on Apache Lucene 3.5.0.
>>>>
>>>>
>>>> == Download
>>>>
>>>> Maven artifacts are here:
>>>> http://repo1.maven.org/maven2/org/apache/jena/jena-larq/1.0.0-incub
>>>> a
>>>> t
>>>> i
>>>> ng/
>>>>
>>>> Source release is here:
>>>> http://www.apache.org/dyn/closer.cgi/incubator/jena/jena-larq-1.0.0
>>>> -
>>>> i
>>>> n
>>>> cubati
>>>> ng
>>>>
>>>>
>>>> == Status
>>>>
>>>> Apache Jena is an effort undergoing incubation at the Apache
>>>> Software Foundation (ASF), sponsored by the Apache Incubator PMC.
>>>>
>>>> Incubation is required of all newly accepted projects until a
>>>> further review indicates that the infrastructure, communications,
>>>> and decision making process have stabilized in a manner consistent
>>>> with other successful ASF projects.
>>>>
>>>> While incubation status is not necessarily a reflection of the
>>>> completeness or stability of the code, it does indicate that the
>>>> project has yet to be fully endorsed by the ASF.
>>>>
>>>> For more information about the incubation status of the Jena
>>>> project you can go to the following page:
>>>> http://incubator.apache.org/projects/jena.html
>>>>
>
Re: [ANN] Release of Apache Jena LARQ 1.0.0-incubating
Posted by Paolo Castagna <ca...@googlemail.com>.
Hi Tao,
could you try this for me:
svn co http://svn.apache.org/repos/asf/incubator/jena/Jena2/Fuseki/trunk/ fuseki
cd fuseki
edit pom.xml adding LARQ dependency:
<dependency>
<groupId>org.apache.jena</groupId>
<artifactId>jena-larq</artifactId>
<version>1.0.0-incubating</version>
</dependency>
mvn clean package
java -jar target/jena-fuseki-0.2.2-incubating-SNAPSHOT-server.jar
--config=config.ttl
---- config.ttl ----
@prefix : <#> .
@prefix fuseki: <http://jena.apache.org/fuseki#> .
@prefix rdf: <http://www.w3.org/1999/02/22-rdf-syntax-ns#> .
@prefix rdfs: <http://www.w3.org/2000/01/rdf-schema#> .
@prefix tdb: <http://jena.hpl.hp.com/2008/tdb#> .
@prefix ja: <http://jena.hpl.hp.com/2005/11/Assembler#> .
[] rdf:type fuseki:Server ;
fuseki:services (
<#service1>
) .
<#service1> rdf:type fuseki:Service ;
fuseki:name "ds" ;
fuseki:serviceQuery "sparql" ;
fuseki:serviceQuery "query" ;
fuseki:serviceUpdate "update" ;
fuseki:serviceUpload "upload" ;
fuseki:serviceReadWriteGraphStore "data" ;
fuseki:serviceReadGraphStore "get" ;
fuseki:serviceReadGraphStore "" ;
fuseki:dataset <#dataset1> ;
.
<#dataset1> rdf:type tdb:DatasetTDB ;
tdb:location "/tmp/tdb" ;
ja:textIndex "/tmp/lucene"
.
----
I get results when I query with:
s-query --service=http://127.0.0.1:3030/ds/sparql "PREFIX pf:
<http://jena.hpl.hp.com/ARQ/property#> SELECT * { ?s pf:textMatch 'word'} LIMIT 10"
Now, I have done the exactly the same with:
http://svn.apache.org/repos/asf/incubator/jena/Jena2/Fuseki/tags/jena-fuseki-0.2.1-incubating-RC-1/
and
http://svn.apache.org/repos/asf/incubator/jena/Jena2/Fuseki/tags/jena-fuseki-0.2.1-incubating/
and I experience your problem. (I checked both since I was not 100% which tag
corresponds to the actual release, it should be jena-fuseki-0.2.1-incubating,
right?)
The Lucene index is created correctly and it's there, I can query in using the
larq.larq command line:
java -cp target/jena-fuseki-0.2.1-incubating-server.jar larq.larq
--larq=/tmp/lucene "word"
The only hypothesis I have is that somehow something goes wrong with the
assembler which initialize LARQ. I am sorry not being able to be more helpful at
the moment.
The only suggestion I have for you is to try using Fuseki from trunk:
http://svn.apache.org/repos/asf/incubator/jena/Jena2/Fuseki/trunk/
and let me know if you experience problems with that. That works for me.
In the meantime, I'll see if I can find what's the cause of this problem.
Paolo
Tao (陶信东) wrote:
> Hi Paolo,
> The index files seem ok (see below). It was obviously created by Fuseki (It
> didn't exist before I create it). It seems that LARQ is not called when
> performing the pf:textMatch search.
>
> -rw-r--r-- 1 17459784 Apr 27 14:32 _2.fdt
> -rw-r--r-- 1 2325668 Apr 27 14:32 _2.fdx
> -rw-r--r-- 1 40 Apr 27 14:32 _2.fnm
> -rw-r--r-- 1 2269211 Apr 27 14:32 _2.frq
> -rw-r--r-- 1 581420 Apr 27 14:32 _2.nrm
> -rw-r--r-- 1 1414550 Apr 27 14:32 _2.prx
> -rw-r--r-- 1 40894 Apr 27 14:32 _2.tii
> -rw-r--r-- 1 4475539 Apr 27 14:32 _2.tis
> -rw-r--r-- 1 253 Apr 27 14:32 segments_1
> -rw-r--r-- 1 20 Apr 27 14:32 segments.gen
> -rw-r--r-- 1 0 Apr 27 14:32 write.lock
>
> -----Original Message-----
> From: Paolo Castagna [mailto:castagna.lists@googlemail.com]
> Sent: Friday, April 27, 2012 3:26 PM
> To: jena-users@incubator.apache.org
> Subject: Re: [ANN] Release of Apache Jena LARQ 1.0.0-incubating
>
> Hi Tao,
> can you share the bit of your Fuseki configuration where you point at the
> path for your Lucene indexes?
>
> #dataset> rdf:type tdb:DatasetTDB ;
> ...
> ja:textIndex "/path/to/lucene/index/" ;
> .
>
> Can you do an ls -la of that directory to see the file sizes?
>
> Can you try to point to a non existing directory and restart Fuseki?
>
> If the directory exists an empty index will be created (this is a side
> effect of opening a Lucene Directory when your Lucene index does not exist).
> If the directory does not exist your dataset will be indexed.
>
> Let's see if you can sort this out and let me know if you have ideas on how
> to improve this.
>
> Paolo
>
> Tao (陶信东) wrote:
>> Thanks Paolo. Now I can find the lucene files. But pf:textMatch still
>> doesn't seem to work. See details below.
>>
>> select * where {?s rdfs:label ?o} limit 10
>> ----------------------------------------------------------------------
>> ------
>> -
>> | s | o
>> |
>> ======================================================================
>> ======
>> =
>> | <http://xmlns.com/foaf/0.1/LabelProperty> | "Label
> Property"
>> |
>> | <http://xmlns.com/foaf/0.1/Person> | "Person"
>> |
>> | <http://www.w3.org/2000/10/swap/pim/contact#Person> | "Person"
>> |
>> | <http://www.w3.org/2003/01/geo/wgs84_pos#SpatialThing> | "Spatial Thing"
>> |
>> | <http://xmlns.com/foaf/0.1/Document> | "Document"
>> |
>> | <http://xmlns.com/foaf/0.1/Organization> | "Organization"
>> |
>> | <http://xmlns.com/foaf/0.1/Group> | "Group"
>> |
>> | <http://xmlns.com/foaf/0.1/Agent> | "Agent"
>> |
>> | <http://xmlns.com/foaf/0.1/Project> | "Project"
>> |
>> | <http://xmlns.com/foaf/0.1/Image> | "Image"
>> |
>> ----------------------------------------------------------------------
>> ------
>> -
>>
>> prefix pf: <http://jena.hpl.hp.com/ARQ/property#>
>> select * where {?s pf:textMatch "+Label"} limit 10
>> -----
>> | s |
>> =====
>> -----
>>
>>
>> -----Original Message-----
>> From: Paolo Castagna [mailto:castagna.lists@googlemail.com]
>> Sent: Thursday, April 26, 2012 10:26 PM
>> To: jena-users@incubator.apache.org
>> Subject: Re: [ANN] Release of Apache Jena LARQ 1.0.0-incubating
>>
>> Tao (陶信东) wrote:
>>> Thanks Paolo, I'll try that.
>>>
>>> Meanwhile, would you please clarify whether Fuseki will build LARQ
>>> index automatically, after the patch?
>> Yes, if the directory does not exist LARQ will create it and build the
>> Lucene index automatically, if a directory exists a Lucene index will
>> be opened pointing to that directory (however, if the directory exists
>> and it's empty, you'll have an empty Lucene index as result):
>>
>> if ( indexPath != null )
>> {
>> File path = new File(indexPath) ;
>> if ( !path.exists() )
>> {
>> log.debug("Directory {} does not exist, building
>> Lucene
>> index...") ;
>> path.mkdirs() ;
>> build ( dataset, path ) ;
>> }
>> directory = FSDirectory.open(path);
>> } else {
>> directory = new RAMDirectory();
>> }
>>
>> http://svn.apache.org/repos/asf/incubator/jena/Jena2/LARQ/tags/jena-la
>> rq-1.0
>> .0-incubating/src/main/java/org/apache/jena/larq/assembler/AssemblerLA
>> RQ.jav
>> a
>>
>>> Your reply and Venkat's seemed different regarding this.
>> This is because things have been improved since the latest release.
>>
>> Paolo
>>
>>> Thanks
>>> Tao
>>>
>>> -----Original Message-----
>>> From: Paolo Castagna [mailto:castagna.lists@googlemail.com]
>>> Sent: Wednesday, April 25, 2012 6:51 PM
>>> To: jena-users@incubator.apache.org
>>> Subject: Re: [ANN] Release of Apache Jena LARQ 1.0.0-incubating
>>>
>>> Hi Tao
>>>
>>> Tao(陶信东) wrote:
>>>> Hi Paolo,
>>>>
>>>> This is great! I've been waiting for it since several weeks ago.
>>> Good to know.
>>>
>>>> However, after I configured Fuseki for it by adding LARQ to my class
>>>> path and the following lines to the assembly file, pf:textMatch
>>>> doesn't work (the usual sparql query works).
>>>>
>>>> <#dataset> rdf:type tdb:DatasetTDB ;
>>>> tdb:location "/path/to/my/tdb/indexes/" ;
>>>> ja:textIndex "/path/to/lucene/index/" ;
>>>> .
>>>>
>>>> Is Fuseki supported by this LARQ release?
>>> Fuseki does not include LARQ.
>>>
>>> For more details, please, see also:
>>> https://issues.apache.org/jira/browse/JENA-63
>>> https://issues.apache.org/jira/browse/JENA-164
>>>
>>> The good news is that it is extremely easy to check out Fuseki
>>> sources, patch the pom.xml file and repackage it (i.e. mvn package). See:
>>> https://issues.apache.org/jira/secure/attachment/12504042/JENA-63_Fus
>>> e
>>> ki_r12
>>> 03107.patch
>>> (be warned, that patch might not be up-to-date, but you see it's just
>>> a new dependency on LARQ).
>>>
>>>> Or should I build the lucene index
>>>> by myself when Fuseki started?
>>> No, you do not need that.
>>>
>>> 1. Checkout Fuseki source code.
>>> 2. Add LARQ dependency to the Fuseki pom.xml file 3. mvn package
>>>
>>> Let me know how it goes and if you have problems.
>>>
>>> Cheers,
>>> Paolo
>>>
>>>> Thanks
>>>> Tao
>>>>
>>>> -----Original Message-----
>>>> From: Paolo Castagna [mailto:castagna.lists@googlemail.com]
>>>> Sent: Tuesday, April 24, 2012 5:43 AM
>>>> To: jena-users@incubator.apache.org
>>>> Subject: [ANN] Release of Apache Jena LARQ 1.0.0-incubating
>>>>
>>>> LARQ 1.0.0-incubating has been released, this is the first release
>>>> of LARQ as separate module and under the Apache License.
>>>>
>>>> LARQ is a combination of ARQ and Lucene aimed at providing
>>>> developers with the ability to perform free text searches within
>>>> their SPARQL
>>> queries.
>>>> Documentation for LARQ is available here:
>>>>
>>>> - http://incubator.apache.org/jena/documentation/larq/
>>>> - http://incubator.apache.org/jena/documentation/javadoc/larq/
>>>>
>>>>
>>>> == Mailing lists
>>>>
>>>> The user mailing list for Jena is jena-users@incubator.apache.org
>>>> Send email to jena-users-subscribe@incubator.apache.org to subscribe.
>>>>
>>>> See also:
>>>> http://incubator.apache.org/jena/help_and_support/index.html
>>>>
>>>>
>>>> == About This Release
>>>>
>>>> The main new feature in this release is support for updating the
>>>> Lucene index as RDF statements are added/removed to the Jena Model
>>>> via the Jena APIs.
>>>> Moreover, LARQ now depends on Apache Lucene 3.5.0.
>>>>
>>>>
>>>> == Download
>>>>
>>>> Maven artifacts are here:
>>>> http://repo1.maven.org/maven2/org/apache/jena/jena-larq/1.0.0-incuba
>>>> t
>>>> i
>>>> ng/
>>>>
>>>> Source release is here:
>>>> http://www.apache.org/dyn/closer.cgi/incubator/jena/jena-larq-1.0.0-
>>>> i
>>>> n
>>>> cubati
>>>> ng
>>>>
>>>>
>>>> == Status
>>>>
>>>> Apache Jena is an effort undergoing incubation at the Apache
>>>> Software Foundation (ASF), sponsored by the Apache Incubator PMC.
>>>>
>>>> Incubation is required of all newly accepted projects until a
>>>> further review indicates that the infrastructure, communications,
>>>> and decision making process have stabilized in a manner consistent
>>>> with other successful ASF projects.
>>>>
>>>> While incubation status is not necessarily a reflection of the
>>>> completeness or stability of the code, it does indicate that the
>>>> project has yet to be fully endorsed by the ASF.
>>>>
>>>> For more information about the incubation status of the Jena project
>>>> you can go to the following page:
>>>> http://incubator.apache.org/projects/jena.html
>>>>
>
RE: [ANN] Release of Apache Jena LARQ 1.0.0-incubating
Posted by "Tao (陶信东)" <ta...@myhexin.com>.
Hi Paolo,
The index files seem ok (see below). It was obviously created by Fuseki (It
didn't exist before I create it). It seems that LARQ is not called when
performing the pf:textMatch search.
-rw-r--r-- 1 17459784 Apr 27 14:32 _2.fdt
-rw-r--r-- 1 2325668 Apr 27 14:32 _2.fdx
-rw-r--r-- 1 40 Apr 27 14:32 _2.fnm
-rw-r--r-- 1 2269211 Apr 27 14:32 _2.frq
-rw-r--r-- 1 581420 Apr 27 14:32 _2.nrm
-rw-r--r-- 1 1414550 Apr 27 14:32 _2.prx
-rw-r--r-- 1 40894 Apr 27 14:32 _2.tii
-rw-r--r-- 1 4475539 Apr 27 14:32 _2.tis
-rw-r--r-- 1 253 Apr 27 14:32 segments_1
-rw-r--r-- 1 20 Apr 27 14:32 segments.gen
-rw-r--r-- 1 0 Apr 27 14:32 write.lock
-----Original Message-----
From: Paolo Castagna [mailto:castagna.lists@googlemail.com]
Sent: Friday, April 27, 2012 3:26 PM
To: jena-users@incubator.apache.org
Subject: Re: [ANN] Release of Apache Jena LARQ 1.0.0-incubating
Hi Tao,
can you share the bit of your Fuseki configuration where you point at the
path for your Lucene indexes?
#dataset> rdf:type tdb:DatasetTDB ;
...
ja:textIndex "/path/to/lucene/index/" ;
.
Can you do an ls -la of that directory to see the file sizes?
Can you try to point to a non existing directory and restart Fuseki?
If the directory exists an empty index will be created (this is a side
effect of opening a Lucene Directory when your Lucene index does not exist).
If the directory does not exist your dataset will be indexed.
Let's see if you can sort this out and let me know if you have ideas on how
to improve this.
Paolo
Tao (陶信东) wrote:
> Thanks Paolo. Now I can find the lucene files. But pf:textMatch still
> doesn't seem to work. See details below.
>
> select * where {?s rdfs:label ?o} limit 10
> ----------------------------------------------------------------------
> ------
> -
> | s | o
> |
> ======================================================================
> ======
> =
> | <http://xmlns.com/foaf/0.1/LabelProperty> | "Label
Property"
> |
> | <http://xmlns.com/foaf/0.1/Person> | "Person"
> |
> | <http://www.w3.org/2000/10/swap/pim/contact#Person> | "Person"
> |
> | <http://www.w3.org/2003/01/geo/wgs84_pos#SpatialThing> | "Spatial Thing"
> |
> | <http://xmlns.com/foaf/0.1/Document> | "Document"
> |
> | <http://xmlns.com/foaf/0.1/Organization> | "Organization"
> |
> | <http://xmlns.com/foaf/0.1/Group> | "Group"
> |
> | <http://xmlns.com/foaf/0.1/Agent> | "Agent"
> |
> | <http://xmlns.com/foaf/0.1/Project> | "Project"
> |
> | <http://xmlns.com/foaf/0.1/Image> | "Image"
> |
> ----------------------------------------------------------------------
> ------
> -
>
> prefix pf: <http://jena.hpl.hp.com/ARQ/property#>
> select * where {?s pf:textMatch "+Label"} limit 10
> -----
> | s |
> =====
> -----
>
>
> -----Original Message-----
> From: Paolo Castagna [mailto:castagna.lists@googlemail.com]
> Sent: Thursday, April 26, 2012 10:26 PM
> To: jena-users@incubator.apache.org
> Subject: Re: [ANN] Release of Apache Jena LARQ 1.0.0-incubating
>
> Tao (陶信东) wrote:
>> Thanks Paolo, I'll try that.
>>
>> Meanwhile, would you please clarify whether Fuseki will build LARQ
>> index automatically, after the patch?
>
> Yes, if the directory does not exist LARQ will create it and build the
> Lucene index automatically, if a directory exists a Lucene index will
> be opened pointing to that directory (however, if the directory exists
> and it's empty, you'll have an empty Lucene index as result):
>
> if ( indexPath != null )
> {
> File path = new File(indexPath) ;
> if ( !path.exists() )
> {
> log.debug("Directory {} does not exist, building
> Lucene
> index...") ;
> path.mkdirs() ;
> build ( dataset, path ) ;
> }
> directory = FSDirectory.open(path);
> } else {
> directory = new RAMDirectory();
> }
>
> http://svn.apache.org/repos/asf/incubator/jena/Jena2/LARQ/tags/jena-la
> rq-1.0
> .0-incubating/src/main/java/org/apache/jena/larq/assembler/AssemblerLA
> RQ.jav
> a
>
>> Your reply and Venkat's seemed different regarding this.
>
> This is because things have been improved since the latest release.
>
> Paolo
>
>> Thanks
>> Tao
>>
>> -----Original Message-----
>> From: Paolo Castagna [mailto:castagna.lists@googlemail.com]
>> Sent: Wednesday, April 25, 2012 6:51 PM
>> To: jena-users@incubator.apache.org
>> Subject: Re: [ANN] Release of Apache Jena LARQ 1.0.0-incubating
>>
>> Hi Tao
>>
>> Tao(陶信东) wrote:
>>> Hi Paolo,
>>>
>>> This is great! I've been waiting for it since several weeks ago.
>> Good to know.
>>
>>> However, after I configured Fuseki for it by adding LARQ to my class
>>> path and the following lines to the assembly file, pf:textMatch
>>> doesn't work (the usual sparql query works).
>>>
>>> <#dataset> rdf:type tdb:DatasetTDB ;
>>> tdb:location "/path/to/my/tdb/indexes/" ;
>>> ja:textIndex "/path/to/lucene/index/" ;
>>> .
>>>
>>> Is Fuseki supported by this LARQ release?
>> Fuseki does not include LARQ.
>>
>> For more details, please, see also:
>> https://issues.apache.org/jira/browse/JENA-63
>> https://issues.apache.org/jira/browse/JENA-164
>>
>> The good news is that it is extremely easy to check out Fuseki
>> sources, patch the pom.xml file and repackage it (i.e. mvn package). See:
>> https://issues.apache.org/jira/secure/attachment/12504042/JENA-63_Fus
>> e
>> ki_r12
>> 03107.patch
>> (be warned, that patch might not be up-to-date, but you see it's just
>> a new dependency on LARQ).
>>
>>> Or should I build the lucene index
>>> by myself when Fuseki started?
>> No, you do not need that.
>>
>> 1. Checkout Fuseki source code.
>> 2. Add LARQ dependency to the Fuseki pom.xml file 3. mvn package
>>
>> Let me know how it goes and if you have problems.
>>
>> Cheers,
>> Paolo
>>
>>> Thanks
>>> Tao
>>>
>>> -----Original Message-----
>>> From: Paolo Castagna [mailto:castagna.lists@googlemail.com]
>>> Sent: Tuesday, April 24, 2012 5:43 AM
>>> To: jena-users@incubator.apache.org
>>> Subject: [ANN] Release of Apache Jena LARQ 1.0.0-incubating
>>>
>>> LARQ 1.0.0-incubating has been released, this is the first release
>>> of LARQ as separate module and under the Apache License.
>>>
>>> LARQ is a combination of ARQ and Lucene aimed at providing
>>> developers with the ability to perform free text searches within
>>> their SPARQL
>> queries.
>>> Documentation for LARQ is available here:
>>>
>>> - http://incubator.apache.org/jena/documentation/larq/
>>> - http://incubator.apache.org/jena/documentation/javadoc/larq/
>>>
>>>
>>> == Mailing lists
>>>
>>> The user mailing list for Jena is jena-users@incubator.apache.org
>>> Send email to jena-users-subscribe@incubator.apache.org to subscribe.
>>>
>>> See also:
>>> http://incubator.apache.org/jena/help_and_support/index.html
>>>
>>>
>>> == About This Release
>>>
>>> The main new feature in this release is support for updating the
>>> Lucene index as RDF statements are added/removed to the Jena Model
>>> via the Jena APIs.
>>> Moreover, LARQ now depends on Apache Lucene 3.5.0.
>>>
>>>
>>> == Download
>>>
>>> Maven artifacts are here:
>>> http://repo1.maven.org/maven2/org/apache/jena/jena-larq/1.0.0-incuba
>>> t
>>> i
>>> ng/
>>>
>>> Source release is here:
>>> http://www.apache.org/dyn/closer.cgi/incubator/jena/jena-larq-1.0.0-
>>> i
>>> n
>>> cubati
>>> ng
>>>
>>>
>>> == Status
>>>
>>> Apache Jena is an effort undergoing incubation at the Apache
>>> Software Foundation (ASF), sponsored by the Apache Incubator PMC.
>>>
>>> Incubation is required of all newly accepted projects until a
>>> further review indicates that the infrastructure, communications,
>>> and decision making process have stabilized in a manner consistent
>>> with other successful ASF projects.
>>>
>>> While incubation status is not necessarily a reflection of the
>>> completeness or stability of the code, it does indicate that the
>>> project has yet to be fully endorsed by the ASF.
>>>
>>> For more information about the incubation status of the Jena project
>>> you can go to the following page:
>>> http://incubator.apache.org/projects/jena.html
>>>
>
RE: [ANN] Release of Apache Jena LARQ 1.0.0-incubating
Posted by "Tao (陶信东)" <ta...@myhexin.com>.
Sorry the text in the second pair of brackets should be "It(The index
directory) didn't exist before I started Fuseki".
-----Original Message-----
From: Tao (陶信东) [mailto:taoxindong@myhexin.com]
Sent: Friday, April 27, 2012 5:57 PM
To: 'jena-users@incubator.apache.org'
Subject: RE: [ANN] Release of Apache Jena LARQ 1.0.0-incubating
Hi Paolo,
The index files seem ok (see below). It was obviously created by Fuseki (It
didn't exist before I create it). It seems that LARQ is not called when
performing the pf:textMatch search.
-rw-r--r-- 1 17459784 Apr 27 14:32 _2.fdt
-rw-r--r-- 1 2325668 Apr 27 14:32 _2.fdx
-rw-r--r-- 1 40 Apr 27 14:32 _2.fnm
-rw-r--r-- 1 2269211 Apr 27 14:32 _2.frq
-rw-r--r-- 1 581420 Apr 27 14:32 _2.nrm
-rw-r--r-- 1 1414550 Apr 27 14:32 _2.prx
-rw-r--r-- 1 40894 Apr 27 14:32 _2.tii
-rw-r--r-- 1 4475539 Apr 27 14:32 _2.tis
-rw-r--r-- 1 253 Apr 27 14:32 segments_1
-rw-r--r-- 1 20 Apr 27 14:32 segments.gen
-rw-r--r-- 1 0 Apr 27 14:32 write.lock
-----Original Message-----
From: Paolo Castagna [mailto:castagna.lists@googlemail.com]
Sent: Friday, April 27, 2012 3:26 PM
To: jena-users@incubator.apache.org
Subject: Re: [ANN] Release of Apache Jena LARQ 1.0.0-incubating
Hi Tao,
can you share the bit of your Fuseki configuration where you point at the
path for your Lucene indexes?
#dataset> rdf:type tdb:DatasetTDB ;
...
ja:textIndex "/path/to/lucene/index/" ;
.
Can you do an ls -la of that directory to see the file sizes?
Can you try to point to a non existing directory and restart Fuseki?
If the directory exists an empty index will be created (this is a side
effect of opening a Lucene Directory when your Lucene index does not exist).
If the directory does not exist your dataset will be indexed.
Let's see if you can sort this out and let me know if you have ideas on how
to improve this.
Paolo
Tao (陶信东) wrote:
> Thanks Paolo. Now I can find the lucene files. But pf:textMatch still
> doesn't seem to work. See details below.
>
> select * where {?s rdfs:label ?o} limit 10
> ----------------------------------------------------------------------
> ------
> -
> | s | o
> |
> ======================================================================
> ======
> =
> | <http://xmlns.com/foaf/0.1/LabelProperty> | "Label
Property"
> |
> | <http://xmlns.com/foaf/0.1/Person> | "Person"
> |
> | <http://www.w3.org/2000/10/swap/pim/contact#Person> | "Person"
> |
> | <http://www.w3.org/2003/01/geo/wgs84_pos#SpatialThing> | "Spatial Thing"
> |
> | <http://xmlns.com/foaf/0.1/Document> | "Document"
> |
> | <http://xmlns.com/foaf/0.1/Organization> | "Organization"
> |
> | <http://xmlns.com/foaf/0.1/Group> | "Group"
> |
> | <http://xmlns.com/foaf/0.1/Agent> | "Agent"
> |
> | <http://xmlns.com/foaf/0.1/Project> | "Project"
> |
> | <http://xmlns.com/foaf/0.1/Image> | "Image"
> |
> ----------------------------------------------------------------------
> ------
> -
>
> prefix pf: <http://jena.hpl.hp.com/ARQ/property#>
> select * where {?s pf:textMatch "+Label"} limit 10
> -----
> | s |
> =====
> -----
>
>
> -----Original Message-----
> From: Paolo Castagna [mailto:castagna.lists@googlemail.com]
> Sent: Thursday, April 26, 2012 10:26 PM
> To: jena-users@incubator.apache.org
> Subject: Re: [ANN] Release of Apache Jena LARQ 1.0.0-incubating
>
> Tao (陶信东) wrote:
>> Thanks Paolo, I'll try that.
>>
>> Meanwhile, would you please clarify whether Fuseki will build LARQ
>> index automatically, after the patch?
>
> Yes, if the directory does not exist LARQ will create it and build the
> Lucene index automatically, if a directory exists a Lucene index will
> be opened pointing to that directory (however, if the directory exists
> and it's empty, you'll have an empty Lucene index as result):
>
> if ( indexPath != null )
> {
> File path = new File(indexPath) ;
> if ( !path.exists() )
> {
> log.debug("Directory {} does not exist, building
> Lucene
> index...") ;
> path.mkdirs() ;
> build ( dataset, path ) ;
> }
> directory = FSDirectory.open(path);
> } else {
> directory = new RAMDirectory();
> }
>
> http://svn.apache.org/repos/asf/incubator/jena/Jena2/LARQ/tags/jena-la
> rq-1.0
> .0-incubating/src/main/java/org/apache/jena/larq/assembler/AssemblerLA
> RQ.jav
> a
>
>> Your reply and Venkat's seemed different regarding this.
>
> This is because things have been improved since the latest release.
>
> Paolo
>
>> Thanks
>> Tao
>>
>> -----Original Message-----
>> From: Paolo Castagna [mailto:castagna.lists@googlemail.com]
>> Sent: Wednesday, April 25, 2012 6:51 PM
>> To: jena-users@incubator.apache.org
>> Subject: Re: [ANN] Release of Apache Jena LARQ 1.0.0-incubating
>>
>> Hi Tao
>>
>> Tao(陶信东) wrote:
>>> Hi Paolo,
>>>
>>> This is great! I've been waiting for it since several weeks ago.
>> Good to know.
>>
>>> However, after I configured Fuseki for it by adding LARQ to my class
>>> path and the following lines to the assembly file, pf:textMatch
>>> doesn't work (the usual sparql query works).
>>>
>>> <#dataset> rdf:type tdb:DatasetTDB ;
>>> tdb:location "/path/to/my/tdb/indexes/" ;
>>> ja:textIndex "/path/to/lucene/index/" ;
>>> .
>>>
>>> Is Fuseki supported by this LARQ release?
>> Fuseki does not include LARQ.
>>
>> For more details, please, see also:
>> https://issues.apache.org/jira/browse/JENA-63
>> https://issues.apache.org/jira/browse/JENA-164
>>
>> The good news is that it is extremely easy to check out Fuseki
>> sources, patch the pom.xml file and repackage it (i.e. mvn package). See:
>> https://issues.apache.org/jira/secure/attachment/12504042/JENA-63_Fus
>> e
>> ki_r12
>> 03107.patch
>> (be warned, that patch might not be up-to-date, but you see it's just
>> a new dependency on LARQ).
>>
>>> Or should I build the lucene index
>>> by myself when Fuseki started?
>> No, you do not need that.
>>
>> 1. Checkout Fuseki source code.
>> 2. Add LARQ dependency to the Fuseki pom.xml file 3. mvn package
>>
>> Let me know how it goes and if you have problems.
>>
>> Cheers,
>> Paolo
>>
>>> Thanks
>>> Tao
>>>
>>> -----Original Message-----
>>> From: Paolo Castagna [mailto:castagna.lists@googlemail.com]
>>> Sent: Tuesday, April 24, 2012 5:43 AM
>>> To: jena-users@incubator.apache.org
>>> Subject: [ANN] Release of Apache Jena LARQ 1.0.0-incubating
>>>
>>> LARQ 1.0.0-incubating has been released, this is the first release
>>> of LARQ as separate module and under the Apache License.
>>>
>>> LARQ is a combination of ARQ and Lucene aimed at providing
>>> developers with the ability to perform free text searches within
>>> their SPARQL
>> queries.
>>> Documentation for LARQ is available here:
>>>
>>> - http://incubator.apache.org/jena/documentation/larq/
>>> - http://incubator.apache.org/jena/documentation/javadoc/larq/
>>>
>>>
>>> == Mailing lists
>>>
>>> The user mailing list for Jena is jena-users@incubator.apache.org
>>> Send email to jena-users-subscribe@incubator.apache.org to subscribe.
>>>
>>> See also:
>>> http://incubator.apache.org/jena/help_and_support/index.html
>>>
>>>
>>> == About This Release
>>>
>>> The main new feature in this release is support for updating the
>>> Lucene index as RDF statements are added/removed to the Jena Model
>>> via the Jena APIs.
>>> Moreover, LARQ now depends on Apache Lucene 3.5.0.
>>>
>>>
>>> == Download
>>>
>>> Maven artifacts are here:
>>> http://repo1.maven.org/maven2/org/apache/jena/jena-larq/1.0.0-incuba
>>> t
>>> i
>>> ng/
>>>
>>> Source release is here:
>>> http://www.apache.org/dyn/closer.cgi/incubator/jena/jena-larq-1.0.0-
>>> i
>>> n
>>> cubati
>>> ng
>>>
>>>
>>> == Status
>>>
>>> Apache Jena is an effort undergoing incubation at the Apache
>>> Software Foundation (ASF), sponsored by the Apache Incubator PMC.
>>>
>>> Incubation is required of all newly accepted projects until a
>>> further review indicates that the infrastructure, communications,
>>> and decision making process have stabilized in a manner consistent
>>> with other successful ASF projects.
>>>
>>> While incubation status is not necessarily a reflection of the
>>> completeness or stability of the code, it does indicate that the
>>> project has yet to be fully endorsed by the ASF.
>>>
>>> For more information about the incubation status of the Jena project
>>> you can go to the following page:
>>> http://incubator.apache.org/projects/jena.html
>>>
>
Re: [ANN] Release of Apache Jena LARQ 1.0.0-incubating
Posted by Paolo Castagna <ca...@googlemail.com>.
Hi Tao,
can you share the bit of your Fuseki configuration where you point at the path for your Lucene indexes?
#dataset> rdf:type tdb:DatasetTDB ;
...
ja:textIndex "/path/to/lucene/index/" ;
.
Can you do an ls -la of that directory to see the file sizes?
Can you try to point to a non existing directory and restart Fuseki?
If the directory exists an empty index will be created (this is a side effect of opening a Lucene Directory when your Lucene index does not exist).
If the directory does not exist your dataset will be indexed.
Let's see if you can sort this out and let me know if you have ideas on how to improve this.
Paolo
Tao (陶信东) wrote:
> Thanks Paolo. Now I can find the lucene files. But pf:textMatch still
> doesn't seem to work. See details below.
>
> select * where {?s rdfs:label ?o} limit 10
> ----------------------------------------------------------------------------
> -
> | s | o
> |
> ============================================================================
> =
> | <http://xmlns.com/foaf/0.1/LabelProperty> | "Label Property"
> |
> | <http://xmlns.com/foaf/0.1/Person> | "Person"
> |
> | <http://www.w3.org/2000/10/swap/pim/contact#Person> | "Person"
> |
> | <http://www.w3.org/2003/01/geo/wgs84_pos#SpatialThing> | "Spatial Thing"
> |
> | <http://xmlns.com/foaf/0.1/Document> | "Document"
> |
> | <http://xmlns.com/foaf/0.1/Organization> | "Organization"
> |
> | <http://xmlns.com/foaf/0.1/Group> | "Group"
> |
> | <http://xmlns.com/foaf/0.1/Agent> | "Agent"
> |
> | <http://xmlns.com/foaf/0.1/Project> | "Project"
> |
> | <http://xmlns.com/foaf/0.1/Image> | "Image"
> |
> ----------------------------------------------------------------------------
> -
>
> prefix pf: <http://jena.hpl.hp.com/ARQ/property#>
> select * where {?s pf:textMatch "+Label"} limit 10
> -----
> | s |
> =====
> -----
>
>
> -----Original Message-----
> From: Paolo Castagna [mailto:castagna.lists@googlemail.com]
> Sent: Thursday, April 26, 2012 10:26 PM
> To: jena-users@incubator.apache.org
> Subject: Re: [ANN] Release of Apache Jena LARQ 1.0.0-incubating
>
> Tao (陶信东) wrote:
>> Thanks Paolo, I'll try that.
>>
>> Meanwhile, would you please clarify whether Fuseki will build LARQ
>> index automatically, after the patch?
>
> Yes, if the directory does not exist LARQ will create it and build the
> Lucene index automatically, if a directory exists a Lucene index will be
> opened pointing to that directory (however, if the directory exists and it's
> empty, you'll have an empty Lucene index as result):
>
> if ( indexPath != null )
> {
> File path = new File(indexPath) ;
> if ( !path.exists() )
> {
> log.debug("Directory {} does not exist, building Lucene
> index...") ;
> path.mkdirs() ;
> build ( dataset, path ) ;
> }
> directory = FSDirectory.open(path);
> } else {
> directory = new RAMDirectory();
> }
>
> http://svn.apache.org/repos/asf/incubator/jena/Jena2/LARQ/tags/jena-larq-1.0
> .0-incubating/src/main/java/org/apache/jena/larq/assembler/AssemblerLARQ.jav
> a
>
>> Your reply and Venkat's seemed different regarding this.
>
> This is because things have been improved since the latest release.
>
> Paolo
>
>> Thanks
>> Tao
>>
>> -----Original Message-----
>> From: Paolo Castagna [mailto:castagna.lists@googlemail.com]
>> Sent: Wednesday, April 25, 2012 6:51 PM
>> To: jena-users@incubator.apache.org
>> Subject: Re: [ANN] Release of Apache Jena LARQ 1.0.0-incubating
>>
>> Hi Tao
>>
>> Tao(陶信东) wrote:
>>> Hi Paolo,
>>>
>>> This is great! I've been waiting for it since several weeks ago.
>> Good to know.
>>
>>> However, after I configured Fuseki for it by adding LARQ to my class
>>> path and the following lines to the assembly file, pf:textMatch
>>> doesn't work (the usual sparql query works).
>>>
>>> <#dataset> rdf:type tdb:DatasetTDB ;
>>> tdb:location "/path/to/my/tdb/indexes/" ;
>>> ja:textIndex "/path/to/lucene/index/" ;
>>> .
>>>
>>> Is Fuseki supported by this LARQ release?
>> Fuseki does not include LARQ.
>>
>> For more details, please, see also:
>> https://issues.apache.org/jira/browse/JENA-63
>> https://issues.apache.org/jira/browse/JENA-164
>>
>> The good news is that it is extremely easy to check out Fuseki
>> sources, patch the pom.xml file and repackage it (i.e. mvn package). See:
>> https://issues.apache.org/jira/secure/attachment/12504042/JENA-63_Fuse
>> ki_r12
>> 03107.patch
>> (be warned, that patch might not be up-to-date, but you see it's just
>> a new dependency on LARQ).
>>
>>> Or should I build the lucene index
>>> by myself when Fuseki started?
>> No, you do not need that.
>>
>> 1. Checkout Fuseki source code.
>> 2. Add LARQ dependency to the Fuseki pom.xml file 3. mvn package
>>
>> Let me know how it goes and if you have problems.
>>
>> Cheers,
>> Paolo
>>
>>> Thanks
>>> Tao
>>>
>>> -----Original Message-----
>>> From: Paolo Castagna [mailto:castagna.lists@googlemail.com]
>>> Sent: Tuesday, April 24, 2012 5:43 AM
>>> To: jena-users@incubator.apache.org
>>> Subject: [ANN] Release of Apache Jena LARQ 1.0.0-incubating
>>>
>>> LARQ 1.0.0-incubating has been released, this is the first release of
>>> LARQ as separate module and under the Apache License.
>>>
>>> LARQ is a combination of ARQ and Lucene aimed at providing developers
>>> with the ability to perform free text searches within their SPARQL
>> queries.
>>> Documentation for LARQ is available here:
>>>
>>> - http://incubator.apache.org/jena/documentation/larq/
>>> - http://incubator.apache.org/jena/documentation/javadoc/larq/
>>>
>>>
>>> == Mailing lists
>>>
>>> The user mailing list for Jena is jena-users@incubator.apache.org
>>> Send email to jena-users-subscribe@incubator.apache.org to subscribe.
>>>
>>> See also:
>>> http://incubator.apache.org/jena/help_and_support/index.html
>>>
>>>
>>> == About This Release
>>>
>>> The main new feature in this release is support for updating the
>>> Lucene index as RDF statements are added/removed to the Jena Model
>>> via the Jena APIs.
>>> Moreover, LARQ now depends on Apache Lucene 3.5.0.
>>>
>>>
>>> == Download
>>>
>>> Maven artifacts are here:
>>> http://repo1.maven.org/maven2/org/apache/jena/jena-larq/1.0.0-incubat
>>> i
>>> ng/
>>>
>>> Source release is here:
>>> http://www.apache.org/dyn/closer.cgi/incubator/jena/jena-larq-1.0.0-i
>>> n
>>> cubati
>>> ng
>>>
>>>
>>> == Status
>>>
>>> Apache Jena is an effort undergoing incubation at the Apache Software
>>> Foundation (ASF), sponsored by the Apache Incubator PMC.
>>>
>>> Incubation is required of all newly accepted projects until a further
>>> review indicates that the infrastructure, communications, and
>>> decision making process have stabilized in a manner consistent with
>>> other successful ASF projects.
>>>
>>> While incubation status is not necessarily a reflection of the
>>> completeness or stability of the code, it does indicate that the
>>> project has yet to be fully endorsed by the ASF.
>>>
>>> For more information about the incubation status of the Jena project
>>> you can go to the following page:
>>> http://incubator.apache.org/projects/jena.html
>>>
>
RE: [ANN] Release of Apache Jena LARQ 1.0.0-incubating
Posted by "Tao (陶信东)" <ta...@myhexin.com>.
Thanks Paolo. Now I can find the lucene files. But pf:textMatch still
doesn't seem to work. See details below.
select * where {?s rdfs:label ?o} limit 10
----------------------------------------------------------------------------
-
| s | o
|
============================================================================
=
| <http://xmlns.com/foaf/0.1/LabelProperty> | "Label Property"
|
| <http://xmlns.com/foaf/0.1/Person> | "Person"
|
| <http://www.w3.org/2000/10/swap/pim/contact#Person> | "Person"
|
| <http://www.w3.org/2003/01/geo/wgs84_pos#SpatialThing> | "Spatial Thing"
|
| <http://xmlns.com/foaf/0.1/Document> | "Document"
|
| <http://xmlns.com/foaf/0.1/Organization> | "Organization"
|
| <http://xmlns.com/foaf/0.1/Group> | "Group"
|
| <http://xmlns.com/foaf/0.1/Agent> | "Agent"
|
| <http://xmlns.com/foaf/0.1/Project> | "Project"
|
| <http://xmlns.com/foaf/0.1/Image> | "Image"
|
----------------------------------------------------------------------------
-
prefix pf: <http://jena.hpl.hp.com/ARQ/property#>
select * where {?s pf:textMatch "+Label"} limit 10
-----
| s |
=====
-----
-----Original Message-----
From: Paolo Castagna [mailto:castagna.lists@googlemail.com]
Sent: Thursday, April 26, 2012 10:26 PM
To: jena-users@incubator.apache.org
Subject: Re: [ANN] Release of Apache Jena LARQ 1.0.0-incubating
Tao (陶信东) wrote:
> Thanks Paolo, I'll try that.
>
> Meanwhile, would you please clarify whether Fuseki will build LARQ
> index automatically, after the patch?
Yes, if the directory does not exist LARQ will create it and build the
Lucene index automatically, if a directory exists a Lucene index will be
opened pointing to that directory (however, if the directory exists and it's
empty, you'll have an empty Lucene index as result):
if ( indexPath != null )
{
File path = new File(indexPath) ;
if ( !path.exists() )
{
log.debug("Directory {} does not exist, building Lucene
index...") ;
path.mkdirs() ;
build ( dataset, path ) ;
}
directory = FSDirectory.open(path);
} else {
directory = new RAMDirectory();
}
http://svn.apache.org/repos/asf/incubator/jena/Jena2/LARQ/tags/jena-larq-1.0
.0-incubating/src/main/java/org/apache/jena/larq/assembler/AssemblerLARQ.jav
a
> Your reply and Venkat's seemed different regarding this.
This is because things have been improved since the latest release.
Paolo
>
> Thanks
> Tao
>
> -----Original Message-----
> From: Paolo Castagna [mailto:castagna.lists@googlemail.com]
> Sent: Wednesday, April 25, 2012 6:51 PM
> To: jena-users@incubator.apache.org
> Subject: Re: [ANN] Release of Apache Jena LARQ 1.0.0-incubating
>
> Hi Tao
>
> Tao(陶信东) wrote:
>> Hi Paolo,
>>
>> This is great! I've been waiting for it since several weeks ago.
>
> Good to know.
>
>> However, after I configured Fuseki for it by adding LARQ to my class
>> path and the following lines to the assembly file, pf:textMatch
>> doesn't work (the usual sparql query works).
>>
>> <#dataset> rdf:type tdb:DatasetTDB ;
>> tdb:location "/path/to/my/tdb/indexes/" ;
>> ja:textIndex "/path/to/lucene/index/" ;
>> .
>>
>> Is Fuseki supported by this LARQ release?
>
> Fuseki does not include LARQ.
>
> For more details, please, see also:
> https://issues.apache.org/jira/browse/JENA-63
> https://issues.apache.org/jira/browse/JENA-164
>
> The good news is that it is extremely easy to check out Fuseki
> sources, patch the pom.xml file and repackage it (i.e. mvn package). See:
> https://issues.apache.org/jira/secure/attachment/12504042/JENA-63_Fuse
> ki_r12
> 03107.patch
> (be warned, that patch might not be up-to-date, but you see it's just
> a new dependency on LARQ).
>
>> Or should I build the lucene index
>> by myself when Fuseki started?
>
> No, you do not need that.
>
> 1. Checkout Fuseki source code.
> 2. Add LARQ dependency to the Fuseki pom.xml file 3. mvn package
>
> Let me know how it goes and if you have problems.
>
> Cheers,
> Paolo
>
>> Thanks
>> Tao
>>
>> -----Original Message-----
>> From: Paolo Castagna [mailto:castagna.lists@googlemail.com]
>> Sent: Tuesday, April 24, 2012 5:43 AM
>> To: jena-users@incubator.apache.org
>> Subject: [ANN] Release of Apache Jena LARQ 1.0.0-incubating
>>
>> LARQ 1.0.0-incubating has been released, this is the first release of
>> LARQ as separate module and under the Apache License.
>>
>> LARQ is a combination of ARQ and Lucene aimed at providing developers
>> with the ability to perform free text searches within their SPARQL
> queries.
>> Documentation for LARQ is available here:
>>
>> - http://incubator.apache.org/jena/documentation/larq/
>> - http://incubator.apache.org/jena/documentation/javadoc/larq/
>>
>>
>> == Mailing lists
>>
>> The user mailing list for Jena is jena-users@incubator.apache.org
>> Send email to jena-users-subscribe@incubator.apache.org to subscribe.
>>
>> See also:
>> http://incubator.apache.org/jena/help_and_support/index.html
>>
>>
>> == About This Release
>>
>> The main new feature in this release is support for updating the
>> Lucene index as RDF statements are added/removed to the Jena Model
>> via the Jena APIs.
>> Moreover, LARQ now depends on Apache Lucene 3.5.0.
>>
>>
>> == Download
>>
>> Maven artifacts are here:
>> http://repo1.maven.org/maven2/org/apache/jena/jena-larq/1.0.0-incubat
>> i
>> ng/
>>
>> Source release is here:
>> http://www.apache.org/dyn/closer.cgi/incubator/jena/jena-larq-1.0.0-i
>> n
>> cubati
>> ng
>>
>>
>> == Status
>>
>> Apache Jena is an effort undergoing incubation at the Apache Software
>> Foundation (ASF), sponsored by the Apache Incubator PMC.
>>
>> Incubation is required of all newly accepted projects until a further
>> review indicates that the infrastructure, communications, and
>> decision making process have stabilized in a manner consistent with
>> other successful ASF projects.
>>
>> While incubation status is not necessarily a reflection of the
>> completeness or stability of the code, it does indicate that the
>> project has yet to be fully endorsed by the ASF.
>>
>> For more information about the incubation status of the Jena project
>> you can go to the following page:
>> http://incubator.apache.org/projects/jena.html
>>
>
Re: [ANN] Release of Apache Jena LARQ 1.0.0-incubating
Posted by Paolo Castagna <ca...@googlemail.com>.
Tao (陶信东) wrote:
> Thanks Paolo, I'll try that.
>
> Meanwhile, would you please clarify whether Fuseki will build LARQ index
> automatically, after the patch?
Yes, if the directory does not exist LARQ will create it and build the Lucene
index automatically, if a directory exists a Lucene index will be opened
pointing to that directory (however, if the directory exists and it's empty,
you'll have an empty Lucene index as result):
if ( indexPath != null )
{
File path = new File(indexPath) ;
if ( !path.exists() )
{
log.debug("Directory {} does not exist, building Lucene index...") ;
path.mkdirs() ;
build ( dataset, path ) ;
}
directory = FSDirectory.open(path);
} else {
directory = new RAMDirectory();
}
http://svn.apache.org/repos/asf/incubator/jena/Jena2/LARQ/tags/jena-larq-1.0.0-incubating/src/main/java/org/apache/jena/larq/assembler/AssemblerLARQ.java
> Your reply and Venkat's seemed different regarding this.
This is because things have been improved since the latest release.
Paolo
>
> Thanks
> Tao
>
> -----Original Message-----
> From: Paolo Castagna [mailto:castagna.lists@googlemail.com]
> Sent: Wednesday, April 25, 2012 6:51 PM
> To: jena-users@incubator.apache.org
> Subject: Re: [ANN] Release of Apache Jena LARQ 1.0.0-incubating
>
> Hi Tao
>
> Tao(陶信东) wrote:
>> Hi Paolo,
>>
>> This is great! I've been waiting for it since several weeks ago.
>
> Good to know.
>
>> However, after I configured Fuseki for it by adding LARQ to my class
>> path and the following lines to the assembly file, pf:textMatch
>> doesn't work (the usual sparql query works).
>>
>> <#dataset> rdf:type tdb:DatasetTDB ;
>> tdb:location "/path/to/my/tdb/indexes/" ;
>> ja:textIndex "/path/to/lucene/index/" ;
>> .
>>
>> Is Fuseki supported by this LARQ release?
>
> Fuseki does not include LARQ.
>
> For more details, please, see also:
> https://issues.apache.org/jira/browse/JENA-63
> https://issues.apache.org/jira/browse/JENA-164
>
> The good news is that it is extremely easy to check out Fuseki sources,
> patch the pom.xml file and repackage it (i.e. mvn package). See:
> https://issues.apache.org/jira/secure/attachment/12504042/JENA-63_Fuseki_r12
> 03107.patch
> (be warned, that patch might not be up-to-date, but you see it's just a new
> dependency on LARQ).
>
>> Or should I build the lucene index
>> by myself when Fuseki started?
>
> No, you do not need that.
>
> 1. Checkout Fuseki source code.
> 2. Add LARQ dependency to the Fuseki pom.xml file 3. mvn package
>
> Let me know how it goes and if you have problems.
>
> Cheers,
> Paolo
>
>> Thanks
>> Tao
>>
>> -----Original Message-----
>> From: Paolo Castagna [mailto:castagna.lists@googlemail.com]
>> Sent: Tuesday, April 24, 2012 5:43 AM
>> To: jena-users@incubator.apache.org
>> Subject: [ANN] Release of Apache Jena LARQ 1.0.0-incubating
>>
>> LARQ 1.0.0-incubating has been released, this is the first release of
>> LARQ as separate module and under the Apache License.
>>
>> LARQ is a combination of ARQ and Lucene aimed at providing developers
>> with the ability to perform free text searches within their SPARQL
> queries.
>> Documentation for LARQ is available here:
>>
>> - http://incubator.apache.org/jena/documentation/larq/
>> - http://incubator.apache.org/jena/documentation/javadoc/larq/
>>
>>
>> == Mailing lists
>>
>> The user mailing list for Jena is jena-users@incubator.apache.org
>> Send email to jena-users-subscribe@incubator.apache.org to subscribe.
>>
>> See also:
>> http://incubator.apache.org/jena/help_and_support/index.html
>>
>>
>> == About This Release
>>
>> The main new feature in this release is support for updating the
>> Lucene index as RDF statements are added/removed to the Jena Model via
>> the Jena APIs.
>> Moreover, LARQ now depends on Apache Lucene 3.5.0.
>>
>>
>> == Download
>>
>> Maven artifacts are here:
>> http://repo1.maven.org/maven2/org/apache/jena/jena-larq/1.0.0-incubati
>> ng/
>>
>> Source release is here:
>> http://www.apache.org/dyn/closer.cgi/incubator/jena/jena-larq-1.0.0-in
>> cubati
>> ng
>>
>>
>> == Status
>>
>> Apache Jena is an effort undergoing incubation at the Apache Software
>> Foundation (ASF), sponsored by the Apache Incubator PMC.
>>
>> Incubation is required of all newly accepted projects until a further
>> review indicates that the infrastructure, communications, and decision
>> making process have stabilized in a manner consistent with other
>> successful ASF projects.
>>
>> While incubation status is not necessarily a reflection of the
>> completeness or stability of the code, it does indicate that the
>> project has yet to be fully endorsed by the ASF.
>>
>> For more information about the incubation status of the Jena project
>> you can go to the following page:
>> http://incubator.apache.org/projects/jena.html
>>
>
RE: [ANN] Release of Apache Jena LARQ 1.0.0-incubating
Posted by "Tao (陶信东)" <ta...@myhexin.com>.
Thanks Paolo, I'll try that.
Meanwhile, would you please clarify whether Fuseki will build LARQ index
automatically, after the patch? Your reply and Venkat's seemed different
regarding this.
Thanks
Tao
-----Original Message-----
From: Paolo Castagna [mailto:castagna.lists@googlemail.com]
Sent: Wednesday, April 25, 2012 6:51 PM
To: jena-users@incubator.apache.org
Subject: Re: [ANN] Release of Apache Jena LARQ 1.0.0-incubating
Hi Tao
Tao(陶信东) wrote:
> Hi Paolo,
>
> This is great! I've been waiting for it since several weeks ago.
Good to know.
> However, after I configured Fuseki for it by adding LARQ to my class
> path and the following lines to the assembly file, pf:textMatch
> doesn't work (the usual sparql query works).
>
> <#dataset> rdf:type tdb:DatasetTDB ;
> tdb:location "/path/to/my/tdb/indexes/" ;
> ja:textIndex "/path/to/lucene/index/" ;
> .
>
> Is Fuseki supported by this LARQ release?
Fuseki does not include LARQ.
For more details, please, see also:
https://issues.apache.org/jira/browse/JENA-63
https://issues.apache.org/jira/browse/JENA-164
The good news is that it is extremely easy to check out Fuseki sources,
patch the pom.xml file and repackage it (i.e. mvn package). See:
https://issues.apache.org/jira/secure/attachment/12504042/JENA-63_Fuseki_r12
03107.patch
(be warned, that patch might not be up-to-date, but you see it's just a new
dependency on LARQ).
> Or should I build the lucene index
> by myself when Fuseki started?
No, you do not need that.
1. Checkout Fuseki source code.
2. Add LARQ dependency to the Fuseki pom.xml file 3. mvn package
Let me know how it goes and if you have problems.
Cheers,
Paolo
>
> Thanks
> Tao
>
> -----Original Message-----
> From: Paolo Castagna [mailto:castagna.lists@googlemail.com]
> Sent: Tuesday, April 24, 2012 5:43 AM
> To: jena-users@incubator.apache.org
> Subject: [ANN] Release of Apache Jena LARQ 1.0.0-incubating
>
> LARQ 1.0.0-incubating has been released, this is the first release of
> LARQ as separate module and under the Apache License.
>
> LARQ is a combination of ARQ and Lucene aimed at providing developers
> with the ability to perform free text searches within their SPARQL
queries.
>
> Documentation for LARQ is available here:
>
> - http://incubator.apache.org/jena/documentation/larq/
> - http://incubator.apache.org/jena/documentation/javadoc/larq/
>
>
> == Mailing lists
>
> The user mailing list for Jena is jena-users@incubator.apache.org
> Send email to jena-users-subscribe@incubator.apache.org to subscribe.
>
> See also:
> http://incubator.apache.org/jena/help_and_support/index.html
>
>
> == About This Release
>
> The main new feature in this release is support for updating the
> Lucene index as RDF statements are added/removed to the Jena Model via
> the Jena APIs.
> Moreover, LARQ now depends on Apache Lucene 3.5.0.
>
>
> == Download
>
> Maven artifacts are here:
> http://repo1.maven.org/maven2/org/apache/jena/jena-larq/1.0.0-incubati
> ng/
>
> Source release is here:
> http://www.apache.org/dyn/closer.cgi/incubator/jena/jena-larq-1.0.0-in
> cubati
> ng
>
>
> == Status
>
> Apache Jena is an effort undergoing incubation at the Apache Software
> Foundation (ASF), sponsored by the Apache Incubator PMC.
>
> Incubation is required of all newly accepted projects until a further
> review indicates that the infrastructure, communications, and decision
> making process have stabilized in a manner consistent with other
> successful ASF projects.
>
> While incubation status is not necessarily a reflection of the
> completeness or stability of the code, it does indicate that the
> project has yet to be fully endorsed by the ASF.
>
> For more information about the incubation status of the Jena project
> you can go to the following page:
> http://incubator.apache.org/projects/jena.html
>
Re: [ANN] Release of Apache Jena LARQ 1.0.0-incubating
Posted by Paolo Castagna <ca...@googlemail.com>.
Hi Tao
Tao(陶信东) wrote:
> Hi Paolo,
>
> This is great! I've been waiting for it since several weeks ago.
Good to know.
> However, after I configured Fuseki for it by adding LARQ to my class path
> and the following lines to the assembly file, pf:textMatch doesn't work (the
> usual sparql query works).
>
> <#dataset> rdf:type tdb:DatasetTDB ;
> tdb:location "/path/to/my/tdb/indexes/" ;
> ja:textIndex "/path/to/lucene/index/" ;
> .
>
> Is Fuseki supported by this LARQ release?
Fuseki does not include LARQ.
For more details, please, see also:
https://issues.apache.org/jira/browse/JENA-63
https://issues.apache.org/jira/browse/JENA-164
The good news is that it is extremely easy to check out Fuseki sources,
patch the pom.xml file and repackage it (i.e. mvn package). See:
https://issues.apache.org/jira/secure/attachment/12504042/JENA-63_Fuseki_r1203107.patch
(be warned, that patch might not be up-to-date, but you see it's just a new
dependency on LARQ).
> Or should I build the lucene index
> by myself when Fuseki started?
No, you do not need that.
1. Checkout Fuseki source code.
2. Add LARQ dependency to the Fuseki pom.xml file
3. mvn package
Let me know how it goes and if you have problems.
Cheers,
Paolo
>
> Thanks
> Tao
>
> -----Original Message-----
> From: Paolo Castagna [mailto:castagna.lists@googlemail.com]
> Sent: Tuesday, April 24, 2012 5:43 AM
> To: jena-users@incubator.apache.org
> Subject: [ANN] Release of Apache Jena LARQ 1.0.0-incubating
>
> LARQ 1.0.0-incubating has been released, this is the first release of LARQ
> as separate module and under the Apache License.
>
> LARQ is a combination of ARQ and Lucene aimed at providing developers with
> the ability to perform free text searches within their SPARQL queries.
>
> Documentation for LARQ is available here:
>
> - http://incubator.apache.org/jena/documentation/larq/
> - http://incubator.apache.org/jena/documentation/javadoc/larq/
>
>
> == Mailing lists
>
> The user mailing list for Jena is jena-users@incubator.apache.org Send
> email to jena-users-subscribe@incubator.apache.org to subscribe.
>
> See also:
> http://incubator.apache.org/jena/help_and_support/index.html
>
>
> == About This Release
>
> The main new feature in this release is support for updating the Lucene
> index as RDF statements are added/removed to the Jena Model via the Jena
> APIs.
> Moreover, LARQ now depends on Apache Lucene 3.5.0.
>
>
> == Download
>
> Maven artifacts are here:
> http://repo1.maven.org/maven2/org/apache/jena/jena-larq/1.0.0-incubating/
>
> Source release is here:
> http://www.apache.org/dyn/closer.cgi/incubator/jena/jena-larq-1.0.0-incubati
> ng
>
>
> == Status
>
> Apache Jena is an effort undergoing incubation at the Apache Software
> Foundation (ASF), sponsored by the Apache Incubator PMC.
>
> Incubation is required of all newly accepted projects until a further review
> indicates that the infrastructure, communications, and decision making
> process have stabilized in a manner consistent with other successful ASF
> projects.
>
> While incubation status is not necessarily a reflection of the completeness
> or stability of the code, it does indicate that the project has yet to be
> fully endorsed by the ASF.
>
> For more information about the incubation status of the Jena project you can
> go to the following page:
> http://incubator.apache.org/projects/jena.html
>
RE: [ANN] Release of Apache Jena LARQ 1.0.0-incubating
Posted by "Tao (陶信东)" <ta...@myhexin.com>.
Hi Paolo,
This is great! I've been waiting for it since several weeks ago.
However, after I configured Fuseki for it by adding LARQ to my class path
and the following lines to the assembly file, pf:textMatch doesn't work (the
usual sparql query works).
<#dataset> rdf:type tdb:DatasetTDB ;
tdb:location "/path/to/my/tdb/indexes/" ;
ja:textIndex "/path/to/lucene/index/" ;
.
Is Fuseki supported by this LARQ release? Or should I build the lucene index
by myself when Fuseki started?
Thanks
Tao
-----Original Message-----
From: Paolo Castagna [mailto:castagna.lists@googlemail.com]
Sent: Tuesday, April 24, 2012 5:43 AM
To: jena-users@incubator.apache.org
Subject: [ANN] Release of Apache Jena LARQ 1.0.0-incubating
LARQ 1.0.0-incubating has been released, this is the first release of LARQ
as separate module and under the Apache License.
LARQ is a combination of ARQ and Lucene aimed at providing developers with
the ability to perform free text searches within their SPARQL queries.
Documentation for LARQ is available here:
- http://incubator.apache.org/jena/documentation/larq/
- http://incubator.apache.org/jena/documentation/javadoc/larq/
== Mailing lists
The user mailing list for Jena is jena-users@incubator.apache.org Send
email to jena-users-subscribe@incubator.apache.org to subscribe.
See also:
http://incubator.apache.org/jena/help_and_support/index.html
== About This Release
The main new feature in this release is support for updating the Lucene
index as RDF statements are added/removed to the Jena Model via the Jena
APIs.
Moreover, LARQ now depends on Apache Lucene 3.5.0.
== Download
Maven artifacts are here:
http://repo1.maven.org/maven2/org/apache/jena/jena-larq/1.0.0-incubating/
Source release is here:
http://www.apache.org/dyn/closer.cgi/incubator/jena/jena-larq-1.0.0-incubati
ng
== Status
Apache Jena is an effort undergoing incubation at the Apache Software
Foundation (ASF), sponsored by the Apache Incubator PMC.
Incubation is required of all newly accepted projects until a further review
indicates that the infrastructure, communications, and decision making
process have stabilized in a manner consistent with other successful ASF
projects.
While incubation status is not necessarily a reflection of the completeness
or stability of the code, it does indicate that the project has yet to be
fully endorsed by the ASF.
For more information about the incubation status of the Jena project you can
go to the following page:
http://incubator.apache.org/projects/jena.html
Re: LARQ usage, dependencies
Posted by Paolo Castagna <ca...@googlemail.com>.
Hi Peter,
the issue JENA-63 had an old patch (and the issue was closed as 'Won't Fix').
It's not possible to attach a patch to a closed issue, so I quickly reopened,
deleted the old patch and attached a new one.
Please, could you try this and let me know if you have problems?
https://issues.apache.org/jira/secure/attachment/12525638/JENA-63-Fuseki-r1334045.patch
You do not need to checkout and/or repackage LARQ, just Fuseki.
Once you have LARQ added to Fuseki you'll find larq.larqbuilder in the Fuseki
jar (which has all the dependencies in it, including Jena, ARQ, TDB and LARQ).
If you use LARQ with Fuseki, please, be aware of JENA-164
https://issues.apache.org/jira/browse/JENA-164
... and if you want to help closing it, you are welcome. ;-)
If you want to help documenting what you are doing with a short section to be
added to the LARQ documentation, that would be great as well. It's trivial, but
it can save time to people. Mainly, checkout Fuseki, apply the patch (i.e. add
LARQ dependency to Fuseki's pom.xml), mvn package it. Then show how to use
larq.larqbuilder to create a new Lucene index, indexing some data from a TDB
location.
Paolo
Peter Jungen wrote:
> Hello everybody,
>
> Im trying to
> -add larq to fuseki,
> -then from command line, build an lucene index for my dataset.
>
> ..using jena-fuseki-0.2.2-incubating-20120329.050912-8-distribution
> and TDB 0.8.10.
>
> Installed larq and fuseki via svn and maven, and added the patch to
> fuseki like so
> https://issues.apache.org/jira/browse/JENA-63?focusedCommentId=13151908&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13151908
>
> on the fuseki package build (mvn clean package) an error occurs:
> ----start----
> Caused by:
> org.apache.maven.artifact.resolver.MultipleArtifactsNotFoundException:
> Missing:
> 1) org.apache.jena:jena-larq:jar:${ver.larq}
> ..
> Path to dependency:
> 1) org.apache.jena:jena-fuseki:jar:0.2.2-incubating-SNAPSHOT
> 2) org.apache.jena:jena-larq:jar:${ver.larq}
> ----end----
> How do I resolve this?
> While Im asking about dependencies....
>
> I packaged LARQ with
> mvn package
> The README in the larq folder instructs me to
> ------start-----
> To package LARQ and use the larq.larqbuilder and larq.larq commands run:
>
> mvn package -Pjar-with-dependencies
> ----end--
> I not sure how to use this Option (-P,--activate-profiles)? and give the
> dependencies..
>
> When in the end hopefuly everything works, I hope this to build the
> index for my dataset..
> java -cp .:target/jena-larq-1.0.1-incubating-SNAPSHOT.jar
> larq.larqbuilder --larq=/home/peter/workspace/fuseki/larq-index
> --desc=/home/peter/workspace/fuseki/config-tdb.ttl
> Am I doing this right?
>
> Regards
> Peter
RE: LARQ usage, dependencies
Posted by "Tao (陶信东)" <ta...@myhexin.com>.
Hi Paolo,
One of our index guys is working on expanding LARQ to meet our own
requirements. However, I'm not sure how to assemble it with Fuseki when he
finished. Can you suggest how?
Thanks
Tao
-----Original Message-----
From: Paolo Castagna [mailto:castagna.lists@googlemail.com]
Sent: Tuesday, May 08, 2012 8:43 PM
To: users@jena.apache.org
Subject: Re: LARQ usage, dependencies
Hi Peter
Peter Jungen wrote:
> Hello Paolo,
>
> The problem was with maven, I knocked down
> ~/.m2/repository/org/apache/jena/jena-larq/ and that solved the problem.
> I also started maven anew from scratch on another system, and ran into
> no troubles there.
> Thank you a lot for your support, Paolo!
> Im on the the road for the next days, but after that Ill put together
> a step by step of how to do it right from maven to larq, so it might
> help the next guy along.
I am happy you found the problem and that now it works for you as well.
Paolo
>
> Regards
> Peter
Re: LARQ usage, dependencies
Posted by Paolo Castagna <ca...@googlemail.com>.
Hi Peter
Peter Jungen wrote:
> Hello Paolo,
>
> The problem was with maven, I knocked down
> ~/.m2/repository/org/apache/jena/jena-larq/ and that solved the problem.
> I also started maven anew from scratch on another system, and ran into
> no troubles there.
> Thank you a lot for your support, Paolo!
> Im on the the road for the next days, but after that Ill put together a
> step by step of how to do it right from maven to larq, so it might help
> the next guy along.
I am happy you found the problem and that now it works for you as well.
Paolo
>
> Regards
> Peter
Re: LARQ usage, dependencies
Posted by Peter Jungen <el...@gmx.de>.
Hello Paolo,
The problem was with maven, I knocked down
~/.m2/repository/org/apache/jena/jena-larq/ and that solved the problem.
I also started maven anew from scratch on another system, and ran into
no troubles there.
Thank you a lot for your support, Paolo!
Im on the the road for the next days, but after that Ill put together a
step by step of how to do it right from maven to larq, so it might help
the next guy along.
Regards
Peter
Re: LARQ usage, dependencies
Posted by Paolo Castagna <ca...@googlemail.com>.
Hi Peter
Peter Jungen wrote:
>> In the output of mvn dependency:tree do you see the following two lines?
>>
>> [INFO] +- org.apache.jena:jena-larq:jar:1.0.0-incubating:compile
>> [INFO] | \- org.apache.lucene:lucene-core:jar:3.5.0:compile
> Just the first line, lucene is still missing. The complete output of
> dependency:tree http://pastebin.com/nhGKyEdF
I do not know how this can happen... LARQ's pom.xml [1] has definitely
a dependency on Lucene 3.5.0:
<properties>
<ver.lucene>3.5.0</ver.lucene>
...
</properties>
<dependency>
<groupId>org.apache.lucene</groupId>
<artifactId>lucene-core</artifactId>
<version>${ver.lucene}</version>
</dependency>
[1]
http://repo1.maven.org/maven2/org/apache/jena/jena-larq/1.0.0-incubating/jena-larq-1.0.0-incubating.pom
Perhaps, you could try to clean your local Maven repository for jena-larq
and see if that helps:
rm -rf ~/.m2/repository/org/apache/jena/jena-larq/
>> Another check, after you run:
>> mvn package
>> Please, double check if the Directory.class is in your Fuseki jar, running:
>> jar -ft target/jena-fuseki-0.2.2-incubating-SNAPSHOT-server.jar | grep Directory
> Two results:
> org/apache/html/dom/HTMLDirectoryElementImpl.class
> org/w3c/dom/html/HTMLDirectoryElement.class
>> org/apache/lucene/store/Directory.class
> is not included.
Yep, this is consistent with the fact that Lucene somehow is not included
in the dependency, but it should since it's a transitive dependency included
as you depend on LARQ.
I am using Maven 3.0.4, which version of Maven are you using? (trying to think
what could go wrong on your side, but I am running out of ideas here).
Paolo
>
> Regards
> Peter
Re: LARQ usage, dependencies
Posted by Peter Jungen <el...@gmx.de>.
Hi Paolo,
> svn co https://svn.apache.org/repos/asf/jena/Jena2/Fuseki/trunk/ fuseki
> cd fuseki
> wget https://issues.apache.org/jira/secure/attachment/12525638/JENA-63-Fuseki-r1334045.patch
> patch -p0 < JENA-63-Fuseki-r1334045.patch
> mvn dependency:tree
>
> In the output of mvn dependency:tree do you see the following two lines?
>
> [INFO] +- org.apache.jena:jena-larq:jar:1.0.0-incubating:compile
> [INFO] | \- org.apache.lucene:lucene-core:jar:3.5.0:compile
Just the first line, lucene is still missing. The complete output of
dependency:tree http://pastebin.com/nhGKyEdF
> Another check, after you run:
> mvn package
> Please, double check if the Directory.class is in your Fuseki jar, running:
> jar -ft target/jena-fuseki-0.2.2-incubating-SNAPSHOT-server.jar | grep Directory
Two results:
org/apache/html/dom/HTMLDirectoryElementImpl.class
org/w3c/dom/html/HTMLDirectoryElement.class
> org/apache/lucene/store/Directory.class
is not included.
Regards
Peter
Re: LARQ usage, dependencies
Posted by Paolo Castagna <ca...@googlemail.com>.
Hi Peter
Peter Jungen wrote:
> I'm sorry, this exact steps lead me to the same error as before, when
> running larq I print it in full:
> -----------
> Get Exception in thread "main" java.lang.NoClassDefFoundError:
> org/apache/lucene/store/Directory
> at larq.larqbuilder.<init>(larqbuilder.java:40)
> at larq.larqbuilder.main(larqbuilder.java:50)
> Caused by: java.lang.ClassNotFoundException:
> org.apache.lucene.store.Directory
> at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
> -----------
> The packaging was successful, but the class seems not to be available
> during runtime by some reason..
I do not really know how to think and what could be different.
Please, try this:
svn co https://svn.apache.org/repos/asf/jena/Jena2/Fuseki/trunk/ fuseki
cd fuseki
wget https://issues.apache.org/jira/secure/attachment/12525638/JENA-63-Fuseki-r1334045.patch
patch -p0 < JENA-63-Fuseki-r1334045.patch
mvn dependency:tree
In the output of mvn dependency:tree do you see the following two lines?
[INFO] +- org.apache.jena:jena-larq:jar:1.0.0-incubating:compile
[INFO] | \- org.apache.lucene:lucene-core:jar:3.5.0:compile
Another check, after you run:
mvn package
Please, double check if the Directory.class is in your Fuseki jar, running:
jar -ft target/jena-fuseki-0.2.2-incubating-SNAPSHOT-server.jar | grep Directory
I see:
org/apache/lucene/store/Directory.class
and, again, I see no error when running:
java -cp target/jena-fuseki-0.2.2-incubating-SNAPSHOT-server.jar larq.larqbuilder --help
Paolo
Re: LARQ usage, dependencies
Posted by Peter Jungen <el...@gmx.de>.
Am 07.05.2012 09:45, schrieb Paolo Castagna:
> Hi Peter
>
> Peter Jungen wrote:
>> The build goes smooth but then, but running
>>
>> java -cp fuseki-server.jar larq.larqbuilder [..]
>>
>> throws an exception java.lang.NoClassDefFoundError
>>
>> There seems to be an dependency problem, the patch, adds lucene 3.5.0
>> to the .classpath file, while the repository loads lucene 3.6.0 as
>> included in fuseki; then there is a classpath to
>> lucene-core-3.6.0-sources.jar and
>> jena-larq-1.0.0-incubating-sources.jar, but no file on the repository.
>
> Here is what I do:
>
> svn co https://svn.apache.org/repos/asf/incubator/jena/Jena2/Fuseki/trunk/ fuseki
> cd fuseki/
> wget https://issues.apache.org/jira/secure/attachment/12525638/JENA-63-Fuseki-r1334045.patch
> patch -p0 < JENA-63-Fuseki-r1334045.patch
> mvn package
> java -cp target/jena-fuseki-0.2.2-incubating-SNAPSHOT-server.jar larq.larqbuilder --help
>
>
> larqbuilder --larq DIR [--subjects] [--allow-duplicates] --data RDF
> LARQ
> --larq=DIR Index directory
> --subjects Index literals to subject nodes
> --allow-duplicates Don't try to avoid duplicate literals (i.e. faster for bulk indexing)
> Symbol definition
> --set Set a configuration symbol to a value
> --strict Operate in strict SPARQL mode (no extensions of any kind)
> --desc= Assembler description file
> General
> -v --verbose Verbose
> -q --quiet Run with minimal output
> --debug Output information for debugging
> --help
> --version Version information
>
> No problem or NoClassDefFoundError.
>
> Please, can you try the above commands and let me know if you still have problems?
>
> Paolo
>
Hi Paolo,
I'm sorry, this exact steps lead me to the same error as before, when
running larq I print it in full:
-----------
Get Exception in thread "main" java.lang.NoClassDefFoundError:
org/apache/lucene/store/Directory
at larq.larqbuilder.<init>(larqbuilder.java:40)
at larq.larqbuilder.main(larqbuilder.java:50)
Caused by: java.lang.ClassNotFoundException:
org.apache.lucene.store.Directory
at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
-----------
The packaging was successful, but the class seems not to be available
during runtime by some reason..
Regards
Peter
Re: LARQ usage, dependencies
Posted by Paolo Castagna <ca...@googlemail.com>.
Hi Peter
Peter Jungen wrote:
> The build goes smooth but then, but running
>
> java -cp fuseki-server.jar larq.larqbuilder [..]
>
> throws an exception java.lang.NoClassDefFoundError
>
> There seems to be an dependency problem, the patch, adds lucene 3.5.0
> to the .classpath file, while the repository loads lucene 3.6.0 as
> included in fuseki; then there is a classpath to
> lucene-core-3.6.0-sources.jar and
> jena-larq-1.0.0-incubating-sources.jar, but no file on the repository.
Here is what I do:
svn co https://svn.apache.org/repos/asf/incubator/jena/Jena2/Fuseki/trunk/ fuseki
cd fuseki/
wget https://issues.apache.org/jira/secure/attachment/12525638/JENA-63-Fuseki-r1334045.patch
patch -p0 < JENA-63-Fuseki-r1334045.patch
mvn package
java -cp target/jena-fuseki-0.2.2-incubating-SNAPSHOT-server.jar larq.larqbuilder --help
larqbuilder --larq DIR [--subjects] [--allow-duplicates] --data RDF
LARQ
--larq=DIR Index directory
--subjects Index literals to subject nodes
--allow-duplicates Don't try to avoid duplicate literals (i.e. faster for bulk indexing)
Symbol definition
--set Set a configuration symbol to a value
--strict Operate in strict SPARQL mode (no extensions of any kind)
--desc= Assembler description file
General
-v --verbose Verbose
-q --quiet Run with minimal output
--debug Output information for debugging
--help
--version Version information
No problem or NoClassDefFoundError.
Please, can you try the above commands and let me know if you still have problems?
Paolo
Re: LARQ usage, dependencies
Posted by Peter Jungen <el...@gmx.de>.
Am 04.05.2012 14:23, schrieb Peter Jungen:
> Hello everybody,
>
> Im trying to
> -add larq to fuseki,
> -then from command line, build an lucene index for my dataset.
>
> ..using jena-fuseki-0.2.2-incubating-20120329.050912-8-distribution
> and TDB 0.8.10.
>
> Installed larq and fuseki via svn and maven, and added the patch to
> fuseki like so
> https://issues.apache.org/jira/browse/JENA-63?focusedCommentId=13151908&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13151908
>
> on the fuseki package build (mvn clean package) an error occurs:
> ----start----
> Caused by:
> org.apache.maven.artifact.resolver.MultipleArtifactsNotFoundException:
> Missing:
> 1) org.apache.jena:jena-larq:jar:${ver.larq}
> ..
> Path to dependency:
> 1) org.apache.jena:jena-fuseki:jar:0.2.2-incubating-SNAPSHOT
> 2) org.apache.jena:jena-larq:jar:${ver.larq}
> ----end----
> How do I resolve this?
> While Im asking about dependencies....
>
> I packaged LARQ with
> mvn package
> The README in the larq folder instructs me to
> ------start-----
> To package LARQ and use the larq.larqbuilder and larq.larq commands run:
>
> mvn package -Pjar-with-dependencies
> ----end--
> I not sure how to use this Option (-P,--activate-profiles)? and give the
> dependencies..
>
> When in the end hopefuly everything works, I hope this to build the
> index for my dataset..
> java -cp .:target/jena-larq-1.0.1-incubating-SNAPSHOT.jar
> larq.larqbuilder --larq=/home/peter/workspace/fuseki/larq-index
> --desc=/home/peter/workspace/fuseki/config-tdb.ttl
> Am I doing this right?
>
> Regards
> Peter
>
Hello Paolo,
thanks for the insight - and the patch!
I'd like to contribute, as far as I can.
>Mainly, checkout Fuseki, apply the patch (i.e. add
>LARQ dependency to Fuseki's pom.xml), mvn package it. Then show how to
>use larq.larqbuilder to create a new Lucene index, indexing some data
>from a TDB location.
The build goes smooth but then, but running
java -cp fuseki-server.jar larq.larqbuilder [..]
throws an exception java.lang.NoClassDefFoundError
There seems to be an dependency problem, the patch, adds lucene 3.5.0
to the .classpath file, while the repository loads lucene 3.6.0 as
included in fuseki; then there is a classpath to
lucene-core-3.6.0-sources.jar and
jena-larq-1.0.0-incubating-sources.jar, but no file on the repository.
I tried to fix that by adding the jars to the repository, adjusting the
pom.xml and .classpath manually, and package again, but that didnt work
out of course..
Regards
Peter
LARQ usage, dependencies
Posted by Peter Jungen <el...@gmx.de>.
Hello everybody,
Im trying to
-add larq to fuseki,
-then from command line, build an lucene index for my dataset.
..using jena-fuseki-0.2.2-incubating-20120329.050912-8-distribution
and TDB 0.8.10.
Installed larq and fuseki via svn and maven, and added the patch to
fuseki like so
https://issues.apache.org/jira/browse/JENA-63?focusedCommentId=13151908&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13151908
on the fuseki package build (mvn clean package) an error occurs:
----start----
Caused by:
org.apache.maven.artifact.resolver.MultipleArtifactsNotFoundException:
Missing:
1) org.apache.jena:jena-larq:jar:${ver.larq}
..
Path to dependency:
1) org.apache.jena:jena-fuseki:jar:0.2.2-incubating-SNAPSHOT
2) org.apache.jena:jena-larq:jar:${ver.larq}
----end----
How do I resolve this?
While Im asking about dependencies....
I packaged LARQ with
mvn package
The README in the larq folder instructs me to
------start-----
To package LARQ and use the larq.larqbuilder and larq.larq commands run:
mvn package -Pjar-with-dependencies
----end--
I not sure how to use this Option (-P,--activate-profiles)? and give the
dependencies..
When in the end hopefuly everything works, I hope this to build the
index for my dataset..
java -cp .:target/jena-larq-1.0.1-incubating-SNAPSHOT.jar
larq.larqbuilder --larq=/home/peter/workspace/fuseki/larq-index
--desc=/home/peter/workspace/fuseki/config-tdb.ttl
Am I doing this right?
Regards
Peter