You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@jena.apache.org by "Paolo Castagna (Created) (JIRA)" <ji...@apache.org> on 2011/11/11 14:32:51 UTC
[jira] [Created] (JENA-164) LARQ needs to update the Lucene index
when a SPARQL Update request is received
LARQ needs to update the Lucene index when a SPARQL Update request is received
------------------------------------------------------------------------------
Key: JENA-164
URL: https://issues.apache.org/jira/browse/JENA-164
Project: Jena
Issue Type: New Feature
Components: LARQ
Reporter: Paolo Castagna
Assignee: Paolo Castagna
LARQ used not to update the Lucene index as RDF statements were added/removed from a Jena Model.
LARQ is currently extending StatementListener [1] to keep a Lucene index in sync with a Jena Model, however this notification mechanism is not applicable in the case of SPARQL Update requests.
LARQ needs to update the Lucene index when a SPARQL Update request is received.
See also a relevant thread from jena-users mailing list:
- How to be notified of triples added/deleted to/from a Graph? -- http://markmail.org/thread/l4ymug3ujoqifnty
[1] http://svn.apache.org/repos/asf/incubator/jena/Jena2/LARQ/trunk/src/main/java/org/apache/jena/larq/IndexBuilderModel.java
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (JENA-164) LARQ needs to update the Lucene index
when a SPARQL Update request is received
Posted by "Andy Seaborne (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/JENA-164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13198720#comment-13198720 ]
Andy Seaborne commented on JENA-164:
------------------------------------
In context:
This does not trap the TDB bulkloader route. That can be done by being between the parser and the bulk loader (any of them) and still be general purpose, not TDB specific.
> LARQ needs to update the Lucene index when a SPARQL Update request is received
> ------------------------------------------------------------------------------
>
> Key: JENA-164
> URL: https://issues.apache.org/jira/browse/JENA-164
> Project: Jena
> Issue Type: New Feature
> Components: LARQ
> Reporter: Paolo Castagna
> Assignee: Paolo Castagna
> Priority: Minor
> Original Estimate: 96h
> Remaining Estimate: 96h
>
> LARQ used not to update the Lucene index as RDF statements were added/removed from a Jena Model.
> LARQ is currently extending StatementListener [1] to keep a Lucene index in sync with a Jena Model, however this notification mechanism is not applicable in the case of SPARQL Update requests.
> LARQ needs to update the Lucene index when a SPARQL Update request is received.
> See also a relevant thread from jena-users mailing list:
> - How to be notified of triples added/deleted to/from a Graph? -- http://markmail.org/thread/l4ymug3ujoqifnty
> [1] http://svn.apache.org/repos/asf/incubator/jena/Jena2/LARQ/trunk/src/main/java/org/apache/jena/larq/IndexBuilderModel.java
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (JENA-164) LARQ needs to update the Lucene index
when a SPARQL Update request is received
Posted by "Paolo Castagna (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/JENA-164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13227364#comment-13227364 ]
Paolo Castagna commented on JENA-164:
-------------------------------------
Hi Tao, could you share a few more detail on your use cases and application scenario? I imagine you are using Fuseki (with TDB) and LARQ for free text searches. Do you submit all your updates via SPARQL Update or there are other ways your updates come in? Do you use tdbloader for large/incremental updates? How frequent and how big are your updates? Would re-building the Lucene index nightly or hourly be a feasible option for you?
In any case, thanks for posting your comment here. You can either answer my questions here or on jena-users/jena-dev mailing lists. I prefer this discussions to happen on jena-users and leave JIRA comments to specific comments on how to implement/fix the issue. But comments in JIRA are welcome anyway and they are better than nothing.
> LARQ needs to update the Lucene index when a SPARQL Update request is received
> ------------------------------------------------------------------------------
>
> Key: JENA-164
> URL: https://issues.apache.org/jira/browse/JENA-164
> Project: Apache Jena
> Issue Type: New Feature
> Components: LARQ
> Reporter: Paolo Castagna
> Assignee: Paolo Castagna
> Priority: Minor
> Original Estimate: 96h
> Remaining Estimate: 96h
>
> LARQ used not to update the Lucene index as RDF statements were added/removed from a Jena Model.
> LARQ is currently extending StatementListener [1] to keep a Lucene index in sync with a Jena Model, however this notification mechanism is not applicable in the case of SPARQL Update requests.
> LARQ needs to update the Lucene index when a SPARQL Update request is received.
> See also a relevant thread from jena-users mailing list:
> - How to be notified of triples added/deleted to/from a Graph? -- http://markmail.org/thread/l4ymug3ujoqifnty
> [1] http://svn.apache.org/repos/asf/incubator/jena/Jena2/LARQ/trunk/src/main/java/org/apache/jena/larq/IndexBuilderModel.java
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Issue Comment Edited] (JENA-164) LARQ needs to update the
Lucene index when a SPARQL Update request is received
Posted by "Paolo Castagna (Issue Comment Edited) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/JENA-164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13198719#comment-13198719 ]
Paolo Castagna edited comment on JENA-164 at 2/2/12 11:58 AM:
--------------------------------------------------------------
Andy's suggestion from jena-dev:
> And I've suggested LARQ could create a DatasetGraph and catch every
> add(quad)/delete(quad).
>
> A LARQ assember could simply name the dataset description it wraps.
> Assemble the LARQ assember assembles the inner dataset. Fuseki service
> points to LARQ.
>
> Seems quite practical to try to me.
-- http://mail-archives.apache.org/mod_mbox/incubator-jena-dev/201202.mbox/%3C4F2A6ECE.6010802%40googlemail.com%3E
was (Author: castagna):
> And I've suggested LARQ could create a DatasetGraph and catch every
> add(quad)/delete(quad).
>
> A LARQ assember could simply name the dataset description it wraps.
> Assemble the LARQ assember assembles the inner dataset. Fuseki service
> points to LARQ.
>
> Seems quite practical to try to me.
-- http://mail-archives.apache.org/mod_mbox/incubator-jena-dev/201202.mbox/%3C4F2A6ECE.6010802%40googlemail.com%3E
> LARQ needs to update the Lucene index when a SPARQL Update request is received
> ------------------------------------------------------------------------------
>
> Key: JENA-164
> URL: https://issues.apache.org/jira/browse/JENA-164
> Project: Jena
> Issue Type: New Feature
> Components: LARQ
> Reporter: Paolo Castagna
> Assignee: Paolo Castagna
> Priority: Minor
> Original Estimate: 96h
> Remaining Estimate: 96h
>
> LARQ used not to update the Lucene index as RDF statements were added/removed from a Jena Model.
> LARQ is currently extending StatementListener [1] to keep a Lucene index in sync with a Jena Model, however this notification mechanism is not applicable in the case of SPARQL Update requests.
> LARQ needs to update the Lucene index when a SPARQL Update request is received.
> See also a relevant thread from jena-users mailing list:
> - How to be notified of triples added/deleted to/from a Graph? -- http://markmail.org/thread/l4ymug3ujoqifnty
> [1] http://svn.apache.org/repos/asf/incubator/jena/Jena2/LARQ/trunk/src/main/java/org/apache/jena/larq/IndexBuilderModel.java
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (JENA-164) LARQ needs to update the Lucene index
when a SPARQL Update request is received
Posted by "Paolo Castagna (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/JENA-164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13198719#comment-13198719 ]
Paolo Castagna commented on JENA-164:
-------------------------------------
> And I've suggested LARQ could create a DatasetGraph and catch every
> add(quad)/delete(quad).
>
> A LARQ assember could simply name the dataset description it wraps.
> Assemble the LARQ assember assembles the inner dataset. Fuseki service
> points to LARQ.
>
> Seems quite practical to try to me.
-- http://mail-archives.apache.org/mod_mbox/incubator-jena-dev/201202.mbox/%3C4F2A6ECE.6010802%40googlemail.com%3E
> LARQ needs to update the Lucene index when a SPARQL Update request is received
> ------------------------------------------------------------------------------
>
> Key: JENA-164
> URL: https://issues.apache.org/jira/browse/JENA-164
> Project: Jena
> Issue Type: New Feature
> Components: LARQ
> Reporter: Paolo Castagna
> Assignee: Paolo Castagna
> Priority: Minor
> Original Estimate: 96h
> Remaining Estimate: 96h
>
> LARQ used not to update the Lucene index as RDF statements were added/removed from a Jena Model.
> LARQ is currently extending StatementListener [1] to keep a Lucene index in sync with a Jena Model, however this notification mechanism is not applicable in the case of SPARQL Update requests.
> LARQ needs to update the Lucene index when a SPARQL Update request is received.
> See also a relevant thread from jena-users mailing list:
> - How to be notified of triples added/deleted to/from a Graph? -- http://markmail.org/thread/l4ymug3ujoqifnty
> [1] http://svn.apache.org/repos/asf/incubator/jena/Jena2/LARQ/trunk/src/main/java/org/apache/jena/larq/IndexBuilderModel.java
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (JENA-164) LARQ needs to update the Lucene index
when a SPARQL Update request is received
Posted by "Paolo Castagna (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/JENA-164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Paolo Castagna updated JENA-164:
--------------------------------
Priority: Minor (was: Major)
> LARQ needs to update the Lucene index when a SPARQL Update request is received
> ------------------------------------------------------------------------------
>
> Key: JENA-164
> URL: https://issues.apache.org/jira/browse/JENA-164
> Project: Jena
> Issue Type: New Feature
> Components: LARQ
> Reporter: Paolo Castagna
> Assignee: Paolo Castagna
> Priority: Minor
> Original Estimate: 96h
> Remaining Estimate: 96h
>
> LARQ used not to update the Lucene index as RDF statements were added/removed from a Jena Model.
> LARQ is currently extending StatementListener [1] to keep a Lucene index in sync with a Jena Model, however this notification mechanism is not applicable in the case of SPARQL Update requests.
> LARQ needs to update the Lucene index when a SPARQL Update request is received.
> See also a relevant thread from jena-users mailing list:
> - How to be notified of triples added/deleted to/from a Graph? -- http://markmail.org/thread/l4ymug3ujoqifnty
> [1] http://svn.apache.org/repos/asf/incubator/jena/Jena2/LARQ/trunk/src/main/java/org/apache/jena/larq/IndexBuilderModel.java
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (JENA-164) LARQ needs to update the Lucene index
when a SPARQL Update request is received
Posted by "Paolo Castagna (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/JENA-164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13224805#comment-13224805 ]
Paolo Castagna commented on JENA-164:
-------------------------------------
A couple of related messages from jena-users ml:
- http://markmail.org/message/ui2plmeuvrr4aaxm
- http://markmail.org/message/bowpd2gxsnwulgpl
> LARQ needs to update the Lucene index when a SPARQL Update request is received
> ------------------------------------------------------------------------------
>
> Key: JENA-164
> URL: https://issues.apache.org/jira/browse/JENA-164
> Project: Apache Jena
> Issue Type: New Feature
> Components: LARQ
> Reporter: Paolo Castagna
> Assignee: Paolo Castagna
> Priority: Minor
> Original Estimate: 96h
> Remaining Estimate: 96h
>
> LARQ used not to update the Lucene index as RDF statements were added/removed from a Jena Model.
> LARQ is currently extending StatementListener [1] to keep a Lucene index in sync with a Jena Model, however this notification mechanism is not applicable in the case of SPARQL Update requests.
> LARQ needs to update the Lucene index when a SPARQL Update request is received.
> See also a relevant thread from jena-users mailing list:
> - How to be notified of triples added/deleted to/from a Graph? -- http://markmail.org/thread/l4ymug3ujoqifnty
> [1] http://svn.apache.org/repos/asf/incubator/jena/Jena2/LARQ/trunk/src/main/java/org/apache/jena/larq/IndexBuilderModel.java
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (JENA-164) LARQ needs to update the Lucene index
when a SPARQL Update request is received
Posted by "laotao (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/JENA-164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13227349#comment-13227349 ]
laotao commented on JENA-164:
-----------------------------
Hi Paolo/Andy,
I was searching for a solution regarding this. It is a very important feature for our project. Would you please inform me when this can be implemented? Or is there any work around that I can try?
Thanks
Tao
> LARQ needs to update the Lucene index when a SPARQL Update request is received
> ------------------------------------------------------------------------------
>
> Key: JENA-164
> URL: https://issues.apache.org/jira/browse/JENA-164
> Project: Apache Jena
> Issue Type: New Feature
> Components: LARQ
> Reporter: Paolo Castagna
> Assignee: Paolo Castagna
> Priority: Minor
> Original Estimate: 96h
> Remaining Estimate: 96h
>
> LARQ used not to update the Lucene index as RDF statements were added/removed from a Jena Model.
> LARQ is currently extending StatementListener [1] to keep a Lucene index in sync with a Jena Model, however this notification mechanism is not applicable in the case of SPARQL Update requests.
> LARQ needs to update the Lucene index when a SPARQL Update request is received.
> See also a relevant thread from jena-users mailing list:
> - How to be notified of triples added/deleted to/from a Graph? -- http://markmail.org/thread/l4ymug3ujoqifnty
> [1] http://svn.apache.org/repos/asf/incubator/jena/Jena2/LARQ/trunk/src/main/java/org/apache/jena/larq/IndexBuilderModel.java
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira