You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@clerezza.apache.org by "Reto Bachmann-Gmür (JIRA)" <ji...@apache.org> on 2011/01/04 20:25:48 UTC

[jira] Created: (CLEREZZA-388) Composite Resource Index Service

Composite Resource Index Service
--------------------------------

                 Key: CLEREZZA-388
                 URL: https://issues.apache.org/jira/browse/CLEREZZA-388
             Project: Clerezza
          Issue Type: New Feature
            Reporter: Reto Bachmann-Gmür
            Assignee: Reto Bachmann-Gmür


A service shall monitor a graph for resource of a specific typed and provide composite indexes on specified properties. It shall support searching by exact value, by range as well as full-text search. This service shall make it possible to provide fast faceted searches.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] [Commented] (CLEREZZA-388) Composite Resource Index Service

Posted by "Tsuyoshi Ito (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/CLEREZZA-388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13015408#comment-13015408 ] 

Tsuyoshi Ito commented on CLEREZZA-388:
---------------------------------------

I was not able to implement IndexService.addDefinition in my java code. Could someone explain or make an example how to use it?


> Composite Resource Index Service
> --------------------------------
>
>                 Key: CLEREZZA-388
>                 URL: https://issues.apache.org/jira/browse/CLEREZZA-388
>             Project: Clerezza
>          Issue Type: New Feature
>            Reporter: Reto Bachmann-Gmür
>            Assignee: Reto Bachmann-Gmür
>         Attachments: GenericCondition.java, GraphIndexer.scala, ResourceFinder.scala
>
>
> A service shall monitor a graph for resource of a specific typed and provide composite indexes on specified properties. It shall support searching by exact value, by range as well as full-text search. This service shall make it possible to provide fast faceted searches.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (CLEREZZA-388) Composite Resource Index Service

Posted by "Daniel Spicar (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/CLEREZZA-388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Daniel Spicar updated CLEREZZA-388:
-----------------------------------

    Attachment: CLEREZZA-388-genericcondition-patch.diff

Hi,
I created a scala implementation of GenericCondition. This is useful with CRIS as it allows people to use the apache lucene query parser syntax (http://lucene.apache.org/java/3_0_0/queryparsersyntax.html). It supports querying over multiple fields as well.

I attached the file (don't confuse it with the java Version I attached earlier ;) )

> Composite Resource Index Service
> --------------------------------
>
>                 Key: CLEREZZA-388
>                 URL: https://issues.apache.org/jira/browse/CLEREZZA-388
>             Project: Clerezza
>          Issue Type: New Feature
>            Reporter: Reto Bachmann-Gmür
>            Assignee: Reto Bachmann-Gmür
>         Attachments: CLEREZZA-388-genericcondition-patch.diff, GenericCondition.java, GraphIndexer.scala, ResourceFinder.scala
>
>
> A service shall monitor a graph for resource of a specific typed and provide composite indexes on specified properties. It shall support searching by exact value, by range as well as full-text search. This service shall make it possible to provide fast faceted searches.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] Commented: (CLEREZZA-388) Composite Resource Index Service

Posted by "Daniel Spicar (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/CLEREZZA-388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13007902#comment-13007902 ] 

Daniel Spicar commented on CLEREZZA-388:
----------------------------------------

I'd like give some feedback from some use-case scenario experience.

The use case is that I have a web site with a search interface that allows me to search for users on the platform. I'd like to be able to search "intuitively". This means when I enter "jessica" i expect all users where jessica appears in the name string as a single word. A rough specification is:
- exact string matching with double quotes ("phrase").
- wildcard matching (*,?)
- case-insensitive search ('jessica' and 'Jessica' should deliver the same results)
- boolean condtitions for search terms (AND, OR, NOT)

Lucene provides a QueryParser that supports most of these things and even more (fuzzy searches, range searches, etc). --> http://lucene.apache.org/java/3_0_0/queryparsersyntax.html

Thus I implemented my own Condition that uses the QueryParser on the user input to generate a query.

But I faced some problems which need to be resolved in CRIS:
1. CRIS indexes named resources with the Field.Index.NOT_ANALYZED attribute. This means the index is not tokenized and it is case-sensitive.
2. CRIS is currently hard-coded to deliver the top 10 results. For this use case this would need to be configurable though.

Concerning problem 1:
I resolved it locally by adding another field to the indexed document:
doc.add(new Field(vProperty.stringKey, propertyValue, Field.Store.YES, Field.Index.ANALYZED))

Because CRIS uses the StandardAnalyzer this means that in that new field the words are tokenized, common English stop words (like "a") are omitted, and the index is (according to my understanding) lower-case.
This means that now there is a field with the exact value, and another field with a lower-case, tokenized index.

The consequences from this solution are that it would be good it the GraphIndexer could somehow expose the Lucene Version attribute and the Analyzer that it uses on the public interface so custom conditions (like mine) can use the same Analyzer as the index has been written with.

I'll attach the GenericCondition, GraphIndexer, ResourceFinder files for reference. It is not production level code though.

> Composite Resource Index Service
> --------------------------------
>
>                 Key: CLEREZZA-388
>                 URL: https://issues.apache.org/jira/browse/CLEREZZA-388
>             Project: Clerezza
>          Issue Type: New Feature
>            Reporter: Reto Bachmann-Gmür
>            Assignee: Reto Bachmann-Gmür
>
> A service shall monitor a graph for resource of a specific typed and provide composite indexes on specified properties. It shall support searching by exact value, by range as well as full-text search. This service shall make it possible to provide fast faceted searches.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] Commented: (CLEREZZA-388) Composite Resource Index Service

Posted by "Daniel Spicar (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/CLEREZZA-388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13007632#comment-13007632 ] 

Daniel Spicar commented on CLEREZZA-388:
----------------------------------------

I played around with CRIS and had a few issues:

when adding a large number of triples to the graph that the GraphIndexer listens to I get a stackoverflow. I added ca. 123 000 triples and got this exception:
org.apache.clerezza.rdf.cris.GraphIndexer$$anon$2@1b6b4740: caught java.lang.StackOverflowError
java.lang.StackOverflowError
	at scala.actors.Reactor$class.drainSendBuffer(Reactor.scala:155)
	at org.apache.clerezza.rdf.cris.GraphIndexer$$anon$2.drainSendBuffer(GraphIndexer.scala:197)
	at scala.actors.Actor$class.receiveWithin(Actor.scala:535)
	at org.apache.clerezza.rdf.cris.GraphIndexer$$anon$2.receiveWithin(GraphIndexer.scala:197)
	at org.apache.clerezza.rdf.cris.GraphIndexer$$anon$2.receiveSubsequentResources(GraphIndexer.scala:216)
	at org.apache.clerezza.rdf.cris.GraphIndexer$$anon$2$$anonfun$receiveSubsequentResources$1.apply(GraphIndexer.scala:219)
	at org.apache.clerezza.rdf.cris.GraphIndexer$$anon$2$$anonfun$receiveSubsequentResources$1.apply(GraphIndexer.scala:216)
	at scala.actors.Actor$class.receiveWithin(Actor.scala:596)
...

another issue:

I can't use the findResources method that takes a list (?) of Conditions as input. I implemented my own Condition in Java and tried to use it and the code would not compile. When I changed the signature to take only a single Condition it worked.

example-> ResourceFinder.scala:
def findResources(conditions: Condition*): List[Resource] <--- OLD: doesn't work in java.
def findResources(conditions: Condition): List[Resource] <--- NEW: this one works in java, but takes only a single condition.

The question is can I pass the arguments for the first version somehow from Java? I tried Arrays, Lists, Objects... didn't work.

And a few wishes: 
-could we make the length of the result list configurable?
-can searches be done both case-sensitive and case-insensitive somehow?

P.S: I know this issue is not yet finished. But we are in a hurry to use such a service to I checked out how it works and what can be done with it in the current state.


> Composite Resource Index Service
> --------------------------------
>
>                 Key: CLEREZZA-388
>                 URL: https://issues.apache.org/jira/browse/CLEREZZA-388
>             Project: Clerezza
>          Issue Type: New Feature
>            Reporter: Reto Bachmann-Gmür
>            Assignee: Reto Bachmann-Gmür
>
> A service shall monitor a graph for resource of a specific typed and provide composite indexes on specified properties. It shall support searching by exact value, by range as well as full-text search. This service shall make it possible to provide fast faceted searches.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (CLEREZZA-388) Composite Resource Index Service

Posted by "Daniel Spicar (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/CLEREZZA-388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13019755#comment-13019755 ] 

Daniel Spicar commented on CLEREZZA-388:
----------------------------------------

Today we ran into problems with "org.apache.clerezza.rdf.cris.GraphIndexer$$anon$2@3e0ad2a5: caught java.io.FileNotFoundException: <path-to-lucene-index>/_1_1.del (Too many open files)" and similar.

I am investigating this currently. It seems we need to to optimize some things in graphindexer/lucene configuration to release file descriptors or not grab too many file descriptors. This might help: http://wiki.apache.org/lucene-java/LuceneFAQ#Why_am_I_getting_an_IOException_that_says_.22Too_many_open_files.22.3F

> Composite Resource Index Service
> --------------------------------
>
>                 Key: CLEREZZA-388
>                 URL: https://issues.apache.org/jira/browse/CLEREZZA-388
>             Project: Clerezza
>          Issue Type: New Feature
>            Reporter: Reto Bachmann-Gmür
>            Assignee: Reto Bachmann-Gmür
>         Attachments: CLEREZZA-388-genericcondition-patch.diff, GenericCondition.java, GraphIndexer.scala, ResourceFinder.scala
>
>
> A service shall monitor a graph for resource of a specific typed and provide composite indexes on specified properties. It shall support searching by exact value, by range as well as full-text search. This service shall make it possible to provide fast faceted searches.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (CLEREZZA-388) Composite Resource Index Service

Posted by "Reto Bachmann-Gmür (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/CLEREZZA-388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13021549#comment-13021549 ] 

Reto Bachmann-Gmür commented on CLEREZZA-388:
---------------------------------------------

Why are the line numbers less usefull in scala than in java?

I'll look into the issue of having multiple IndexSearcher. Keep in mind howver that the TDB storage also keeps a lot of files open, so the operating system default an how many files are allowed to be open needs very likely to be increased anyway.

> Composite Resource Index Service
> --------------------------------
>
>                 Key: CLEREZZA-388
>                 URL: https://issues.apache.org/jira/browse/CLEREZZA-388
>             Project: Clerezza
>          Issue Type: New Feature
>            Reporter: Reto Bachmann-Gmür
>            Assignee: Reto Bachmann-Gmür
>         Attachments: CLEREZZA-388-genericcondition-patch.diff, GenericCondition.java, GraphIndexer.scala, ResourceFinder.scala
>
>
> A service shall monitor a graph for resource of a specific typed and provide composite indexes on specified properties. It shall support searching by exact value, by range as well as full-text search. This service shall make it possible to provide fast faceted searches.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] Updated: (CLEREZZA-388) Composite Resource Index Service

Posted by "Daniel Spicar (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/CLEREZZA-388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Daniel Spicar updated CLEREZZA-388:
-----------------------------------

    Attachment: ResourceFinder.scala
                GraphIndexer.scala
                GenericCondition.java

Attached files for use-case

> Composite Resource Index Service
> --------------------------------
>
>                 Key: CLEREZZA-388
>                 URL: https://issues.apache.org/jira/browse/CLEREZZA-388
>             Project: Clerezza
>          Issue Type: New Feature
>            Reporter: Reto Bachmann-Gmür
>            Assignee: Reto Bachmann-Gmür
>         Attachments: GenericCondition.java, GraphIndexer.scala, ResourceFinder.scala
>
>
> A service shall monitor a graph for resource of a specific typed and provide composite indexes on specified properties. It shall support searching by exact value, by range as well as full-text search. This service shall make it possible to provide fast faceted searches.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] Commented: (CLEREZZA-388) Composite Resource Index Service

Posted by "Reto Bachmann-Gmür (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/CLEREZZA-388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13008622#comment-13008622 ] 

Reto Bachmann-Gmür commented on CLEREZZA-388:
---------------------------------------------

Thanks for the files, I've added the patch to GraphIndexer. In ResourceFinder I've added an overloaded method taking a java.util.List.

As for the stack-overflow, does it also occur when adding the triples more slowly? an accosional 100ms without new indexable resource should solve the problem, otherwise you'd have to increase the stack size.

> Composite Resource Index Service
> --------------------------------
>
>                 Key: CLEREZZA-388
>                 URL: https://issues.apache.org/jira/browse/CLEREZZA-388
>             Project: Clerezza
>          Issue Type: New Feature
>            Reporter: Reto Bachmann-Gmür
>            Assignee: Reto Bachmann-Gmür
>         Attachments: GenericCondition.java, GraphIndexer.scala, ResourceFinder.scala
>
>
> A service shall monitor a graph for resource of a specific typed and provide composite indexes on specified properties. It shall support searching by exact value, by range as well as full-text search. This service shall make it possible to provide fast faceted searches.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (CLEREZZA-388) Composite Resource Index Service

Posted by "Alexander Schäfer (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/CLEREZZA-388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13021560#comment-13021560 ] 

Alexander Schäfer commented on CLEREZZA-388:
--------------------------------------------

I'm currently pursuing a way to implement faceted search in clerezza via Solr, as Solr provides a nice interface and management system for lucene indices. As far as I understand, CRIS is composed of three parts, a way to subscribe to a graph, a simple query system and the actual indexing via Lucene. Would it make sense to modularize all features? This would allow me replace the query system with a SPARQL based one once it is performant enough, and the indexing system with Solr.

> Composite Resource Index Service
> --------------------------------
>
>                 Key: CLEREZZA-388
>                 URL: https://issues.apache.org/jira/browse/CLEREZZA-388
>             Project: Clerezza
>          Issue Type: New Feature
>            Reporter: Reto Bachmann-Gmür
>            Assignee: Hasan
>         Attachments: CLEREZZA-388-genericcondition-patch.diff, GenericCondition.java, GraphIndexer.scala, ResourceFinder.scala
>
>
> A service shall monitor a graph for resource of a specific typed and provide composite indexes on specified properties. It shall support searching by exact value, by range as well as full-text search. This service shall make it possible to provide fast faceted searches.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] Issue Comment Edited: (CLEREZZA-388) Composite Resource Index Service

Posted by "Reto Bachmann-Gmür (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/CLEREZZA-388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13008622#comment-13008622 ] 

Reto Bachmann-Gmür edited comment on CLEREZZA-388 at 3/18/11 9:52 PM:
----------------------------------------------------------------------

Thanks for the files, I've added the patch to GraphIndexer. In ResourceFinder I've added an overloaded method taking a java.util.List.

As for the stack-overflow, I think this happened when adding triples very quickly (never letting 100ms without an indexable resource), I've changed the code so this should no longer happen.

      was (Author: reto):
    Thanks for the files, I've added the patch to GraphIndexer. In ResourceFinder I've added an overloaded method taking a java.util.List.

As for the stack-overflow, does it also occur when adding the triples more slowly? an accosional 100ms without new indexable resource should solve the problem, otherwise you'd have to increase the stack size.
  
> Composite Resource Index Service
> --------------------------------
>
>                 Key: CLEREZZA-388
>                 URL: https://issues.apache.org/jira/browse/CLEREZZA-388
>             Project: Clerezza
>          Issue Type: New Feature
>            Reporter: Reto Bachmann-Gmür
>            Assignee: Reto Bachmann-Gmür
>         Attachments: GenericCondition.java, GraphIndexer.scala, ResourceFinder.scala
>
>
> A service shall monitor a graph for resource of a specific typed and provide composite indexes on specified properties. It shall support searching by exact value, by range as well as full-text search. This service shall make it possible to provide fast faceted searches.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Assigned] (CLEREZZA-388) Composite Resource Index Service

Posted by "Reto Bachmann-Gmür (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/CLEREZZA-388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Reto Bachmann-Gmür reassigned CLEREZZA-388:
-------------------------------------------

    Assignee: Hasan  (was: Reto Bachmann-Gmür)

Assigning to Hasan whoul would like to suggest another implementation.

> Composite Resource Index Service
> --------------------------------
>
>                 Key: CLEREZZA-388
>                 URL: https://issues.apache.org/jira/browse/CLEREZZA-388
>             Project: Clerezza
>          Issue Type: New Feature
>            Reporter: Reto Bachmann-Gmür
>            Assignee: Hasan
>         Attachments: CLEREZZA-388-genericcondition-patch.diff, GenericCondition.java, GraphIndexer.scala, ResourceFinder.scala
>
>
> A service shall monitor a graph for resource of a specific typed and provide composite indexes on specified properties. It shall support searching by exact value, by range as well as full-text search. This service shall make it possible to provide fast faceted searches.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (CLEREZZA-388) Composite Resource Index Service

Posted by "Tsuyoshi Ito (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/CLEREZZA-388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13021564#comment-13021564 ] 

Tsuyoshi Ito commented on CLEREZZA-388:
---------------------------------------

I am not sure: Probably because of inline functions within functions. Additionally inline functions in scala makes it difficult for me to understand/read the code of CRIS (Alle functions are defined and executed within in the constructor)

new IndexSearcher(index, true) opens at least one new file (and it will never be closed) => after a few searches within  300'000 triples a "too many files open" exception occurs. I never had this problems bevor with tdb (constantly about 600 files open).

IMO if IndexSearcher and IndexWriter would be available once per lucene directory (as service?) I think we could reduce the number of files resp. keep it constant.



> Composite Resource Index Service
> --------------------------------
>
>                 Key: CLEREZZA-388
>                 URL: https://issues.apache.org/jira/browse/CLEREZZA-388
>             Project: Clerezza
>          Issue Type: New Feature
>            Reporter: Reto Bachmann-Gmür
>            Assignee: Hasan
>         Attachments: CLEREZZA-388-genericcondition-patch.diff, GenericCondition.java, GraphIndexer.scala, ResourceFinder.scala
>
>
> A service shall monitor a graph for resource of a specific typed and provide composite indexes on specified properties. It shall support searching by exact value, by range as well as full-text search. This service shall make it possible to provide fast faceted searches.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (CLEREZZA-388) Composite Resource Index Service

Posted by "Tommaso Teofili (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/CLEREZZA-388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tommaso Teofili updated CLEREZZA-388:
-------------------------------------

    Fix Version/s: 0.2-incubating
    
> Composite Resource Index Service
> --------------------------------
>
>                 Key: CLEREZZA-388
>                 URL: https://issues.apache.org/jira/browse/CLEREZZA-388
>             Project: Clerezza
>          Issue Type: New Feature
>            Reporter: Reto Bachmann-Gmür
>            Assignee: Hasan
>             Fix For: 0.2-incubating
>
>         Attachments: CLEREZZA-388-genericcondition-patch.diff, GenericCondition.java, GraphIndexer.scala, ResourceFinder.scala
>
>
> A service shall monitor a graph for resource of a specific typed and provide composite indexes on specified properties. It shall support searching by exact value, by range as well as full-text search. This service shall make it possible to provide fast faceted searches.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

       

[jira] [Commented] (CLEREZZA-388) Composite Resource Index Service

Posted by "Tsuyoshi Ito (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/CLEREZZA-388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13021096#comment-13021096 ] 

Tsuyoshi Ito commented on CLEREZZA-388:
---------------------------------------

It is difficult to understand/read the scala code and locate the problems because the error messages/line number are not very useful.

Probably somebody else can help solving the issues regarding the java.io.FileNotFoundException (too many files open). 

IMO we shouldn't create an IndexSearcher for every thread.

FAQ lucene:
Make sure you only open one IndexSearcher, and share it among all of the threads that are doing searches -- this is safe, and it will minimize the number of files that are open concurently. 

> Composite Resource Index Service
> --------------------------------
>
>                 Key: CLEREZZA-388
>                 URL: https://issues.apache.org/jira/browse/CLEREZZA-388
>             Project: Clerezza
>          Issue Type: New Feature
>            Reporter: Reto Bachmann-Gmür
>            Assignee: Reto Bachmann-Gmür
>         Attachments: CLEREZZA-388-genericcondition-patch.diff, GenericCondition.java, GraphIndexer.scala, ResourceFinder.scala
>
>
> A service shall monitor a graph for resource of a specific typed and provide composite indexes on specified properties. It shall support searching by exact value, by range as well as full-text search. This service shall make it possible to provide fast faceted searches.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] Commented: (CLEREZZA-388) Composite Resource Index Service

Posted by "Daniel Spicar (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/CLEREZZA-388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13007430#comment-13007430 ] 

Daniel Spicar commented on CLEREZZA-388:
----------------------------------------

I tried to use CRIS in a prototype project in Java. I can't figure out how to use the IndexDefinitionManager in Java. In Scala it is a trait. I don't know how to instantiate an Object of this type in Java. The java compiler doesn't seem to see any method signatures for this type (and javah produces header files that are pretty much empty).

Is there any way to use the IndexDefinitionManager in Java?

> Composite Resource Index Service
> --------------------------------
>
>                 Key: CLEREZZA-388
>                 URL: https://issues.apache.org/jira/browse/CLEREZZA-388
>             Project: Clerezza
>          Issue Type: New Feature
>            Reporter: Reto Bachmann-Gmür
>            Assignee: Reto Bachmann-Gmür
>
> A service shall monitor a graph for resource of a specific typed and provide composite indexes on specified properties. It shall support searching by exact value, by range as well as full-text search. This service shall make it possible to provide fast faceted searches.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Issue Comment Edited] (CLEREZZA-388) Composite Resource Index Service

Posted by "Daniel Spicar (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/CLEREZZA-388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13019365#comment-13019365 ] 

Daniel Spicar edited comment on CLEREZZA-388 at 4/13/11 3:00 PM:
-----------------------------------------------------------------

Hi,
I created a scala implementation of GenericCondition. This is useful with CRIS as it allows people to use the apache lucene query parser syntax (http://lucene.apache.org/java/3_0_0/queryparsersyntax.html). It supports querying over multiple fields as well.

I attached a patch (don't confuse it with the java Version I attached earlier ;) )

      was (Author: daniel.spicar):
    Hi,
I created a scala implementation of GenericCondition. This is useful with CRIS as it allows people to use the apache lucene query parser syntax (http://lucene.apache.org/java/3_0_0/queryparsersyntax.html). It supports querying over multiple fields as well.

I attached the file (don't confuse it with the java Version I attached earlier ;) )
  
> Composite Resource Index Service
> --------------------------------
>
>                 Key: CLEREZZA-388
>                 URL: https://issues.apache.org/jira/browse/CLEREZZA-388
>             Project: Clerezza
>          Issue Type: New Feature
>            Reporter: Reto Bachmann-Gmür
>            Assignee: Reto Bachmann-Gmür
>         Attachments: CLEREZZA-388-genericcondition-patch.diff, GenericCondition.java, GraphIndexer.scala, ResourceFinder.scala
>
>
> A service shall monitor a graph for resource of a specific typed and provide composite indexes on specified properties. It shall support searching by exact value, by range as well as full-text search. This service shall make it possible to provide fast faceted searches.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] Commented: (CLEREZZA-388) Composite Resource Index Service

Posted by "Reto Bachmann-Gmür (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/CLEREZZA-388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13007642#comment-13007642 ] 

Reto Bachmann-Gmür commented on CLEREZZA-388:
---------------------------------------------

Thanks Daniel for checking out CRIS. I'm reading up on varargs compatibility:

http://www.scala-lang.org/node/1644

> Composite Resource Index Service
> --------------------------------
>
>                 Key: CLEREZZA-388
>                 URL: https://issues.apache.org/jira/browse/CLEREZZA-388
>             Project: Clerezza
>          Issue Type: New Feature
>            Reporter: Reto Bachmann-Gmür
>            Assignee: Reto Bachmann-Gmür
>
> A service shall monitor a graph for resource of a specific typed and provide composite indexes on specified properties. It shall support searching by exact value, by range as well as full-text search. This service shall make it possible to provide fast faceted searches.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (CLEREZZA-388) Composite Resource Index Service

Posted by "Daniel Spicar (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/CLEREZZA-388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13010276#comment-13010276 ] 

Daniel Spicar commented on CLEREZZA-388:
----------------------------------------

The import no longer causes a stack overflow.

But I ran into another Problem. I can't find a way to instantiate the JoinVirtualProperty and the PathVirtualProperty from java.

> Composite Resource Index Service
> --------------------------------
>
>                 Key: CLEREZZA-388
>                 URL: https://issues.apache.org/jira/browse/CLEREZZA-388
>             Project: Clerezza
>          Issue Type: New Feature
>            Reporter: Reto Bachmann-Gmür
>            Assignee: Reto Bachmann-Gmür
>         Attachments: GenericCondition.java, GraphIndexer.scala, ResourceFinder.scala
>
>
> A service shall monitor a graph for resource of a specific typed and provide composite indexes on specified properties. It shall support searching by exact value, by range as well as full-text search. This service shall make it possible to provide fast faceted searches.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Resolved] (CLEREZZA-388) Composite Resource Index Service

Posted by "Tsuyoshi Ito (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/CLEREZZA-388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tsuyoshi Ito resolved CLEREZZA-388.
-----------------------------------

    Resolution: Duplicate

Check CLEREZZA-501. 

> Composite Resource Index Service
> --------------------------------
>
>                 Key: CLEREZZA-388
>                 URL: https://issues.apache.org/jira/browse/CLEREZZA-388
>             Project: Clerezza
>          Issue Type: New Feature
>            Reporter: Reto Bachmann-Gmür
>            Assignee: Hasan
>         Attachments: CLEREZZA-388-genericcondition-patch.diff, GenericCondition.java, GraphIndexer.scala, ResourceFinder.scala
>
>
> A service shall monitor a graph for resource of a specific typed and provide composite indexes on specified properties. It shall support searching by exact value, by range as well as full-text search. This service shall make it possible to provide fast faceted searches.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira