You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Karl Wettin (JIRA)" <ji...@apache.org> on 2006/07/13 11:16:31 UTC

[jira] Created: (LUCENE-625) Query auto completer

Query auto completer
--------------------

         Key: LUCENE-625
         URL: http://issues.apache.org/jira/browse/LUCENE-625
     Project: Lucene - Java
        Type: New Feature

  Components: Search  
    Reporter: Karl Wettin
    Priority: Minor


A trie that helps users to type in their query. Made for AJAX, works great with ruby on rails common scripts <http://script.aculo.us/>. Similar to the Google labs suggester.

Trained by user queries. Optimizable. Uses an in memory corpus. Serializable.

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
   http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
   http://www.atlassian.com/software/jira


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


[jira] Updated: (LUCENE-625) Query auto completer

Posted by "Karl Wettin (JIRA)" <ji...@apache.org>.
     [ http://issues.apache.org/jira/browse/LUCENE-625?page=all ]

Karl Wettin updated LUCENE-625:
-------------------------------

    Attachment: autocomplete_20060730.tar.gz

beta 2.

reqiures the Trie.java from beta1 tar-ball.

also features the first junit test case i ever wrote! :D

this is really simple code. but effective.

> Query auto completer
> --------------------
>
>                 Key: LUCENE-625
>                 URL: http://issues.apache.org/jira/browse/LUCENE-625
>             Project: Lucene - Java
>          Issue Type: New Feature
>          Components: Search
>            Reporter: Karl Wettin
>            Priority: Minor
>         Attachments: autocomplete_0.0.1.tar.gz, autocomplete_20060730.tar.gz
>
>
> A trie that helps users to type in their query. Made for AJAX, works great with ruby on rails common scripts <http://script.aculo.us/>. Similar to the Google labs suggester.
> Trained by user queries. Optimizable. Uses an in memory corpus. Serializable.

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


[jira] Commented: (LUCENE-625) Query auto completer

Posted by "Karl Wettin (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/LUCENE-625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12736923#action_12736923 ] 

Karl Wettin commented on LUCENE-625:
------------------------------------

bq. Karl, did you ever proceed on this patch? I'm interested in adding autosuggest to Solr.

I used this patch for a few things a couple of years ago. If I recall everything right I ended up using the bootstrapped apriori corpus of LUCENE-626 as training data the last time. Made the corpus rather small, speedy and still relevant for most users.

But the major caveat is that this patch is a trie and is thus a "precise forward only" thing. So that might not fit all use cases. It might be easier to get things going using an index with ngrams of untokenized user queries (i.e. including whitespace) or subject-like fields. 

But I really prefere user queries as using only the last n queries will make it sensitive to trends. That will however require quite a bit of data to work well. A lot as in hundreds of thousands of user queries, according to my experience.

Not sure if this was an answer to your question.. : )

> Query auto completer
> --------------------
>
>                 Key: LUCENE-625
>                 URL: https://issues.apache.org/jira/browse/LUCENE-625
>             Project: Lucene - Java
>          Issue Type: New Feature
>          Components: Search
>            Reporter: Karl Wettin
>            Priority: Minor
>         Attachments: autocomplete_0.0.1.tar.gz, autocomplete_20060730.tar.gz
>
>
> A trie that helps users to type in their query. Made for AJAX, works great with ruby on rails common scripts <http://script.aculo.us/>. Similar to the Google labs suggester.
> Trained by user queries. Optimizable. Uses an in memory corpus. Serializable.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


[jira] Commented: (LUCENE-625) Query auto completer

Posted by "Jason Rutherglen (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/LUCENE-625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12736858#action_12736858 ] 

Jason Rutherglen commented on LUCENE-625:
-----------------------------------------

Karl, did you ever proceed on this patch?  I'm interested in adding autosuggest to Solr.

> Query auto completer
> --------------------
>
>                 Key: LUCENE-625
>                 URL: https://issues.apache.org/jira/browse/LUCENE-625
>             Project: Lucene - Java
>          Issue Type: New Feature
>          Components: Search
>            Reporter: Karl Wettin
>            Priority: Minor
>         Attachments: autocomplete_0.0.1.tar.gz, autocomplete_20060730.tar.gz
>
>
> A trie that helps users to type in their query. Made for AJAX, works great with ruby on rails common scripts <http://script.aculo.us/>. Similar to the Google labs suggester.
> Trained by user queries. Optimizable. Uses an in memory corpus. Serializable.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


[jira] Updated: (LUCENE-625) Query auto completer

Posted by "Karl Wettin (JIRA)" <ji...@apache.org>.
     [ http://issues.apache.org/jira/browse/LUCENE-625?page=all ]

Karl Wettin updated LUCENE-625:
-------------------------------

    Attachment: autocomplete_0.0.1.tar.gz

Beta 1.

Will add pervayler transactions in future.

> Query auto completer
> --------------------
>
>          Key: LUCENE-625
>          URL: http://issues.apache.org/jira/browse/LUCENE-625
>      Project: Lucene - Java
>         Type: New Feature

>   Components: Search
>     Reporter: Karl Wettin
>     Priority: Minor
>  Attachments: autocomplete_0.0.1.tar.gz
>
> A trie that helps users to type in their query. Made for AJAX, works great with ruby on rails common scripts <http://script.aculo.us/>. Similar to the Google labs suggester.
> Trained by user queries. Optimizable. Uses an in memory corpus. Serializable.

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
   http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
   http://www.atlassian.com/software/jira


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


[jira] Commented: (LUCENE-625) Query auto completer

Posted by "Karl Wettin (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/LUCENE-625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12488213 ] 

Karl Wettin commented on LUCENE-625:
------------------------------------

(from a mail i just posted to java-user)

There is a memoryleak in the trie at optimize() that has been fixed locally. Might be available in LUCENE-626 too. 

I'll repackage and post it up as soon I get time.

> Query auto completer
> --------------------
>
>                 Key: LUCENE-625
>                 URL: https://issues.apache.org/jira/browse/LUCENE-625
>             Project: Lucene - Java
>          Issue Type: New Feature
>          Components: Search
>            Reporter: Karl Wettin
>            Priority: Minor
>         Attachments: autocomplete_0.0.1.tar.gz, autocomplete_20060730.tar.gz
>
>
> A trie that helps users to type in their query. Made for AJAX, works great with ruby on rails common scripts <http://script.aculo.us/>. Similar to the Google labs suggester.
> Trained by user queries. Optimizable. Uses an in memory corpus. Serializable.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org