You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "James Dyer (Created) (JIRA)" <ji...@apache.org> on 2011/10/24 17:57:32 UTC

[jira] [Created] (LUCENE-3527) Implement getDistance() on DirectSpellChecker.INTERNAL_LEVENSHTEIN

Implement getDistance() on DirectSpellChecker.INTERNAL_LEVENSHTEIN
------------------------------------------------------------------

                 Key: LUCENE-3527
                 URL: https://issues.apache.org/jira/browse/LUCENE-3527
             Project: Lucene - Java
          Issue Type: Improvement
          Components: modules/spellchecker
    Affects Versions: 4.0
            Reporter: James Dyer
            Priority: Minor
             Fix For: 4.0


DirectSpellChecker.INTERNAL_LEVENSHTEIN is currently not a full-fledged implementation of StringDistance.  But an full implementation is needed for Solr's SpellCheckComponent.finishStage(), and also would be helpful for those trying to take the advice given in LIA 2nd ed section sect8.5.3.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[jira] [Updated] (LUCENE-3527) Implement getDistance() on DirectSpellChecker.INTERNAL_LEVENSHTEIN

Posted by "James Dyer (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/LUCENE-3527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

James Dyer updated LUCENE-3527:
-------------------------------

    Attachment: LUCENE-3527.patch
    
> Implement getDistance() on DirectSpellChecker.INTERNAL_LEVENSHTEIN
> ------------------------------------------------------------------
>
>                 Key: LUCENE-3527
>                 URL: https://issues.apache.org/jira/browse/LUCENE-3527
>             Project: Lucene - Java
>          Issue Type: Improvement
>          Components: modules/spellchecker
>    Affects Versions: 4.0
>            Reporter: James Dyer
>            Priority: Minor
>             Fix For: 4.0
>
>         Attachments: LUCENE-3527.patch
>
>
> DirectSpellChecker.INTERNAL_LEVENSHTEIN is currently not a full-fledged implementation of StringDistance.  But an full implementation is needed for Solr's SpellCheckComponent.finishStage(), and also would be helpful for those trying to take the advice given in LIA 2nd ed section sect8.5.3.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[jira] [Resolved] (LUCENE-3527) Implement getDistance() on DirectSpellChecker.INTERNAL_LEVENSHTEIN

Posted by "Robert Muir (Resolved) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/LUCENE-3527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Robert Muir resolved LUCENE-3527.
---------------------------------

    Resolution: Fixed
    
> Implement getDistance() on DirectSpellChecker.INTERNAL_LEVENSHTEIN
> ------------------------------------------------------------------
>
>                 Key: LUCENE-3527
>                 URL: https://issues.apache.org/jira/browse/LUCENE-3527
>             Project: Lucene - Java
>          Issue Type: Improvement
>          Components: modules/spellchecker
>    Affects Versions: 4.0
>            Reporter: James Dyer
>            Priority: Minor
>             Fix For: 4.0
>
>         Attachments: LUCENE-3257.patch, LUCENE-3527.patch, LUCENE-3527.patch
>
>
> DirectSpellChecker.INTERNAL_LEVENSHTEIN is currently not a full-fledged implementation of StringDistance.  But an full implementation is needed for Solr's SpellCheckComponent.finishStage(), and also would be helpful for those trying to take the advice given in LIA 2nd ed section sect8.5.3.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[jira] [Updated] (LUCENE-3527) Implement getDistance() on DirectSpellChecker.INTERNAL_LEVENSHTEIN

Posted by "Robert Muir (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/LUCENE-3527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Robert Muir updated LUCENE-3527:
--------------------------------

    Attachment: LUCENE-3257.patch

Thanks for opening this issue James.

I updated the patch: for just a one-off comparator (merging distributed results), termsenum/fuzzytermsenum/automata construction is very costly, so I just implemented this the standard way (as LuceneLevenshteinDistance).

Just like before, DirectSpellChecker doesn't actually use this code, but the distances computations are equivalent.
                
> Implement getDistance() on DirectSpellChecker.INTERNAL_LEVENSHTEIN
> ------------------------------------------------------------------
>
>                 Key: LUCENE-3527
>                 URL: https://issues.apache.org/jira/browse/LUCENE-3527
>             Project: Lucene - Java
>          Issue Type: Improvement
>          Components: modules/spellchecker
>    Affects Versions: 4.0
>            Reporter: James Dyer
>            Priority: Minor
>             Fix For: 4.0
>
>         Attachments: LUCENE-3257.patch, LUCENE-3527.patch
>
>
> DirectSpellChecker.INTERNAL_LEVENSHTEIN is currently not a full-fledged implementation of StringDistance.  But an full implementation is needed for Solr's SpellCheckComponent.finishStage(), and also would be helpful for those trying to take the advice given in LIA 2nd ed section sect8.5.3.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[jira] [Updated] (LUCENE-3527) Implement getDistance() on DirectSpellChecker.INTERNAL_LEVENSHTEIN

Posted by "Robert Muir (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/LUCENE-3527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Robert Muir updated LUCENE-3527:
--------------------------------

    Attachment: LUCENE-3527.patch

fix dyslexic patch name, and add another test term that will fail if the distance measure doesn't act like lucene's
                
> Implement getDistance() on DirectSpellChecker.INTERNAL_LEVENSHTEIN
> ------------------------------------------------------------------
>
>                 Key: LUCENE-3527
>                 URL: https://issues.apache.org/jira/browse/LUCENE-3527
>             Project: Lucene - Java
>          Issue Type: Improvement
>          Components: modules/spellchecker
>    Affects Versions: 4.0
>            Reporter: James Dyer
>            Priority: Minor
>             Fix For: 4.0
>
>         Attachments: LUCENE-3257.patch, LUCENE-3527.patch, LUCENE-3527.patch
>
>
> DirectSpellChecker.INTERNAL_LEVENSHTEIN is currently not a full-fledged implementation of StringDistance.  But an full implementation is needed for Solr's SpellCheckComponent.finishStage(), and also would be helpful for those trying to take the advice given in LIA 2nd ed section sect8.5.3.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org