You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Karl Wettin (JIRA)" <ji...@apache.org> on 2007/10/09 18:39:50 UTC

[jira] Created: (LUCENE-1024) MarkovChainTokenFilter

MarkovChainTokenFilter
----------------------

                 Key: LUCENE-1024
                 URL: https://issues.apache.org/jira/browse/LUCENE-1024
             Project: Lucene - Java
          Issue Type: New Feature
          Components: Analysis, Term Vectors
            Reporter: Karl Wettin
            Priority: Minor
         Attachments: LUCENE-1024.txt

Merges chains of tokens to a single token, ngrams on a phrase word level rathar than on a word character level.

Quite useful for text mining purposes of the vector space.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


[jira] Updated: (LUCENE-1024) MarkovChainTokenFilter

Posted by "Karl Wettin (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/LUCENE-1024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Karl Wettin updated LUCENE-1024:
--------------------------------

    Attachment:     (was: LUCENE-1024.txt)

> MarkovChainTokenFilter
> ----------------------
>
>                 Key: LUCENE-1024
>                 URL: https://issues.apache.org/jira/browse/LUCENE-1024
>             Project: Lucene - Java
>          Issue Type: New Feature
>          Components: Analysis, Term Vectors
>            Reporter: Karl Wettin
>            Priority: Minor
>
> Merges chains of tokens to a single token, ngrams on a phrase word level rathar than on a word character level.
> Quite useful for text mining purposes of the vector space.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


[jira] Closed: (LUCENE-1024) MarkovChainTokenFilter

Posted by "Karl Wettin (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/LUCENE-1024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Karl Wettin closed LUCENE-1024.
-------------------------------

       Resolution: Duplicate
    Lucene Fields: [New, Patch Available]  (was: [Patch Available, New])

See LUCENE-1025

> MarkovChainTokenFilter
> ----------------------
>
>                 Key: LUCENE-1024
>                 URL: https://issues.apache.org/jira/browse/LUCENE-1024
>             Project: Lucene - Java
>          Issue Type: New Feature
>          Components: Analysis, Term Vectors
>            Reporter: Karl Wettin
>            Priority: Minor
>
> Merges chains of tokens to a single token, ngrams on a phrase word level rathar than on a word character level.
> Quite useful for text mining purposes of the vector space.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


[jira] Updated: (LUCENE-1024) MarkovChainTokenFilter

Posted by "Karl Wettin (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/LUCENE-1024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Karl Wettin updated LUCENE-1024:
--------------------------------

    Attachment: LUCENE-1024.txt

> MarkovChainTokenFilter
> ----------------------
>
>                 Key: LUCENE-1024
>                 URL: https://issues.apache.org/jira/browse/LUCENE-1024
>             Project: Lucene - Java
>          Issue Type: New Feature
>          Components: Analysis, Term Vectors
>            Reporter: Karl Wettin
>            Priority: Minor
>         Attachments: LUCENE-1024.txt
>
>
> Merges chains of tokens to a single token, ngrams on a phrase word level rathar than on a word character level.
> Quite useful for text mining purposes of the vector space.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


[jira] Commented: (LUCENE-1024) MarkovChainTokenFilter

Posted by "Karl Wettin (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/LUCENE-1024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12533669 ] 

Karl Wettin commented on LUCENE-1024:
-------------------------------------

Available in patch of LUCENE-1025


> MarkovChainTokenFilter
> ----------------------
>
>                 Key: LUCENE-1024
>                 URL: https://issues.apache.org/jira/browse/LUCENE-1024
>             Project: Lucene - Java
>          Issue Type: New Feature
>          Components: Analysis, Term Vectors
>            Reporter: Karl Wettin
>            Priority: Minor
>
> Merges chains of tokens to a single token, ngrams on a phrase word level rathar than on a word character level.
> Quite useful for text mining purposes of the vector space.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org