You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@mahout.apache.org by "Grant Ingersoll (JIRA)" <ji...@apache.org> on 2008/11/01 13:39:44 UTC
[jira] Commented: (MAHOUT-92) BayesFeatureMapper doesn't properly
extract features
[ https://issues.apache.org/jira/browse/MAHOUT-92?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12644507#action_12644507 ]
Grant Ingersoll commented on MAHOUT-92:
---------------------------------------
Cool, this looks almost exactly like the patch I came up with based on looking at some of the old patches.
{code}
Why is encoding and analyzer a required option in the command line?
{code}
In my original patch, I believe it started off by tokenizing/filtering the text using any specified Lucene Analyzer. I think this piece would be useful to restore. This way, you aren't just relying on a simple whitespace tokenizer and can plug in your own very easily.
{code}
The same goes for the default category. The classifier returns the first category if all the categories have same score or zero. I don't see any problem in that.
{code}
The default category covered the case where there isn't sufficient evidence for a category.
> BayesFeatureMapper doesn't properly extract features
> ----------------------------------------------------
>
> Key: MAHOUT-92
> URL: https://issues.apache.org/jira/browse/MAHOUT-92
> Project: Mahout
> Issue Type: Bug
> Reporter: Grant Ingersoll
> Assignee: Grant Ingersoll
> Priority: Minor
> Fix For: 0.1
>
> Attachments: MAHOUT-92.patch
>
>
> The BayesFeatureMapper currently has a bunch of unused variables and doesn't actually do anything. The problem is it is not using the input value to generate a set of n-grams, from which it can then generate tf-idf information.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.