You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@mahout.apache.org by "Robin Anil (JIRA)" <ji...@apache.org> on 2012/06/05 14:19:23 UTC

[jira] [Commented] (MAHOUT-939) ASF Email Classification Examples don't always produce good results

    [ https://issues.apache.org/jira/browse/MAHOUT-939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13289364#comment-13289364 ] 

Robin Anil commented on MAHOUT-939:
-----------------------------------

Fixed this, the new naivebayes classifier shows awesome results with asf mail archives. 


encoding takes 200 seconds
train 222s
test 117s
12/06/04 18:18:49 INFO test.TestNaiveBayesDriver: Complementary Results: =======================================================
Summary
-------------------------------------------------------
Correctly Classified Instances : 68302	 97.8342%
Incorrectly Classified Instances : 1512	 2.1658%
Total Classified Instances : 69814
=======================================================
Confusion Matrix
-------------------------------------------------------
a b <--Classified as
27633	796 | 28429 a = commons.apache.org
716 40669	 | 41385 b = cocoon.apache.org
                
> ASF Email Classification Examples don't always produce good results
> -------------------------------------------------------------------
>
>                 Key: MAHOUT-939
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-939
>             Project: Mahout
>          Issue Type: Bug
>    Affects Versions: 0.6
>            Reporter: Grant Ingersoll
>            Assignee: Robin Anil
>              Labels: MAHOUT_INTRO_CONTRIBUTE
>             Fix For: 0.8
>
>         Attachments: 939.patch, MAHOUT-939.patch, MAHOUT-939.patch, MAHOUT-939.patch, asf_sample_list.txt, bayes.patch, strip_reject.patch
>
>
> The classification examples for the ASF email don't work all that well currently in terms of quality when it comes to more than a few labels.  Also, need to determine how much memory is required for vectors of cardinality size 100K.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira