You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@mahout.apache.org by "XiaoboGu (JIRA)" <ji...@apache.org> on 2011/08/10 16:40:27 UTC
[jira] [Created] (MAHOUT-783) AUC ConfusionMatrix do not work
probably
AUC ConfusionMatrix do not work probably
----------------------------------------
Key: MAHOUT-783
URL: https://issues.apache.org/jira/browse/MAHOUT-783
Project: Mahout
Issue Type: Bug
Components: Classification
Affects Versions: 0.6
Reporter: XiaoboGu
I have reported the problem to the dev list, just creating this jira to remind the authors of AUC and ConfusionMatrix to help identify the root problem, you can see abnormal output of ConfusionMatrix and AUC at here
http://mail-archives.apache.org/mod_mbox/mahout-dev/201108.mbox/%3cCACOCgcnRbH=xHW6TqkZV_iFdbDPOcqEZ_aHMP8npE7_utE_1=Q@mail.gmail.com%3e
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAHOUT-783) AUC ConfusionMatrix do not work
probably
Posted by "Sean Owen (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sean Owen updated MAHOUT-783:
-----------------------------
Affects Version/s: (was: 0.6)
Assignee: Ted Dunning
> AUC ConfusionMatrix do not work probably
> ----------------------------------------
>
> Key: MAHOUT-783
> URL: https://issues.apache.org/jira/browse/MAHOUT-783
> Project: Mahout
> Issue Type: Bug
> Components: Classification
> Reporter: XiaoboGu
> Assignee: Ted Dunning
>
> I have reported the problem to the dev list, just creating this jira to remind the authors of AUC and ConfusionMatrix to help identify the root problem, you can see abnormal output of ConfusionMatrix and AUC at here
> http://mail-archives.apache.org/mod_mbox/mahout-dev/201108.mbox/%3cCACOCgcnRbH=xHW6TqkZV_iFdbDPOcqEZ_aHMP8npE7_utE_1=Q@mail.gmail.com%3e
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (MAHOUT-783) AUC ConfusionMatrix do not work
probably
Posted by "Sean Owen (Resolved) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sean Owen resolved MAHOUT-783.
------------------------------
Resolution: Invalid
I don't understand the issue. The confusion matrix looks OK, but hard to say without understanding the input. What is the expected output? What is a patch would fix the behavior as you desire?
> AUC ConfusionMatrix do not work probably
> ----------------------------------------
>
> Key: MAHOUT-783
> URL: https://issues.apache.org/jira/browse/MAHOUT-783
> Project: Mahout
> Issue Type: Bug
> Components: Classification
> Reporter: XiaoboGu
> Assignee: Ted Dunning
>
> I have reported the problem to the dev list, just creating this jira to remind the authors of AUC and ConfusionMatrix to help identify the root problem, you can see abnormal output of ConfusionMatrix and AUC at here
> http://mail-archives.apache.org/mod_mbox/mahout-dev/201108.mbox/%3cCACOCgcnRbH=xHW6TqkZV_iFdbDPOcqEZ_aHMP8npE7_utE_1=Q@mail.gmail.com%3e
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAHOUT-783) AUC ConfusionMatrix do not work
probably
Posted by "XiaoboGu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13084816#comment-13084816 ]
XiaoboGu commented on MAHOUT-783:
---------------------------------
I am sorry, the link above seems not working, so I plaste the original message here:
ValidateAdaptiveLogistic now has a default option let user specify the
default valuefor confusion matrix, now the output is:
Log-likelihood:Min=-100.00, Max=0.00, Mean=-27.10, Median=0.00
AUC = 0.48
=======================================================
Confusion Matrix
-------------------------------------------------------
a c <--Classified as
9711 0 | 9711 a = normal
0 12833 | 12833 c = anomaly
Default Category: anomaly: 2
Entropy Matrix: [[NaN, NaN], [-0.0, -0.0]]
It seems AUC and Entropy still can't work, and the labels confusion
matrix use should sequencially, that's it should use a, b, c, d, e
....., but here b is not used.
> AUC ConfusionMatrix do not work probably
> ----------------------------------------
>
> Key: MAHOUT-783
> URL: https://issues.apache.org/jira/browse/MAHOUT-783
> Project: Mahout
> Issue Type: Bug
> Components: Classification
> Affects Versions: 0.6
> Reporter: XiaoboGu
>
> I have reported the problem to the dev list, just creating this jira to remind the authors of AUC and ConfusionMatrix to help identify the root problem, you can see abnormal output of ConfusionMatrix and AUC at here
> http://mail-archives.apache.org/mod_mbox/mahout-dev/201108.mbox/%3cCACOCgcnRbH=xHW6TqkZV_iFdbDPOcqEZ_aHMP8npE7_utE_1=Q@mail.gmail.com%3e
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira