You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@samoa.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2017/05/22 15:17:04 UTC
[jira] [Commented] (SAMOA-68) Saving true and predicted labels to
file
[ https://issues.apache.org/jira/browse/SAMOA-68?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16019687#comment-16019687 ]
ASF GitHub Bot commented on SAMOA-68:
-------------------------------------
GitHub user mgrzenda opened a pull request:
https://github.com/apache/incubator-samoa/pull/61
SAMOA-68: Saving true and predicted labels to file
This pull request refers to new code saving predicted and true values for classification and regression tasks. In addition, votes are saved for classification tasks. This can be easily extended at the level of individual evaluators.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/mgrzenda/incubator-samoa predictions-file
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/incubator-samoa/pull/61.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #61
----
commit 830ec5f282c7bdde03c902e9a9a68679266bec83
Author: Maciej Grzenda <ma...@gmail.com>
Date: 2017-05-17T11:51:56Z
Draft label dump code
commit b936c2b0b673903409a6a05cec07263eefeb2b5e
Author: Jerzy Jegier <je...@wp.pl>
Date: 2017-05-17T13:52:47Z
Label dump with tests
commit 95adef29fbbd0afa2fe6ff8c452a7cee7fddbf47
Author: Jerzy Jegier <je...@wp.pl>
Date: 2017-05-22T13:20:13Z
Migrating code to evaluators
commit d51b5abed8c620b351f00f216e3ac19688b2b57c
Author: Jerzy Jegier <je...@wp.pl>
Date: 2017-05-22T15:00:26Z
Comments added
----
> Saving true and predicted labels to file
> ----------------------------------------
>
> Key: SAMOA-68
> URL: https://issues.apache.org/jira/browse/SAMOA-68
> Project: SAMOA
> Issue Type: New Feature
> Components: SAMOA-API
> Reporter: Maciej Grzenda
> Labels: features
>
> Currently PrequentialEvaluation task supports dumpFile option. With this option model performance can be saved to a file. However, in some cases it would be good to save also individual predictions made by a model. This is useful for model debugging and method development.
> This could be also used to visualize model output, calculate custom performance indicators (e.g. model accuracy for instances of a certain class or sharing the same feature value). Such saving of model output (if done) should be made for every instance. Hence, a new option making it possible to dump predictions to a separate file seems justified. For classification, it should include votes made for individual classes, if available.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)