[jira] [Commented] (SAMOA-68) Saving true and predicted labels to file

["ASF GitHub Bot (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SAMOA-68?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16040888#comment-16040888 ] 

ASF GitHub Bot commented on SAMOA-68:
-------------------------------------

Github user mgrzenda commented on the issue:

    https://github.com/apache/incubator-samoa/pull/61
  
    The code is extended now to handle new switch "-h". This makes it possible to declare how frequently lines in labels file should be created. If set to e.g. 10 this option will make the label file contain true and predicted labels (+ votes for classification tasks) for every 10th instance in the stream. Please let us know if there is anything else to add.


> Saving true and predicted labels to file
> ----------------------------------------
>
>                 Key: SAMOA-68
>                 URL: https://issues.apache.org/jira/browse/SAMOA-68
>             Project: SAMOA
>          Issue Type: New Feature
>          Components: SAMOA-API
>            Reporter: Maciej Grzenda
>              Labels: features
>
> Currently PrequentialEvaluation task supports dumpFile option.  With this option model performance can be saved to a file. However, in some cases it would be good to save also individual predictions made by a model.  This is useful for model debugging and method development.
> This could be also used to visualize model output, calculate custom performance indicators (e.g. model accuracy for instances of a certain class or sharing the same feature value).  Such saving of model output (if done) should be made for every instance. Hence, a new option making it possible to dump predictions to a separate file seems justified.  For classification, it should include votes made for individual classes, if available.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)