[jira] [Commented] (STANBOL-652) Benchmark should report evaluation summary

["Rupert Westenthaler (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/STANBOL-652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13930255#comment-13930255 ] 

Rupert Westenthaler commented on STANBOL-652:
---------------------------------------------

We should evaluate the usage of EARL[1] for representing the evaluation results

[1] http://www.w3.org/TR/EARL10-Schema/

> Benchmark should report evaluation summary
> ------------------------------------------
>
>                 Key: STANBOL-652
>                 URL: https://issues.apache.org/jira/browse/STANBOL-652
>             Project: Stanbol
>          Issue Type: Improvement
>          Components: Commons
>            Reporter: Pablo Mendes
>            Priority: Minor
>              Labels: benchmark, evaluation
>
>  The SBC is a nice way to perform manual inspection of the behavior of the enhancement chain for different examples in the evaluation dataset. However, for evaluations with several hundreds of examples, it would be interesting to have scores that summarize the performance for the entire
>  dataset. For example, precision, recall and F1. An evaluation dataset is available here in BDL: http://spotlight.dbpedia.org/download/stanbol/



--
This message was sent by Atlassian JIRA
(v6.2#6252)