You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Doron Cohen (JIRA)" <ji...@apache.org> on 2008/01/02 22:55:34 UTC
[jira] Created: (LUCENE-1116) contrib.benchmark.quality package
improvements
contrib.benchmark.quality package improvements
----------------------------------------------
Key: LUCENE-1116
URL: https://issues.apache.org/jira/browse/LUCENE-1116
Project: Lucene - Java
Issue Type: Improvement
Components: contrib/benchmark
Affects Versions: 2.2
Reporter: Doron Cohen
Assignee: Doron Cohen
Priority: Minor
Fix For: 2.3
Few fixes and improvements for the search quality benchmark package:
- flush report and logger at the end (otherwise long submission reports might miss last lines).
- add run-tag-name to submission report (API change).
- add control over max-#queries to run (useful at debugging a quality evaluation setup).
- move control over max-docs-to-retrieve from benchmark constructor to a setter method (API change).
- add computation of Mean Reciprocal Rank (MRR) in QualityStats.
- QualityStats fixed to not fail if there are no results to average.
- Add a TREC queries reader adequate for the 1MQ track (track started 2007).
All tests pass, will commit this in 1-2 days if there is no objection.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org
[jira] Updated: (LUCENE-1116) contrib.benchmark.quality package
improvements
Posted by "Doron Cohen (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-1116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Doron Cohen updated LUCENE-1116:
--------------------------------
Attachment: lucene-1116.patch
> contrib.benchmark.quality package improvements
> ----------------------------------------------
>
> Key: LUCENE-1116
> URL: https://issues.apache.org/jira/browse/LUCENE-1116
> Project: Lucene - Java
> Issue Type: Improvement
> Components: contrib/benchmark
> Affects Versions: 2.2
> Reporter: Doron Cohen
> Assignee: Doron Cohen
> Priority: Minor
> Fix For: 2.3
>
> Attachments: lucene-1116.patch
>
>
> Few fixes and improvements for the search quality benchmark package:
> - flush report and logger at the end (otherwise long submission reports might miss last lines).
> - add run-tag-name to submission report (API change).
> - add control over max-#queries to run (useful at debugging a quality evaluation setup).
> - move control over max-docs-to-retrieve from benchmark constructor to a setter method (API change).
> - add computation of Mean Reciprocal Rank (MRR) in QualityStats.
> - QualityStats fixed to not fail if there are no results to average.
> - Add a TREC queries reader adequate for the 1MQ track (track started 2007).
> All tests pass, will commit this in 1-2 days if there is no objection.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org
[jira] Resolved: (LUCENE-1116) contrib.benchmark.quality package
improvements
Posted by "Doron Cohen (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/LUCENE-1116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Doron Cohen resolved LUCENE-1116.
---------------------------------
Resolution: Fixed
Lucene Fields: [New, Patch Available] (was: [Patch Available, New])
Committed.
> contrib.benchmark.quality package improvements
> ----------------------------------------------
>
> Key: LUCENE-1116
> URL: https://issues.apache.org/jira/browse/LUCENE-1116
> Project: Lucene - Java
> Issue Type: Improvement
> Components: contrib/benchmark
> Affects Versions: 2.2
> Reporter: Doron Cohen
> Assignee: Doron Cohen
> Priority: Minor
> Fix For: 2.3
>
> Attachments: lucene-1116.patch
>
>
> Few fixes and improvements for the search quality benchmark package:
> - flush report and logger at the end (otherwise long submission reports might miss last lines).
> - add run-tag-name to submission report (API change).
> - add control over max-#queries to run (useful at debugging a quality evaluation setup).
> - move control over max-docs-to-retrieve from benchmark constructor to a setter method (API change).
> - add computation of Mean Reciprocal Rank (MRR) in QualityStats.
> - QualityStats fixed to not fail if there are no results to average.
> - Add a TREC queries reader adequate for the 1MQ track (track started 2007).
> All tests pass, will commit this in 1-2 days if there is no objection.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org