You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@opennlp.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2024/05/29 19:06:00 UTC
[jira] [Commented] (OPENNLP-1564) Fix Evaluation Tests after POSFormat Change
[ https://issues.apache.org/jira/browse/OPENNLP-1564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17850471#comment-17850471 ]
ASF GitHub Bot commented on OPENNLP-1564:
-----------------------------------------
rzo1 opened a new pull request, #603:
URL: https://github.com/apache/opennlp/pull/603
Thank you for contributing to Apache OpenNLP.
In order to streamline the review of the contribution we ask you
to ensure the following steps have been taken:
### For all changes:
- [x] Is there a JIRA ticket associated with this PR? Is it referenced
in the commit message?
- [x] Does your PR title start with OPENNLP-XXXX where XXXX is the JIRA number you are trying to resolve? Pay particular attention to the hyphen "-" character.
- [x] Has your PR been rebased against the latest commit within the target branch (typically main)?
- [ ] Is your initial contribution a single, squashed commit?
### For code changes:
- [x] Have you ensured that the full suite of tests is executed via mvn clean install at the root opennlp folder?
- [x] Have you written or updated unit tests to verify your changes?
- [ ] If adding new dependencies to the code, are these dependencies licensed in a way that is compatible for inclusion under [ASF 2.0](http://www.apache.org/legal/resolved.html#category-a)?
- [ ] If applicable, have you updated the LICENSE file, including the main LICENSE file in opennlp folder?
- [ ] If applicable, have you updated the NOTICE file, including the main NOTICE file found in opennlp folder?
### For documentation related changes:
- [ ] Have you ensured that format looks appropriate for the output in which it is rendered?
### Note:
Updates some missed `PENN` format cases in the evaluation test data. In addition, if `POSTaggerNameFeatureGenerator` is used for NameFinder (i.e. defined via XML), we only get a POSModel and need to guess the format of it before creating the `POSTagger`. Therefore, I updated the mapper with a static method for guessing this type based on a given POSModel. This might be useful for other cases as well.
Sadly, ASF Jenkins is currently broken, so we cannot trigger a manual run, see https://issues.apache.org/jira/browse/INFRA-25828
> Fix Evaluation Tests after POSFormat Change
> -------------------------------------------
>
> Key: OPENNLP-1564
> URL: https://issues.apache.org/jira/browse/OPENNLP-1564
> Project: OpenNLP
> Issue Type: Task
> Reporter: Richard Zowalla
> Assignee: Richard Zowalla
> Priority: Major
> Fix For: 2.3.4, 2.4.0
>
>
> ERROR] Failures:
> [ERROR] ConllXPosTaggerEval.evalDanishMaxentGis:133->eval:79 expected: <0.9504442925495558> but was: <0.0>
> [ERROR] ConllXPosTaggerEval.evalDanishMaxentQn:144->eval:79 expected: <0.9564251537935748> but was: <0.0>
> [ERROR] ConllXPosTaggerEval.evalSwedishMaxentGis:200->eval:79 expected: <0.9248585572842999> but was: <0.0>
> [ERROR] ConllXPosTaggerEval.evalSwedishMaxentQn:211->eval:79 expected: <0.9377652050919377> but was: <0.0>
> [ERROR] OntoNotes4NameFinderEval.evalAllTypesWithPOSNameFinder:152 expected: <0.8070226153653437> but was: <0.8060021642728011>
> [ERROR] OntoNotes4PosTaggerEval.evalEnglishMaxentTagger:79->crossEval:65 expected: <0.969345319453096> but was: <1.5460660461489513E-4>
> [ERROR] SourceForgeModelEval.evalChunkerModel:344 expected: <304922886851384639120257052245406261332> but was: <85416056838725341441074840387786758951>
> [ERROR] SourceForgeModelEval.evalMaxentModel:376->evalPosModel:368 expected: <231995214522232523777090597594904492687> but was: <90112530006040278703441476599716290769>
> [ERROR] SourceForgeModelEval.evalPerceptronModel:384->evalPosModel:368 expected: <209440430718727101220960491543652921728> but was: <256369615778494816584749939613105809001>
> [INFO]
> [ERROR] Tests run: 1040, Failures: 9, Errors: 0, Skipped: 3
--
This message was sent by Atlassian Jira
(v8.20.10#820010)