You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@opennlp.apache.org by "Jeff Zemerick (JIRA)" <ji...@apache.org> on 2017/07/07 18:49:00 UTC
[jira] [Commented] (OPENNLP-1113)
evalPortugueseChunkerQnMultipleThreads and other tests can fail
[ https://issues.apache.org/jira/browse/OPENNLP-1113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16078513#comment-16078513 ]
Jeff Zemerick commented on OPENNLP-1113:
----------------------------------------
mvn test -Dtest=ArvoresDeitadasEval#evalPortugueseChunkerQnMultipleThreads -Peval-tests -DOPENNLP_DATA_DIR=/opt/opennlp-data/
mvn test -Dtest=ArvoresDeitadasEval#evalPortugueseSentenceDetectorMaxentQn -Peval-tests -DOPENNLP_DATA_DIR=/opt/opennlp-data/
mvn test -Dtest=Conll02NameFinderEval#evalSpanishOrganizationMaxentQn -Peval-tests -DOPENNLP_DATA_DIR=/opt/opennlp-data/
mvn test -Dtest=ConllXPosTaggerEval#evalSwedishMaxentQn -Peval-tests -DOPENNLP_DATA_DIR=/opt/opennlp-data/
> evalPortugueseChunkerQnMultipleThreads and other tests can fail
> ---------------------------------------------------------------
>
> Key: OPENNLP-1113
> URL: https://issues.apache.org/jira/browse/OPENNLP-1113
> Project: OpenNLP
> Issue Type: Test
> Affects Versions: 1.8.1
> Reporter: Jeff Zemerick
> Assignee: Jeff Zemerick
> Priority: Minor
>
> When running the eval-tests for the 1.8.1 tag some of the tests consistently fail on an EC2 instance. On another virtual machine the tests consistently pass. When the tests fail the failures are consistent with the following:
> {quote}Failed tests:
> ArvoresDeitadasEval.evalPortugueseChunkerQnMultipleThreads:208->chunkerCrossEval:128 expected:<0.9649180953528779> but was:<0.9650518197155942>
> ArvoresDeitadasEval.evalPortugueseSentenceDetectorMaxentQn:143->sentenceCrossEval:90 expected:<0.99261110833375> but was:<0.9927505074644777>
> Conll02NameFinderEval.evalSpanishOrganizationMaxentQn:390->eval:90 expected:<0.682961897915169> but was:<0.6798418972332015>
> ConllXPosTaggerEval.evalSwedishMaxentQn:152->eval:76 expected:<0.9347595473833098> but was:<0.9322842998585573>{quote}
> Both systems are Ubuntu 16.04.2 running OpenJDK 1.8.0_131 but there must be some other differences affecting the tests. Those differences need to be identified.
> *VM1 (Tests Consistently _Pass_)*
> Apache Maven 3.3.9
> Maven home: /usr/share/maven
> Java version: 1.8.0_131, vendor: Oracle Corporation
> Java home: /usr/lib/jvm/java-8-openjdk-amd64/jre
> Default locale: en_US, platform encoding: UTF-8
> OS name: "linux", version: "4.4.0-1022-aws", arch: "amd64", family: "unix"
> LANG=en_US.UTF-8
> *VM2 (Tests Consistently _Fail_)*
> Apache Maven 3.3.9
> Maven home: /usr/share/maven
> Java version: 1.8.0_131, vendor: Oracle Corporation
> Java home: /usr/lib/jvm/java-8-openjdk-amd64/jre
> Default locale: en_US, platform encoding: UTF-8
> OS name: "linux", version: "4.4.0-83-generic", arch: "amd64", family: "unix"
> LANG=en_US.UTF-8
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)