You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@opennlp.apache.org by Richard Zowalla <rz...@apache.org> on 2023/03/04 07:49:05 UTC
Eval Tests are now run on ASF Jenkins CI
Hi all,
I've setup a job to run our eval tests on the ASF infrastructure [1].
It will run daily. It takes around 6h 17min to complete. Mails from
Jenkins are sent to the dev@ list. Thanks to Bruno for communicating
with INFRA to get us a Jenkins space.
Note, that the job runs under Linux/Ubuntu and most of the tests are
fine ;) - however, it seems, that we need to have a look into the
opennlp-dl module as we have some failures (probably require a
delta/eps in the assertion) but also an error, which needs revision.
I have created OPENNLP-1478 to track it [2].
[ERROR] Failures:
[ERROR] DocumentCategorizerDLEval.categorize:86 array contents differ
at index [0], expected: <0.3391093313694> but was:
<0.33910930156707764>
[ERROR] DocumentCategorizerDLEval.categorizeWithInferenceOptions:154
array contents differ at index [1], expected: <0.11486853659152985> but
was: <0.11486850678920746>
[ERROR] DocumentCategorizerDLEval.scoreMap:179 expected:
<0.04995147883892059> but was: <0.049951449036598206>
[ERROR] NameFinderDLEval.tokenNameFinder1Test:67 expected:
<8.251646041870117> but was: <8.251642227172852>
[ERROR] Errors:
[ERROR] DocumentCategorizerDLEval.sortedScoreMap:202 NullPointer
Cannot invoke "java.u...
[INFO]
[ERROR] Tests run: 15, Failures: 4, Errors: 1, Skipped: 1
[INFO]
[INFO] ----------------------------------------------------------------
--------
[INFO] Reactor Summary for Apache OpenNLP Reactor 2.1.2-SNAPSHOT:
[INFO]
[INFO] Apache OpenNLP Reactor ............................. SUCCESS
[ 3.000 s]
[INFO] Apache OpenNLP Tools ............................... SUCCESS
[ 06:10 h]
[INFO] Apache OpenNLP UIMA Annotators ..................... SUCCESS
[ 4.584 s]
[INFO] Apache OpenNLP Brat Annotator ...................... SUCCESS
[ 5.109 s]
[INFO] Apache OpenNLP Morfologik Addon .................... SUCCESS
[ 8.617 s]
[INFO] Apache OpenNLP Documentation ....................... SUCCESS
[ 0.103 s]
[INFO] Apache OpenNLP Distribution ........................ SUCCESS [
15.329 s]
[INFO] Apache OpenNLP DL .................................. FAILURE [
30.542 s]
[INFO] ----------------------------------------------------------------
--------
[INFO] BUILD FAILURE
[INFO] ----------------------------------------------------------------
--------
[INFO] Total time: 06:11 h
[INFO] Finished at: 2023-03-04T05:05:19Z
[INFO] ----------------------------------------------------------------
--------
Gruß
Richard
[1] https://ci-builds.apache.org/job/OpenNLP/job/eval-tests/
[2] https://issues.apache.org/jira/browse/OPENNLP-1478
Re: Eval Tests are now run on ASF Jenkins CI
Posted by Jeff Zemerick <jz...@apache.org>.
This is great -- thanks Richard and Bruno!
I can take a look at those failing tests to see what's going on.
Thanks,
Jeff
On Sat, Mar 4, 2023 at 2:49 AM Richard Zowalla <rz...@apache.org> wrote:
>
> Hi all,
>
> I've setup a job to run our eval tests on the ASF infrastructure [1].
> It will run daily. It takes around 6h 17min to complete. Mails from
> Jenkins are sent to the dev@ list. Thanks to Bruno for communicating
> with INFRA to get us a Jenkins space.
>
> Note, that the job runs under Linux/Ubuntu and most of the tests are
> fine ;) - however, it seems, that we need to have a look into the
> opennlp-dl module as we have some failures (probably require a
> delta/eps in the assertion) but also an error, which needs revision.
> I have created OPENNLP-1478 to track it [2].
>
> [ERROR] Failures:
> [ERROR] DocumentCategorizerDLEval.categorize:86 array contents differ
> at index [0], expected: <0.3391093313694> but was:
> <0.33910930156707764>
> [ERROR] DocumentCategorizerDLEval.categorizeWithInferenceOptions:154
> array contents differ at index [1], expected: <0.11486853659152985> but
> was: <0.11486850678920746>
> [ERROR] DocumentCategorizerDLEval.scoreMap:179 expected:
> <0.04995147883892059> but was: <0.049951449036598206>
> [ERROR] NameFinderDLEval.tokenNameFinder1Test:67 expected:
> <8.251646041870117> but was: <8.251642227172852>
> [ERROR] Errors:
> [ERROR] DocumentCategorizerDLEval.sortedScoreMap:202 NullPointer
> Cannot invoke "java.u...
> [INFO]
> [ERROR] Tests run: 15, Failures: 4, Errors: 1, Skipped: 1
> [INFO]
> [INFO] ----------------------------------------------------------------
> --------
> [INFO] Reactor Summary for Apache OpenNLP Reactor 2.1.2-SNAPSHOT:
> [INFO]
> [INFO] Apache OpenNLP Reactor ............................. SUCCESS
> [ 3.000 s]
> [INFO] Apache OpenNLP Tools ............................... SUCCESS
> [ 06:10 h]
> [INFO] Apache OpenNLP UIMA Annotators ..................... SUCCESS
> [ 4.584 s]
> [INFO] Apache OpenNLP Brat Annotator ...................... SUCCESS
> [ 5.109 s]
> [INFO] Apache OpenNLP Morfologik Addon .................... SUCCESS
> [ 8.617 s]
> [INFO] Apache OpenNLP Documentation ....................... SUCCESS
> [ 0.103 s]
> [INFO] Apache OpenNLP Distribution ........................ SUCCESS [
> 15.329 s]
> [INFO] Apache OpenNLP DL .................................. FAILURE [
> 30.542 s]
> [INFO] ----------------------------------------------------------------
> --------
> [INFO] BUILD FAILURE
> [INFO] ----------------------------------------------------------------
> --------
> [INFO] Total time: 06:11 h
> [INFO] Finished at: 2023-03-04T05:05:19Z
> [INFO] ----------------------------------------------------------------
> --------
>
>
> Gruß
> Richard
>
> [1] https://ci-builds.apache.org/job/OpenNLP/job/eval-tests/
> [2] https://issues.apache.org/jira/browse/OPENNLP-1478
>