You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@opennlp.apache.org by jz...@apache.org on 2021/06/07 19:14:25 UTC
[opennlp-site] branch master updated: Adding UD models 1.0 to the
website. (#65)
This is an automated email from the ASF dual-hosted git repository.
jzemerick pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/opennlp-site.git
The following commit(s) were added to refs/heads/master by this push:
new 59b3fa3 Adding UD models 1.0 to the website. (#65)
59b3fa3 is described below
commit 59b3fa35db11787650e65d67e08497d587d6502c
Author: Jeff Zemerick <jz...@apache.org>
AuthorDate: Mon Jun 7 15:12:40 2021 -0400
Adding UD models 1.0 to the website. (#65)
* Adding UD models 1.0 to the website.
* Fixing spelling and new lines.
---
src/main/jbake/content/models.ad | 173 +++++++++++++++++++++++--
src/main/jbake/content/news/news-2021-05-30.ad | 31 +++++
2 files changed, 193 insertions(+), 11 deletions(-)
diff --git a/src/main/jbake/content/models.ad b/src/main/jbake/content/models.ad
index f99b24a..12ea474 100755
--- a/src/main/jbake/content/models.ad
+++ b/src/main/jbake/content/models.ad
@@ -22,17 +22,16 @@
:jbake-status: published
:idprefix:
-
Use the links in the table below to download the pre-trained models for the Apache OpenNLP.
Note: All models are zip compressed (like a jar file), they *must not* be uncompressed.
[options="header"]
-|===
+|======
| Component | Language | Compatibility | Description | README and Reports | File | Signatures
| Language Detector
-| 103
+| Detects 103 languages
| >= 1.8.3
| Detects 103 languages in ISO 693-3 standard. Works well with longer texts that have at least 2 sentences or more from the same language.
| https://www.apache.org/dist/opennlp/models/langdetect/1.8.3/README.txt[README]
@@ -42,17 +41,161 @@ https://www.apache.org/dist/opennlp/models/langdetect/1.8.3/langdetect-183.bin.r
|https://www.apache.org/dist/opennlp/models/langdetect/1.8.3/langdetect-183.bin.md5[md5]
https://www.apache.org/dist/opennlp/models/langdetect/1.8.3/langdetect-183.bin.sha1[sha1]
https://www.apache.org/dist/opennlp/models/langdetect/1.8.3/langdetect-183.bin.asc[asc]
-|===
-
-# SourceForge Models
-
-The models on Sourceforge for 1.5.0 are http://opennlp.sourceforge.net/models-1.5/[found here]
-and are fully compatible with Apache OpenNLP {opennlp_version}.
-The models can be used for testing or getting started, please train your own models for all other use cases.
+| Sentence
+| fr
+| >= 1.0.0
+| Sentence detection model for French
+| https://www.apache.org/dyn/closer.cgi/opennlp/models/ud-models-1.0/README[README]
+https://dist.apache.org/repos/dist/release/opennlp/models/ud-models-1.0/opennlp-training-eval-logs-1.0-1.9.3.zip[Evaluation Logs]
+| https://www.apache.org/dyn/closer.cgi/opennlp/models/ud-models-1.0/opennlp-1.0-1.9.3fr-ud-ftb-sentence-1.0-1.9.3.bin[opennlp-1.0-1.9.3fr-ud-ftb-sentence-1.0-1.9.3.bin]
+|https://www.apache.org/dyn/closer.cgi/opennlp/models/ud-models-1.0/opennlp-1.0-1.9.3fr-ud-ftb-sentence-1.0-1.9.3.bin.sha512[sha512]
+https://www.apache.org/dyn/closer.cgi/opennlp/models/ud-models-1.0/opennlp-1.0-1.9.3fr-ud-ftb-sentence-1.0-1.9.3.bin.asc[asc]
+
+| Sentence
+| de
+| >= 1.0.0
+| Sentence detection model for German
+| https://www.apache.org/dyn/closer.cgi/opennlp/models/ud-models-1.0/README[README]
+https://dist.apache.org/repos/dist/release/opennlp/models/ud-models-1.0/opennlp-training-eval-logs-1.0-1.9.3.zip[Evaluation Logs]
+| https://www.apache.org/dyn/closer.cgi/opennlp/models/ud-models-1.0/opennlp-de-ud-gsd-sentence-1.0-1.9.3.bin[opennlp-de-ud-gsd-sentence-1.0-1.9.3.bin]
+|https://www.apache.org/dyn/closer.cgi/opennlp/models/ud-models-1.0/opennlp-de-ud-gsd-sentence-1.0-1.9.3.bin.sha512[sha512]
+https://www.apache.org/dyn/closer.cgi/opennlp/models/ud-models-1.0/opennlp-de-ud-gsd-sentence-1.0-1.9.3.bin.asc[asc]
+
+| Sentence
+| en
+| >= 1.0.0
+| Sentence detection model for English
+| https://www.apache.org/dyn/closer.cgi/opennlp/models/ud-models-1.0/README[README]
+https://dist.apache.org/repos/dist/release/opennlp/models/ud-models-1.0/opennlp-training-eval-logs-1.0-1.9.3.zip[Evaluation Logs]
+| https://www.apache.org/dyn/closer.cgi/opennlp/models/ud-models-1.0/opennlp-en-ud-ewt-sentence-1.0-1.9.3.bin[opennlp-en-ud-ewt-sentence-1.0-1.9.3.bin]
+|https://www.apache.org/dyn/closer.cgi/opennlp/models/ud-models-1.0/opennlp-en-ud-ewt-sentence-1.0-1.9.3.bin.sha512[sha512]
+https://www.apache.org/dyn/closer.cgi/opennlp/models/ud-models-1.0/opennlp-en-ud-ewt-sentence-1.0-1.9.3.bin.asc[asc]
+
+| Sentence
+| it
+| >= 1.0.0
+| Sentence detection model for Italian
+| https://www.apache.org/dyn/closer.cgi/opennlp/models/ud-models-1.0/README[README]
+https://dist.apache.org/repos/dist/release/opennlp/models/ud-models-1.0/opennlp-training-eval-logs-1.0-1.9.3.zip[Evaluation Logs]
+| https://www.apache.org/dyn/closer.cgi/opennlp/models/ud-models-1.0/opennlp-it-ud-vit-sentence-1.0-1.9.3.bin[opennlp-it-ud-vit-sentence-1.0-1.9.3.bin]
+|https://www.apache.org/dyn/closer.cgi/opennlp/models/ud-models-1.0/opennlp-it-ud-vit-sentence-1.0-1.9.3.bin.sha512[sha512]
+https://www.apache.org/dyn/closer.cgi/opennlp/models/ud-models-1.0/opennlp-it-ud-vit-sentence-1.0-1.9.3.bin.asc[asc]
+
+| Sentence
+| nl
+| >= 1.0.0
+| Sentence detection model for Dutch
+| https://www.apache.org/dyn/closer.cgi/opennlp/models/ud-models-1.0/README[README]
+https://dist.apache.org/repos/dist/release/opennlp/models/ud-models-1.0/opennlp-training-eval-logs-1.0-1.9.3.zip[Evaluation Logs]
+| https://www.apache.org/dyn/closer.cgi/opennlp/models/ud-models-1.0/opennlp-nl-ud-alpino-sentence-1.0-1.9.3.bin[opennlp-nl-ud-alpino-sentence-1.0-1.9.3.bin]
+|https://www.apache.org/dyn/closer.cgi/opennlp/models/ud-models-1.0/opennlp-nl-ud-alpino-sentence-1.0-1.9.3.bin.sha512[sha512]
+https://www.apache.org/dyn/closer.cgi/opennlp/models/ud-models-1.0/opennlp-nl-ud-alpino-sentence-1.0-1.9.3.bin.asc[asc]
+
+| Parts of Speech
+| de
+| >= 1.0.0
+| Parts of speech model for German
+| https://www.apache.org/dyn/closer.cgi/opennlp/models/ud-models-1.0/README[README]
+https://dist.apache.org/repos/dist/release/opennlp/models/ud-models-1.0/opennlp-training-eval-logs-1.0-1.9.3.zip[Evaluation Logs]
+| https://www.apache.org/dyn/closer.cgi/opennlp/models/ud-models-1.0/opennlp-de-ud-gsd-pos-1.0-1.9.3.bin[opennlp-de-ud-gsd-pos-1.0-1.9.3.bin]
+|https://www.apache.org/dyn/closer.cgi/opennlp/models/ud-models-1.0/opennlp-de-ud-gsd-pos-1.0-1.9.3.bin.sha512[sha512]
+https://www.apache.org/dyn/closer.cgi/opennlp/models/ud-models-1.0/opennlp-de-ud-gsd-pos-1.0-1.9.3.bin.asc[asc]
+
+| Parts of Speech
+| en
+| >= 1.0.0
+| Parts of speech model for English
+| https://www.apache.org/dyn/closer.cgi/opennlp/models/ud-models-1.0/README[README]
+https://dist.apache.org/repos/dist/release/opennlp/models/ud-models-1.0/opennlp-training-eval-logs-1.0-1.9.3.zip[Evaluation Logs]
+| https://www.apache.org/dyn/closer.cgi/opennlp/models/ud-models-1.0/opennlp-en-ud-ewt-pos-1.0-1.9.3.bin[opennlp-en-ud-ewt-pos-1.0-1.9.3.bin]
+|https://www.apache.org/dyn/closer.cgi/opennlp/models/ud-models-1.0/opennlp-en-ud-ewt-pos-1.0-1.9.3.bin.sha512[sha512]
+https://www.apache.org/dyn/closer.cgi/opennlp/models/ud-models-1.0/opennlp-en-ud-ewt-pos-1.0-1.9.3.bin.asc[asc]
+
+| Parts of Speech
+| fr
+| >= 1.0.0
+| Parts of speech model for French
+| https://www.apache.org/dyn/closer.cgi/opennlp/models/ud-models-1.0/README[README]
+https://dist.apache.org/repos/dist/release/opennlp/models/ud-models-1.0/opennlp-training-eval-logs-1.0-1.9.3.zip[Evaluation Logs]
+| https://www.apache.org/dyn/closer.cgi/opennlp/models/ud-models-1.0/opennlp-fr-ud-ftb-pos-1.0-1.9.3.bin[opennlp-fr-ud-ftb-pos-1.0-1.9.3.bin]
+|https://www.apache.org/dyn/closer.cgi/opennlp/models/ud-models-1.0/opennlp-fr-ud-ftb-pos-1.0-1.9.3.bin.md5[md5]
+https://www.apache.org/dyn/closer.cgi/opennlp/models/ud-models-1.0/opennlp-fr-ud-ftb-pos-1.0-1.9.3.bin.sha512[sha512]
+https://www.apache.org/dyn/closer.cgi/opennlp/models/ud-models-1.0/opennlp-fr-ud-ftb-pos-1.0-1.9.3.bin.asc[asc]
+
+| Parts of Speech
+| it
+| >= 1.0.0
+| Parts of speech model for Italian
+| https://www.apache.org/dyn/closer.cgi/opennlp/models/ud-models-1.0/README[README]
+https://dist.apache.org/repos/dist/release/opennlp/models/ud-models-1.0/opennlp-training-eval-logs-1.0-1.9.3.zip[Evaluation Logs]
+| https://www.apache.org/dyn/closer.cgi/opennlp/models/ud-models-1.0/opennlp-it-ud-vit-pos-1.0-1.9.3.bin[opennlp-it-ud-vit-pos-1.0-1.9.3.bin]
+|https://www.apache.org/dyn/closer.cgi/opennlp/models/ud-models-1.0/opennlp-it-ud-vit-pos-1.0-1.9.3.bin.sha512[sha512]
+https://www.apache.org/dyn/closer.cgi/opennlp/models/ud-models-1.0/opennlp-it-ud-vit-pos-1.0-1.9.3.bin.asc[asc]
+
+| Parts of Speech
+| nl
+| >= 1.0.0
+| Parts of speech model for Dutch
+| https://www.apache.org/dyn/closer.cgi/opennlp/models/ud-models-1.0/README[README]
+https://dist.apache.org/repos/dist/release/opennlp/models/ud-models-1.0/opennlp-training-eval-logs-1.0-1.9.3.zip[Evaluation Logs]
+| https://www.apache.org/dyn/closer.cgi/opennlp/models/ud-models-1.0/opennlp-nl-ud-alpino-pos-1.0-1.9.3.bin[opennlp-nl-ud-alpino-pos-1.0-1.9.3.bin]
+|https://www.apache.org/dyn/closer.cgi/opennlp/models/ud-models-1.0/opennlp-nl-ud-alpino-pos-1.0-1.9.3.bin.sha512[sha512]
+https://www.apache.org/dyn/closer.cgi/opennlp/models/ud-models-1.0/opennlp-nl-ud-alpino-pos-1.0-1.9.3.bin.asc[asc]
+
+| Tokens
+| de
+| >= 1.0.0
+| Tokenizer model for German
+| https://www.apache.org/dyn/closer.cgi/opennlp/models/ud-models-1.0/README[README]
+https://dist.apache.org/repos/dist/release/opennlp/models/ud-models-1.0/opennlp-training-eval-logs-1.0-1.9.3.zip[Evaluation Logs]
+| https://www.apache.org/dyn/closer.cgi/opennlp/models/ud-models-1.0/opennlp-de-ud-gsd-tokens-1.0-1.9.3.bin[opennlp-de-ud-gsd-tokens-1.0-1.9.3.bin]
+|https://www.apache.org/dyn/closer.cgi/opennlp/models/ud-models-1.0/opennlp-de-ud-gsd-tokens-1.0-1.9.3.bin.sha512[sha512]
+https://www.apache.org/dyn/closer.cgi/opennlp/models/ud-models-1.0/opennlp-de-ud-gsd-tokens-1.0-1.9.3.bin.asc[asc]
+
+| Tokens
+| en
+| >= 1.0.0
+| Tokenizer model for English
+| https://www.apache.org/dyn/closer.cgi/opennlp/models/ud-models-1.0/README[README]
+https://dist.apache.org/repos/dist/release/opennlp/models/ud-models-1.0/opennlp-training-eval-logs-1.0-1.9.3.zip[Evaluation Logs]
+| https://www.apache.org/dyn/closer.cgi/opennlp/models/ud-models-1.0/opennlp-en-ud-ewt-tokens-1.0-1.9.3.bin[opennlp-en-ud-ewt-tokens-1.0-1.9.3.bin]
+|https://www.apache.org/dyn/closer.cgi/opennlp/models/ud-models-1.0/opennlp-en-ud-ewt-tokens-1.0-1.9.3.bin.sha512[sha512]
+https://www.apache.org/dyn/closer.cgi/opennlp/models/ud-models-1.0/opennlp-en-ud-ewt-tokens-1.0-1.9.3.bin.asc[asc]
+
+| Tokens
+| fr
+| >= 1.0.0
+| Tokenizer model for French
+| https://www.apache.org/dyn/closer.cgi/opennlp/models/ud-models-1.0/README[README]
+https://dist.apache.org/repos/dist/release/opennlp/models/ud-models-1.0/opennlp-training-eval-logs-1.0-1.9.3.zip[Evaluation Logs]
+| https://www.apache.org/dyn/closer.cgi/opennlp/models/ud-models-1.0/opennlp-en-ud-ewt-tokens-1.0-1.9.3.bin[opennlp-en-ud-ewt-tokens-1.0-1.9.3.bin]
+|https://www.apache.org/dyn/closer.cgi/opennlp/models/ud-models-1.0/opennlp-en-ud-ewt-tokens-1.0-1.9.3.bin.sha512[sha512]
+https://www.apache.org/dyn/closer.cgi/opennlp/models/ud-models-1.0/opennlp-en-ud-ewt-tokens-1.0-1.9.3.bin.asc[asc]
+
+| Tokens
+| it
+| >= 1.0.0
+| Tokenizer model for Italian
+| https://www.apache.org/dyn/closer.cgi/opennlp/models/ud-models-1.0/README[README]
+https://dist.apache.org/repos/dist/release/opennlp/models/ud-models-1.0/opennlp-training-eval-logs-1.0-1.9.3.zip[Evaluation Logs]
+| https://www.apache.org/dyn/closer.cgi/opennlp/models/ud-models-1.0/opennlp-it-ud-vit-tokens-1.0-1.9.3.bin[opennlp-it-ud-vit-tokens-1.0-1.9.3.bin]
+|https://www.apache.org/dyn/closer.cgi/opennlp/models/ud-models-1.0/opennlp-it-ud-vit-tokens-1.0-1.9.3.bin.sha512[sha512]
+https://www.apache.org/dyn/closer.cgi/opennlp/models/ud-models-1.0/opennlp-it-ud-vit-tokens-1.0-1.9.3.bin.asc[asc]
+
+| Tokens
+| nl
+| >= 1.0.0
+| Tokenizer model for Dutch
+| https://www.apache.org/dyn/closer.cgi/opennlp/models/ud-models-1.0/README[README]
+https://dist.apache.org/repos/dist/release/opennlp/models/ud-models-1.0/opennlp-training-eval-logs-1.0-1.9.3.zip[Evaluation Logs]
+| https://www.apache.org/dyn/closer.cgi/opennlp/models/ud-models-1.0/opennlp-nl-ud-alpino-tokens-1.0-1.9.3.bin[opennlp-nl-ud-alpino-tokens-1.0-1.9.3.bin]
+|https://www.apache.org/dyn/closer.cgi/opennlp/models/ud-models-1.0/opennlp-nl-ud-alpino-tokens-1.0-1.9.3.bin.sha512[sha512]
+https://www.apache.org/dyn/closer.cgi/opennlp/models/ud-models-1.0/opennlp-nl-ud-alpino-tokens-1.0-1.9.3.bin.asc[asc]
+|======
## Verifying Signatures
-The md5, sha1 and asc files are signature files and can be used to verify the integrity of the
+The md5, sha1, sha512, and asc files are signature files and can be used to verify the integrity of the
downloaded distribution package.
Use the following commands to verify the integrity:
@@ -70,3 +213,11 @@ That can easily be done with:
More information about release signing and verifying signatures can
be found https://www.apache.org/dev/release-signing.html[here].
+
+# SourceForge Models
+
+The models on Sourceforge for 1.5.0 are http://opennlp.sourceforge.net/models-1.5/[found here]
+and are fully compatible with Apache OpenNLP {opennlp_version}.
+
+The models can be used for testing or getting started, please train your own models for all other use cases.
+
diff --git a/src/main/jbake/content/news/news-2021-05-30.ad b/src/main/jbake/content/news/news-2021-05-30.ad
new file mode 100755
index 0000000..b5bf4c8
--- /dev/null
+++ b/src/main/jbake/content/news/news-2021-05-30.ad
@@ -0,0 +1,31 @@
+////
+ Licensed to the Apache Software Foundation (ASF) under one
+ or more contributor license agreements. See the NOTICE file
+ distributed with this work for additional information
+ regarding copyright ownership. The ASF licenses this file
+ to you under the Apache License, Version 2.0 (the
+ "License"); you may not use this file except in compliance
+ with the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+ Unless required by applicable law or agreed to in writing,
+ software distributed under the License is distributed on an
+ "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+ KIND, either express or implied. See the License for the
+ specific language governing permissions and limitations
+ under the License.
+////
+= OpenNLP Pre-trained Models Available
+2021-05-30
+:jbake-type: post
+:jbake-tags: news
+:jbake-status: published
+:category: news
+:idprefix:
+
+== OpenNLP Pre-trained Models Available
+
+Pre-trained sentence, parts of speech, and token models are now available for English, French, Italian, German, and Dutch.
+These models were trained on Universal Dependencies and are intended to provide usable models under the Apache 2.0 license.
+See the models' README for more information on the models including how each was created and evaluated.