You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@opennlp.apache.org by ko...@apache.org on 2018/08/01 01:03:03 UTC
[opennlp] branch master updated: [OPENNLP-1210] Change `-lang en`
in documentation about CoNLL2003 to `-lang eng` (#325)
This is an automated email from the ASF dual-hosted git repository.
koji pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/opennlp.git
The following commit(s) were added to refs/heads/master by this push:
new bf1c2c3 [OPENNLP-1210] Change `-lang en` in documentation about CoNLL2003 to `-lang eng` (#325)
bf1c2c3 is described below
commit bf1c2c3b0a60041be263d1febeddf53a146d9fa1
Author: Xiang Ji <ji...@gmail.com>
AuthorDate: Wed Aug 1 03:03:00 2018 +0200
[OPENNLP-1210] Change `-lang en` in documentation about CoNLL2003 to `-lang eng` (#325)
Thanks x-ji! :)
---
opennlp-docs/src/docbkx/corpora.xml | 14 ++++++++------
1 file changed, 8 insertions(+), 6 deletions(-)
diff --git a/opennlp-docs/src/docbkx/corpora.xml b/opennlp-docs/src/docbkx/corpora.xml
index aeef36c..187c9c3 100644
--- a/opennlp-docs/src/docbkx/corpora.xml
+++ b/opennlp-docs/src/docbkx/corpora.xml
@@ -270,6 +270,8 @@ path: .\es_ner_person.bin]]>
<para>After one of the corpora is available the data must be
transformed as explained in the README file to the CONLL format.
The transformed data can be read by the OpenNLP CONLL03 converter.
+
+ Note that for CoNLL-2003 corpora, the -lang argument should either be "eng" or "deu", instead of "en" or "de".
</para>
</section>
<section id="tools.corpora.conll.2003.converting">
@@ -278,13 +280,13 @@ path: .\es_ner_person.bin]]>
To convert the information to the OpenNLP format:
<screen>
<![CDATA[
-$ opennlp TokenNameFinderConverter conll03 -lang en -types per -data eng.train > corpus_train.txt]]>
+$ opennlp TokenNameFinderConverter conll03 -lang eng -types per -data eng.train > corpus_train.txt]]>
</screen>
Optionally, you can convert the training test samples as well.
<screen>
<![CDATA[
-$ opennlp TokenNameFinderConverter conll03 -lang en -types per -data eng.testa > corpus_testa.txt
-$ opennlp TokenNameFinderConverter conll03 -lang en -types per -data eng.testb > corpus_testb.txt]]>
+$ opennlp TokenNameFinderConverter conll03 -lang eng -types per -data eng.testa > corpus_testa.txt
+$ opennlp TokenNameFinderConverter conll03 -lang eng -types per -data eng.testb > corpus_testb.txt]]>
</screen>
</para>
</section>
@@ -295,7 +297,7 @@ $ opennlp TokenNameFinderConverter conll03 -lang en -types per -data eng.testb >
<screen>
<![CDATA[
$ opennlp TokenNameFinderTrainer.conll03 -model en_ner_person.bin -iterations 500 \
- -lang en -types per -data eng.train -encoding utf8]]>
+ -lang eng -types per -data eng.train -encoding utf8]]>
</screen>
</para>
<para>
@@ -346,7 +348,7 @@ path: .\en_ner_person.bin]]>
<screen>
<![CDATA[
$ opennlp TokenNameFinderEvaluator.conll03 -model en_ner_person.bin \
- -lang en -types per -data eng.testa -encoding utf8]]>
+ -lang eng -types per -data eng.testa -encoding utf8]]>
</screen>
</para>
<para>
@@ -745,4 +747,4 @@ Organization: precision: 85.11%; recall: 79.38%; F1: 82.14%. [target: 130
</para>
</section>
</section>
-</chapter>
\ No newline at end of file
+</chapter>