You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@opennlp.apache.org by kr...@apache.org on 2026/08/09 22:06:56 UTC

(opennlp) branch OPENNLP-1894-lattice-cjk updated (163e3960d -> 85cb63f50)

This is an automated email from the ASF dual-hosted git repository.

krickert pushed a change to branch OPENNLP-1894-lattice-cjk
in repository https://gitbox.apache.org/repos/asf/opennlp.git


    from 163e3960d OPENNLP-1894: Reconcile the shared download test files with the sibling PR
     add 8e14a692c OPENNLP-1894: Add a remote-gated end-to-end test over the catalog dictionaries
     add f3e2d3bc0 OPENNLP-1894: Bound matrix cells separately so real distributions load
     add 85cb63f50 OPENNLP-1894: Extract dictionary files from the archive root only

No new revisions were added by this update.

Summary of changes:
 .../tools/tokenize/lattice/MecabDictionary.java    |   9 +-
 .../java/opennlp/tools/util/ResourceLimits.java    |  34 +++++-
 .../tokenize/lattice/MecabDictionaryInstaller.java |  33 +++++-
 .../tokenize/lattice/LatticeTokenizerTest.java     |  36 ++++--
 .../tokenize/lattice/MecabCatalogEndToEndTest.java | 122 +++++++++++++++++++++
 .../lattice/MecabDictionaryInstallerTest.java      |  23 ++++
 opennlp-docs/src/docbkx/tokenizer.xml              |   5 +-
 7 files changed, 240 insertions(+), 22 deletions(-)
 create mode 100644 opennlp-core/opennlp-runtime/src/test/java/opennlp/tools/tokenize/lattice/MecabCatalogEndToEndTest.java