You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@opennlp.apache.org by rz...@apache.org on 2026/10/08 09:44:54 UTC
(opennlp) branch fix/ci-cache-models updated (cdb8de324 -> 3fc41b870)
This is an automated email from the ASF dual-hosted git repository.
rzo1 pushed a change to branch fix/ci-cache-models
in repository https://gitbox.apache.org/repos/asf/opennlp.git
discard cdb8de324 Cache downloaded test models in CI
add 47369544c (fix) GH-1378: MeCab CSV reader accepts unterminated quoted fields (#1383)
add a368de9cd (fix) GH-1379: Morpheme accepts a surface that does not match its span (#1384)
add 197933cf9 OPENNLP-1934: Add explicit tokenizer character policies (#1349)
add 42877392f Minor: Use ArgumentChecks for inline null checks in normalizer and tokenize (#1400)
add fce5fdbd6 Minor: Use ArgumentChecks for the inline null checks in opennlp-api (#1399)
add c8536d2c1 Minor: Use ArgumentChecks for inline null checks in ml, model-resolver, spellcheck (#1402)
add 35e97920d Minor: Use ArgumentChecks for the remaining inline null checks in runtime (#1401)
add d742b18f0 MorfologikTagDictionary is not thread-safe and fails on entries without a tag (#1382)
add b2e843340 Bump org.apache.maven:apache-maven from 3.9.16 to 3.10.0 (#1405)
add dd45c0042 Bump com.puppycrawl.tools:checkstyle from 13.3.0 to 14.3.0 (#1407)
add a6871186b GH-1408: Rename ArgumentChecks to ParamChecks (#1409)
add 6c8fdd5c7 GH-1397: Reject null spellcheck arguments with IllegalArgumentException (#1412)
add 169827669 GH-1396: Use ParamChecks for null arguments in opennlp-runtime (#1411)
add 66b1719bd GH-1395: Reject null arguments in opennlp-api with IllegalArgumentException (#1410)
add 19f201e80 GH-1414: Store mvnw.cmd with LF line endings (#1415)
add c98b76298 GH-1398: Add requireNonEmpty and requireNonNegative to ParamChecks (#1413)
add 1fd51808e Spellcheck correction loses the capital of a supplementary-plane initial (#1385)
add 8b8a4dc86 GH-1422: Clean up opennlp-morfologik builder and Javadoc (#1430)
add af742d8bd GH-1422: Clean up NumberUtil and its tests in opennlp-uima (#1432)
add e1a807c47 GH-1388: Load bundled Unicode data through one recoverable loader (#1373)
add 42f446a5a GH-1422: Clean up the spellcheck normalizer and loader (#1431)
add 95b1ac5ff GH-1422: Clean up the report listeners in opennlp-cli (#1429)
add d7eadeda2 GH-1422: Clean up the stemmer, Hunspell and NameFinderDL evals (#1434)
add 0a363d573 GH-1421: Clean up the AD, MASC, CoNLL-U and Brat readers (#1428)
add 97e4fb13f GH-1418: Clean up event parsing and context generators in the ml modules (#1425)
add 0ca246230 GH-1417: Remove duplicated logic in opennlp-api and the lattice tokenizer (#1424)
add ef04afe6d GH-1416: Correct and trim opennlp-api Javadoc (#1423)
add 9a6a927a5 GH-1422: Remove duplication in StringUtilTest and the chunker listener test (#1433)
add 11a136cc6 GH-1441: Report malformed lattice dictionary content as InvalidFormatException (#1443)
add bca31bb7c OPENNLP-1988: Load WordPiece vocabularies from tokenizer.json (#1319)
new 3fc41b870 GH-1393: Cache the downloaded test models between CI runs
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (cdb8de324)
\
N -- N -- N refs/heads/fix/ci-cache-models (3fc41b870)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.github/workflows/maven.yml | 11 +
.mvn/wrapper/maven-wrapper.properties | 2 +-
README.md | 1 +
.../java/opennlp/tools/doccat/DocumentSample.java | 7 +-
.../java/opennlp/tools/document/Annotation.java | 5 +-
.../main/java/opennlp/tools/document/Document.java | 42 +-
.../opennlp/tools/document/DocumentAnalyzer.java | 6 +-
.../opennlp/tools/document/DocumentAnnotator.java | 5 +-
.../opennlp/tools/document/DocumentAnnotators.java | 27 +-
.../opennlp/tools/document/DocumentMerges.java | 71 +++
.../opennlp/tools/document/ImmutableDocument.java | 41 +-
.../main/java/opennlp/tools/document/LayerKey.java | 5 +-
.../main/java/opennlp/tools/document/Layers.java | 24 +-
.../opennlp/tools/embeddings/TextEmbedder.java | 6 +-
.../java/opennlp/tools/langdetect/Language.java | 6 +-
.../opennlp/tools/langdetect/LanguageSample.java | 15 +-
.../main/java/opennlp/tools/ml/model/Event.java | 13 +-
.../java/opennlp/tools/namefind/NameSample.java | 6 +-
.../tools/namefind/OffsetMappingNameFinder.java | 13 +-
.../src/main/java/opennlp/tools/parser/Parse.java | 5 +-
.../opennlp/tools/sentiment/SentimentSample.java | 9 +-
.../java/opennlp/tools/stemmer/StemmerFactory.java | 4 +-
.../java/opennlp/tools/termvector/TermVector.java | 13 +-
.../opennlp/tools/tokenize/BertNormalization.java | 35 ++
.../java/opennlp/tools/tokenize/MappedText.java | 161 +++++++
.../java/opennlp/tools/tokenize/SubwordPiece.java | 14 +-
.../opennlp/tools/tokenize/SubwordTokenizer.java | 5 +
.../java/opennlp/tools/tokenize/TokenSample.java | 19 +-
.../opennlp/tools/tokenize/WordpieceEncoder.java | 195 ++------
.../opennlp/tools/tokenize/WordpieceTokenizer.java | 58 +--
.../java/opennlp/tools/util/ArgumentChecks.java | 57 ---
.../java/opennlp/tools/util/CompatibilityMode.java | 4 +-
.../opennlp/tools/util/LanguageCodeValidator.java | 13 +-
.../java/opennlp/tools/util/ObjectStreamUtils.java | 12 +-
.../main/java/opennlp/tools/util/ParamChecks.java | 191 ++++++++
.../opennlp/tools/util/PlainTextByLineStream.java | 7 +-
.../java/opennlp/tools/util/ResourceLimits.java | 8 +-
.../main/java/opennlp/tools/util/StringUtil.java | 25 +-
.../java/opennlp/tools/util/WhitespaceMode.java | 4 +-
.../opennlp/tools/util/ext/ExtensionLoader.java | 11 +-
.../java/opennlp/tools/util/ext/ProviderSpec.java | 26 +-
.../java/opennlp/tools/util/ext/Providers.java | 17 +-
.../opennlp/tools/util/normalizer/AlignedText.java | 28 +-
.../opennlp/tools/util/normalizer/Alignment.java | 20 +-
.../opennlp/tools/util/normalizer/CharClass.java | 324 +++++++------
.../tools/util/normalizer/CodePointSet.java | 44 +-
.../tools/util/normalizer/HexCodePoints.java | 26 +-
.../util/normalizer/OffsetAwareNormalizer.java | 2 +
.../opennlp/tools/util/normalizer/UnicodeDash.java | 30 +-
.../tools/util/normalizer/UnicodeWhitespace.java | 42 +-
.../tools/document/DocumentAnnotatorsTest.java | 12 +
.../tools/document/DocumentContractTest.java | 4 +
.../opennlp/tools/tokenize/MappedTextTest.java | 88 ++++
.../tools/tokenize/WordpieceEncoderTest.java | 12 +-
.../opennlp/tools/util/ArgumentChecksTest.java | 60 ---
.../java/opennlp/tools/util/ParamChecksTest.java | 185 ++++++++
.../java/opennlp/tools/util/StringUtilTest.java | 187 ++++----
.../tools/util/normalizer/AlignedTextTest.java | 18 +
.../tools/util/normalizer/AlignmentTest.java | 8 +
.../tools/util/normalizer/CharClassTest.java | 78 ++--
.../tools/util/normalizer/CodePointSetTest.java | 39 ++
.../tools/cmdline/DetailedFMeasureListener.java | 19 +
.../tools/cmdline/FineGrainedReportListener.java | 53 ++-
.../ChunkerDetailedFMeasureListenerTest.java | 21 +-
.../java/opennlp/tools/formats/ad/ADMetadata.java | 29 +-
.../tools/formats/ad/ADNameSampleStream.java | 31 +-
.../tools/formats/ad/ADSentenceSampleStream.java | 8 +-
.../tools/formats/brat/BratAnnotationStream.java | 7 +-
.../opennlp/tools/formats/conllu/ConlluStream.java | 3 +-
.../tools/formats/ad/ADNameSampleStreamTest.java | 3 +-
.../formats/ad/ADSentenceSampleStreamTest.java | 5 +-
.../tools/formats/masc/MascParserTestUtil.java | 3 +-
.../src/main/java/opennlp/dl/AbstractDL.java | 288 ++++++++++--
.../src/main/java/opennlp/dl/JsonScan.java | 152 +++++--
.../dl/doccat/DocumentCategorizerConfig.java | 5 +-
.../opennlp/dl/doccat/DocumentCategorizerDL.java | 18 +-
.../java/opennlp/dl/namefinder/NameFinderDL.java | 16 +-
.../dl/vectors/OnnxTextEmbedderProvider.java | 9 +-
.../java/opennlp/dl/vectors/SentenceVectorsDL.java | 23 +-
.../src/test/java/opennlp/dl/JsonScanTest.java | 57 +++
.../src/test/java/opennlp/dl/LoadVocabTest.java | 501 +++++++++++++++++++--
.../dl/vectors/SentenceVectorsDLEmbedderTest.java | 25 +
.../src/test/resources/opennlp/dl/tokenizer.json | 79 ++++
.../tools/ml/naivebayes/NaiveBayesModel.java | 2 +-
.../opennlp/tools/ml/AbstractMLModelWriter.java | 4 +-
.../src/main/java/opennlp/tools/ml/BeamSearch.java | 62 +--
.../tools/ml/model/AbstractDataIndexer.java | 4 +-
.../java/opennlp/tools/ml/model/AbstractModel.java | 2 +-
.../java/opennlp/tools/ml/model/EventFields.java | 37 +-
.../opennlp/tools/ml/model/FileEventStream.java | 8 +-
.../tools/ml/model/RealValueFileEventStream.java | 45 +-
.../tools/ml/model/SimpleEventStreamBuilder.java | 29 +-
.../java/opennlp/tools/ml/model/EventTest.java | 20 +-
.../ml/model/RealValueFileEventStreamTest.java | 38 +-
.../ml/model/SimpleEventStreamBuilderTest.java | 43 +-
.../tools/ml/libsvm/doccat/SvmDoccatModel.java | 14 +-
.../tools/ml/maxent/BasicContextGenerator.java | 18 +-
.../tools/ml/maxent/RealBasicEventStream.java | 11 +-
.../tools/ml/maxent/BasicContextGeneratorTest.java | 3 +-
.../tools/ml/maxent/RealBasicEventStreamTest.java | 37 +-
.../tools/ml/perceptron/PerceptronModel.java | 2 +-
.../tools/models/AbstractClassPathModelFinder.java | 9 +-
.../opennlp/tools/chunker/ChunkerAnnotator.java | 5 +-
.../java/opennlp/tools/chunker/ChunkerModel.java | 4 +-
.../tools/dictionary/serializer/Attributes.java | 8 +-
.../tools/doccat/BagOfWordsFeatureGenerator.java | 9 +-
.../java/opennlp/tools/doccat/DoccatModel.java | 4 +-
.../tools/doccat/NGramFeatureGenerator.java | 9 +-
.../tools/entitylinker/EntityLinkerFactory.java | 4 +-
.../tools/lemmatizer/LemmatizerAnnotator.java | 5 +-
.../java/opennlp/tools/log/LogPrintStream.java | 8 +-
.../namefind/DefaultNameContextGenerator.java | 6 +-
.../tools/namefind/DictionaryNameFinder.java | 7 +-
.../tools/namefind/NameFinderAnnotator.java | 5 +-
.../opennlp/tools/namefind/RegexNameFinder.java | 13 +-
.../tools/namefind/RegexNameFinderFactory.java | 13 +-
.../java/opennlp/tools/parser/ParserAnnotator.java | 9 +-
.../java/opennlp/tools/parser/ParserModel.java | 10 +-
.../postag/ConfigurablePOSContextGenerator.java | 7 +-
.../main/java/opennlp/tools/postag/POSModel.java | 10 +-
.../opennlp/tools/postag/POSTagFormatMapper.java | 15 +-
.../opennlp/tools/postag/POSTaggerAnnotator.java | 5 +-
.../sentdetect/SentenceDetectorAnnotator.java | 9 +-
.../opennlp/tools/sentdetect/SentenceModel.java | 4 +-
.../java/opennlp/tools/stemmer/CachingStemmer.java | 9 +-
.../opennlp/tools/stemmer/DelegatingStemmer.java | 5 +-
.../java/opennlp/tools/stemmer/PorterStemmer.java | 6 +-
.../java/opennlp/tools/stemmer/SharingStemmer.java | 9 +-
.../opennlp/tools/stemmer/StemmerAnnotator.java | 5 +-
.../tools/stemmer/StemmerAnnotatorProvider.java | 9 +-
.../tools/stemmer/hunspell/HunspellDictionary.java | 33 +-
.../hunspell/HunspellDictionaryDownload.java | 13 +-
.../tools/stemmer/hunspell/HunspellStemmer.java | 13 +-
.../stemmer/hunspell/HunspellStemmerFactory.java | 5 +-
.../stemmer/snowball/SnowballStemmerFactory.java | 9 +-
.../tools/stopword/DictionaryStopwordFilter.java | 33 +-
.../tools/stopword/StopwordFilterStream.java | 6 +-
.../tools/stopword/StopwordFilteringTokenizer.java | 9 +-
.../java/opennlp/tools/stopword/StopwordLists.java | 13 +-
.../tools/termvector/TermVectorAnnotator.java | 21 +-
.../java/opennlp/tools/tokenize/BPETokenizer.java | 13 +-
.../tools/tokenize/BPETokenizerTrainer.java | 11 +-
.../opennlp/tools/tokenize/TokenSampleStream.java | 8 +-
.../opennlp/tools/tokenize/TokenizerAnnotator.java | 9 +-
.../tools/tokenize/TokenizerCharacterPolicy.java | 174 +++++++
.../opennlp/tools/tokenize/TokenizerModel.java | 4 +-
.../tools/tokenize/lattice/CategoryTable.java | 15 +-
.../tools/tokenize/lattice/DoubleArrayLexicon.java | 10 +-
.../tools/tokenize/lattice/LatticeTokenizer.java | 26 +-
.../tools/tokenize/lattice/MecabDictionary.java | 167 ++++---
.../tokenize/lattice/MecabDictionaryInstaller.java | 21 +-
.../opennlp/tools/tokenize/lattice/Morpheme.java | 29 +-
.../tools/tokenize/lattice/UnigramSegmenter.java | 79 +---
.../tools/tokenize/lattice/WhitespaceRuns.java | 65 +++
.../tools/tokenize/uax29/ExtendedPictographic.java | 91 ++--
.../tools/tokenize/uax29/WordBreakProperty.java | 109 ++---
.../tools/tokenize/uax29/WordSegmenter.java | 8 +
.../tools/tokenize/uax29/WordTokenizer.java | 14 +-
.../java/opennlp/tools/util/DictionaryCatalog.java | 28 +-
.../opennlp/tools/util/FilterObjectStream.java | 4 +-
.../java/opennlp/tools/util/ResourceInstaller.java | 28 +-
.../main/java/opennlp/tools/util/StringList.java | 3 +-
.../java/opennlp/tools/util/archive/TarStream.java | 9 +-
.../featuregen/AggregatedFeatureGenerator.java | 15 +-
.../tools/util/featuregen/InSpanGenerator.java | 7 +-
.../java/opennlp/tools/util/model/BaseModel.java | 17 +-
.../tools/util/model/GenericModelSerializer.java | 11 +-
.../java/opennlp/tools/util/model/ModelUtil.java | 6 +-
.../AccentFoldCharSequenceNormalizer.java | 12 +-
.../AggregateCharSequenceNormalizer.java | 6 +-
.../AlignedAggregateCharSequenceNormalizer.java | 4 +
.../tools/util/normalizer/BundledUnicodeData.java | 204 +++++++++
.../normalizer/CaseFoldCharSequenceNormalizer.java | 16 +-
.../ConfusableSkeletonCharSequenceNormalizer.java | 4 +-
.../opennlp/tools/util/normalizer/Confusables.java | 104 ++---
.../tools/util/normalizer/EmojiAnnotations.java | 105 +++--
.../normalizer/EmojiCharSequenceNormalizer.java | 4 +-
.../tools/util/normalizer/EmojiEmoticons.java | 97 ++--
.../EmojiToEmoticonCharSequenceNormalizer.java | 6 +-
.../EmoticonToEmojiCharSequenceNormalizer.java | 6 +-
.../FullCaseFoldCharSequenceNormalizer.java | 97 ++--
.../tools/util/normalizer/MailAddressScan.java | 4 +-
.../util/normalizer/NfcCharSequenceNormalizer.java | 4 +-
.../normalizer/NfkcCharSequenceNormalizer.java | 4 +-
.../util/normalizer/NormalizationProfile.java | 9 +-
.../util/normalizer/NormalizationProfiles.java | 13 +-
.../normalizer/NumberCharSequenceNormalizer.java | 4 +-
.../normalizer/ShrinkCharSequenceNormalizer.java | 4 +-
.../SocialMediaCharSequenceNormalizer.java | 4 +-
.../java/opennlp/tools/util/normalizer/Term.java | 13 +-
.../tools/util/normalizer/TermAnalyzer.java | 29 +-
.../tools/util/normalizer/TextNormalizer.java | 6 +-
.../util/normalizer/UnicodeEmojiSequences.java | 79 ++--
.../util/normalizer/UrlCharSequenceNormalizer.java | 4 +-
.../opennlp/tools/NullArgumentRejectionTest.java | 210 +++++++++
.../doccat/BagOfWordsFeatureGeneratorTest.java | 4 +-
.../opennlp/tools/doccat/DocumentSampleTest.java | 9 +
.../tools/doccat/NGramFeatureGeneratorTest.java | 4 +-
.../tools/langdetect/LanguageSampleTest.java | 4 +-
.../opennlp/tools/langdetect/LanguageTest.java | 4 +-
.../tools/namefind/NameFinderMEWithDatesTest.java | 2 +-
.../opennlp/tools/namefind/NameSampleTest.java | 7 +
.../opennlp/tools/tokenize/TokenSampleTest.java | 23 +
.../tokenize/TokenizerCharacterPolicyTest.java | 256 +++++++++++
.../tools/tokenize/WordpieceTokenizerTest.java | 11 +-
.../tokenize/lattice/LatticeTokenizerTest.java | 58 ++-
.../tokenize/lattice/UnigramSegmenterTest.java | 6 +-
.../util/normalizer/BundledUnicodeDataTest.java | 161 +++++++
.../CaseFoldCharSequenceNormalizerTest.java | 4 +-
opennlp-docs/src/docbkx/corpora.xml | 7 +-
opennlp-docs/src/docbkx/doccat.xml | 11 +-
opennlp-docs/src/docbkx/machine-learning.xml | 4 +-
opennlp-docs/src/docbkx/morfologik-addon.xml | 6 +
opennlp-docs/src/docbkx/namefinder.xml | 3 +
opennlp-docs/src/docbkx/spellcheck.xml | 14 +
opennlp-docs/src/docbkx/tokenizer.xml | 37 +-
.../opennlp/dl/namefinder/NameFinderDLEval.java | 98 ++--
.../java/opennlp/tools/eval/AbstractEvalTest.java | 29 ++
.../tools/eval/HunspellClassificationEval.java | 80 ++++
.../tools/eval/HunspellCompatibilityEval.java | 43 +-
.../tools/eval/MultiThreadedStemmerEval.java | 94 +++-
.../builder/MorfologikDictionaryBuilder.java | 14 +-
.../lemmatizer/MorfologikLemmatizer.java | 2 +
.../tagdict/MorfologikTagDictionary.java | 37 +-
.../opennlp/morfologik/AbstractMorfologikTest.java | 6 +-
.../MorfologikTagDictionaryConcurrencyTest.java | 94 ++++
.../tagdict/MorfologikTagDictionaryTest.java | 39 ++
...aryLocaleSafety.info => dictionaryTagless.info} | 0
.../src/test/resources/dictionaryTagless.txt | 2 +
.../main/java/opennlp/spellcheck/SpellChecker.java | 11 +-
.../main/java/opennlp/spellcheck/SuggestItem.java | 9 +-
.../dictionary/FrequencyDictionaryLoader.java | 15 +-
.../spellcheck/dictionary/SymSpellModel.java | 26 +-
.../dictionary/SymSpellModelResolver.java | 16 +-
.../spellcheck/dictionary/SymSpellModels.java | 18 +-
.../SpellCheckingCharSequenceNormalizer.java | 89 ++--
.../stream/SpellCorrectingObjectStream.java | 10 +-
.../stream/SpellCorrectingTokenStream.java | 12 +-
.../java/opennlp/spellcheck/symspell/SymSpell.java | 25 +-
.../spellcheck/symspell/SymSpellConfig.java | 6 +-
.../java/opennlp/spellcheck/SuggestItemTest.java | 4 +-
.../dictionary/FrequencyDictionaryLoaderTest.java | 18 +
.../dictionary/SymSpellModelResolverTest.java | 11 +
.../dictionary/SymSpellModelSerializationTest.java | 28 ++
.../SpellCheckingCharSequenceNormalizerTest.java | 60 +--
.../normalizer/SpellCheckingUnicodeCaseTest.java | 116 +++++
.../spellcheck/symspell/SymSpellCompoundTest.java | 2 +-
.../spellcheck/symspell/SymSpellConfigTest.java | 2 +-
.../spellcheck/symspell/SymSpellLookupTest.java | 14 +-
.../java/opennlp/uima/normalizer/NumberUtil.java | 7 +-
.../opennlp/uima/normalizer/NumberUtilTest.java | 26 +-
.../opennlp/tools/util/ObjectStreamUtilsTest.java | 21 +
.../tools/util/PlainTextByLineStreamTest.java | 9 +
.../tools/util/ext/ExtensionLoaderTest.java | 8 +-
pom.xml | 2 +-
255 files changed, 5710 insertions(+), 2577 deletions(-)
create mode 100644 opennlp-api/src/main/java/opennlp/tools/document/DocumentMerges.java
create mode 100644 opennlp-api/src/main/java/opennlp/tools/tokenize/MappedText.java
delete mode 100644 opennlp-api/src/main/java/opennlp/tools/util/ArgumentChecks.java
create mode 100644 opennlp-api/src/main/java/opennlp/tools/util/ParamChecks.java
create mode 100644 opennlp-api/src/test/java/opennlp/tools/tokenize/MappedTextTest.java
delete mode 100644 opennlp-api/src/test/java/opennlp/tools/util/ArgumentChecksTest.java
create mode 100644 opennlp-api/src/test/java/opennlp/tools/util/ParamChecksTest.java
create mode 100644 opennlp-core/opennlp-ml/opennlp-dl/src/test/resources/opennlp/dl/tokenizer.json
create mode 100644 opennlp-core/opennlp-runtime/src/main/java/opennlp/tools/tokenize/TokenizerCharacterPolicy.java
create mode 100644 opennlp-core/opennlp-runtime/src/main/java/opennlp/tools/tokenize/lattice/WhitespaceRuns.java
create mode 100644 opennlp-core/opennlp-runtime/src/main/java/opennlp/tools/util/normalizer/BundledUnicodeData.java
create mode 100644 opennlp-core/opennlp-runtime/src/test/java/opennlp/tools/NullArgumentRejectionTest.java
create mode 100644 opennlp-core/opennlp-runtime/src/test/java/opennlp/tools/tokenize/TokenizerCharacterPolicyTest.java
create mode 100644 opennlp-core/opennlp-runtime/src/test/java/opennlp/tools/util/normalizer/BundledUnicodeDataTest.java
create mode 100644 opennlp-eval-tests/src/test/java/opennlp/tools/eval/HunspellClassificationEval.java
create mode 100644 opennlp-extensions/opennlp-morfologik/src/test/java/opennlp/morfologik/tagdict/MorfologikTagDictionaryConcurrencyTest.java
copy opennlp-extensions/opennlp-morfologik/src/test/resources/{dictionaryLocaleSafety.info => dictionaryTagless.info} (100%)
create mode 100644 opennlp-extensions/opennlp-morfologik/src/test/resources/dictionaryTagless.txt
create mode 100644 opennlp-extensions/opennlp-spellcheck/src/test/java/opennlp/spellcheck/normalizer/SpellCheckingUnicodeCaseTest.java
(opennlp) 01/01: GH-1393: Cache the downloaded test models between CI runs
Posted by rz...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
rzo1 pushed a commit to branch fix/ci-cache-models
in repository https://gitbox.apache.org/repos/asf/opennlp.git
commit 3fc41b870c238f3fe88ef349e62e6a2e8bf6949b
Author: Kristian Rickert <kr...@apache.org>
AuthorDate: Sun Oct 4 05:02:21 2026 -0400
GH-1393: Cache the downloaded test models between CI runs
---
.github/workflows/maven.yml | 8 +++++++-
1 file changed, 7 insertions(+), 1 deletion(-)
diff --git a/.github/workflows/maven.yml b/.github/workflows/maven.yml
index 9b816c10c..288174f42 100644
--- a/.github/workflows/maven.yml
+++ b/.github/workflows/maven.yml
@@ -73,13 +73,19 @@ jobs:
key: ${{ runner.os }}-maven-${{ hashFiles('**/pom.xml') }}
restore-keys: |
${{ runner.os }}-maven-
+ # Test models are downloaded once and reused, so the build does not depend on the
+ # model host on every run. Change the key when the tests move to other models.
+ - uses: actions/cache@55cc8345863c7cc4c66a329aec7e433d2d1c52a9 # v6.1.0
+ with:
+ path: ~/.opennlp-ci
+ key: ${{ runner.os }}-opennlp-models-ud-1.3
- name: Set up JDK ${{ matrix.java }}
uses: actions/setup-java@de7274f081f381c8f8158605e0321c36c376e2e6 # v6.0.1
with:
distribution: temurin
java-version: ${{ matrix.java }}
- name: Build with Maven
- run: mvn -V clean test verify --show-version --batch-mode --no-transfer-progress -Pjacoco -Pci
+ run: mvn -V clean test verify --show-version --batch-mode --no-transfer-progress -Pjacoco -Pci "-Dopennlp.download.home=$HOME/.opennlp-ci"
- name: Jacoco
run: mvn jacoco:report
# The binary distribution is pure-Java and platform-independent, so we build it