You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@opennlp.apache.org by kr...@apache.org on 2026/08/16 01:28:57 UTC
(opennlp) branch OPENNLP-1833-grpc-helper updated (8dc087064 -> b220f73ff)
This is an automated email from the ASF dual-hosted git repository.
krickert pushed a change to branch OPENNLP-1833-grpc-helper
in repository https://gitbox.apache.org/repos/asf/opennlp.git
from 8dc087064 Set version to 3.0.0-OPENNLP-1833-SNAPSHOT for the gRPC sandbox build
add dc3877169 OPENNLP-1897: Add a term vector layer rolling tokens up to (term, frequency, offsets)
add 448d1dc65 OPENNLP-1897: Address review: fold the constructor chain, split aggregation by mode
add b34415881 OPENNLP-1897: Document the term vector layer with a mirror-tested example
add 72889e74b OPENNLP-1897: Accept a plain per-token normalizer for term identity
add b306b6a89 OPENNLP-1897: Document the normalized-term workflow with a mirror-tested example
add 9829831e0 OPENNLP-1897: Review round: reject null span elements, finalize the annotator, share the space-split test fixture, pin supplementary-plane offsets
new b220f73ff Merge PR #1212 (OPENNLP-1897 term vectors) into the gRPC helper base
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../java/opennlp/tools/termvector/TermVector.java | 117 ++++++
.../tools/termvector/TermVectorAnnotator.java | 312 ++++++++++++++++
.../tools/termvector/SingleSpaceTokens.java | 90 +++++
.../tools/termvector/TermVectorAnnotatorTest.java | 416 +++++++++++++++++++++
.../tools/termvector/TermVectorPipelineTest.java | 109 ++++++
.../opennlp/tools/termvector/TermVectorTest.java | 105 ++++++
.../TermVectorNormalizedExampleTest.java | 69 ++++
opennlp-docs/src/docbkx/document.xml | 55 +++
8 files changed, 1273 insertions(+)
create mode 100644 opennlp-api/src/main/java/opennlp/tools/termvector/TermVector.java
create mode 100644 opennlp-api/src/main/java/opennlp/tools/termvector/TermVectorAnnotator.java
create mode 100644 opennlp-api/src/test/java/opennlp/tools/termvector/SingleSpaceTokens.java
create mode 100644 opennlp-api/src/test/java/opennlp/tools/termvector/TermVectorAnnotatorTest.java
create mode 100644 opennlp-api/src/test/java/opennlp/tools/termvector/TermVectorPipelineTest.java
create mode 100644 opennlp-api/src/test/java/opennlp/tools/termvector/TermVectorTest.java
create mode 100644 opennlp-core/opennlp-runtime/src/test/java/opennlp/tools/termvector/TermVectorNormalizedExampleTest.java
(opennlp) 01/01: Merge PR #1212 (OPENNLP-1897 term vectors) into the gRPC helper base
Posted by kr...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
krickert pushed a commit to branch OPENNLP-1833-grpc-helper
in repository https://gitbox.apache.org/repos/asf/opennlp.git
commit b220f73ff24ebd6b675e9b4b09f6ff705ac798bc
Merge: 8dc087064 9829831e0
Author: Kristian Rickert <kr...@gmail.com>
AuthorDate: Sat Aug 15 21:24:59 2026 -0400
Merge PR #1212 (OPENNLP-1897 term vectors) into the gRPC helper base
.../java/opennlp/tools/termvector/TermVector.java | 117 ++++++
.../tools/termvector/TermVectorAnnotator.java | 312 ++++++++++++++++
.../tools/termvector/SingleSpaceTokens.java | 90 +++++
.../tools/termvector/TermVectorAnnotatorTest.java | 416 +++++++++++++++++++++
.../tools/termvector/TermVectorPipelineTest.java | 109 ++++++
.../opennlp/tools/termvector/TermVectorTest.java | 105 ++++++
.../TermVectorNormalizedExampleTest.java | 69 ++++
opennlp-docs/src/docbkx/document.xml | 55 +++
8 files changed, 1273 insertions(+)