You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@opennlp.apache.org by kr...@apache.org on 2026/10/04 02:28:47 UTC
(opennlp) branch OPENNLP-1982-embed-padding updated (9ca5e0385 -> 89205f1e6)
This is an automated email from the ASF dual-hosted git repository.
krickert pushed a change to branch OPENNLP-1982-embed-padding
in repository https://gitbox.apache.org/repos/asf/opennlp.git
from 9ca5e0385 StringUtil.toUpperCase does not uppercase supplementary-plane letters (#1381)
add 756e58ee8 GPU inference fails on the first CUDA request in a fresh JVM
add 3d7395de4 SentenceVectorsDL cannot run on a GPU
add 4cf8fb31a Cap the token positions of one embedAll inference
add 89205f1e6 Add padding strategies for embedAll
No new revisions were added by this update.
Summary of changes:
opennlp-core/opennlp-ml/opennlp-dl-gpu/pom.xml | 7 +
.../src/main/java/opennlp/dl/AbstractDL.java | 8 +-
.../dl/vectors/OnnxTextEmbedderProvider.java | 42 +++-
.../java/opennlp/dl/vectors/PaddingStrategy.java | 57 +++++
.../java/opennlp/dl/vectors/SentenceVectorsDL.java | 276 +++++++++++++++++++--
.../opennlp/dl/AbstractDLColdStartCudaTest.java | 67 +++++
.../test/java/opennlp/dl/ColdStartCudaProbe.java | 50 ++++
.../dl/vectors/OnnxTextEmbedderProviderTest.java | 3 +-
.../dl/vectors/SentenceVectorsDLEmbedderTest.java | 189 +++++++++++++-
.../SentenceVectorsDLInferenceOptionsTest.java | 120 +++++++++
...ny_pooled_model.py => gen_tiny_masked_model.py} | 24 +-
.../vectors/{tiny-pooled.onnx => tiny-masked.onnx} | Bin 513 -> 603 bytes
opennlp-docs/src/docbkx/machine-learning.xml | 15 +-
rat-excludes | 1 +
14 files changed, 818 insertions(+), 41 deletions(-)
create mode 100644 opennlp-core/opennlp-ml/opennlp-dl/src/main/java/opennlp/dl/vectors/PaddingStrategy.java
create mode 100644 opennlp-core/opennlp-ml/opennlp-dl/src/test/java/opennlp/dl/AbstractDLColdStartCudaTest.java
create mode 100644 opennlp-core/opennlp-ml/opennlp-dl/src/test/java/opennlp/dl/ColdStartCudaProbe.java
create mode 100644 opennlp-core/opennlp-ml/opennlp-dl/src/test/java/opennlp/dl/vectors/SentenceVectorsDLInferenceOptionsTest.java
copy opennlp-core/opennlp-ml/opennlp-dl/src/test/resources/opennlp/dl/vectors/{gen_tiny_pooled_model.py => gen_tiny_masked_model.py} (77%)
copy opennlp-core/opennlp-ml/opennlp-dl/src/test/resources/opennlp/dl/vectors/{tiny-pooled.onnx => tiny-masked.onnx} (72%)