You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@opennlp.apache.org by kr...@apache.org on 2026/10/04 02:28:47 UTC

(opennlp) branch OPENNLP-1982-embed-padding updated (9ca5e0385 -> 89205f1e6)

This is an automated email from the ASF dual-hosted git repository.

krickert pushed a change to branch OPENNLP-1982-embed-padding
in repository https://gitbox.apache.org/repos/asf/opennlp.git


    from 9ca5e0385 StringUtil.toUpperCase does not uppercase supplementary-plane letters (#1381)
     add 756e58ee8 GPU inference fails on the first CUDA request in a fresh JVM
     add 3d7395de4 SentenceVectorsDL cannot run on a GPU
     add 4cf8fb31a Cap the token positions of one embedAll inference
     add 89205f1e6 Add padding strategies for embedAll

No new revisions were added by this update.

Summary of changes:
 opennlp-core/opennlp-ml/opennlp-dl-gpu/pom.xml     |   7 +
 .../src/main/java/opennlp/dl/AbstractDL.java       |   8 +-
 .../dl/vectors/OnnxTextEmbedderProvider.java       |  42 +++-
 .../java/opennlp/dl/vectors/PaddingStrategy.java   |  57 +++++
 .../java/opennlp/dl/vectors/SentenceVectorsDL.java | 276 +++++++++++++++++++--
 .../opennlp/dl/AbstractDLColdStartCudaTest.java    |  67 +++++
 .../test/java/opennlp/dl/ColdStartCudaProbe.java   |  50 ++++
 .../dl/vectors/OnnxTextEmbedderProviderTest.java   |   3 +-
 .../dl/vectors/SentenceVectorsDLEmbedderTest.java  | 189 +++++++++++++-
 .../SentenceVectorsDLInferenceOptionsTest.java     | 120 +++++++++
 ...ny_pooled_model.py => gen_tiny_masked_model.py} |  24 +-
 .../vectors/{tiny-pooled.onnx => tiny-masked.onnx} | Bin 513 -> 603 bytes
 opennlp-docs/src/docbkx/machine-learning.xml       |  15 +-
 rat-excludes                                       |   1 +
 14 files changed, 818 insertions(+), 41 deletions(-)
 create mode 100644 opennlp-core/opennlp-ml/opennlp-dl/src/main/java/opennlp/dl/vectors/PaddingStrategy.java
 create mode 100644 opennlp-core/opennlp-ml/opennlp-dl/src/test/java/opennlp/dl/AbstractDLColdStartCudaTest.java
 create mode 100644 opennlp-core/opennlp-ml/opennlp-dl/src/test/java/opennlp/dl/ColdStartCudaProbe.java
 create mode 100644 opennlp-core/opennlp-ml/opennlp-dl/src/test/java/opennlp/dl/vectors/SentenceVectorsDLInferenceOptionsTest.java
 copy opennlp-core/opennlp-ml/opennlp-dl/src/test/resources/opennlp/dl/vectors/{gen_tiny_pooled_model.py => gen_tiny_masked_model.py} (77%)
 copy opennlp-core/opennlp-ml/opennlp-dl/src/test/resources/opennlp/dl/vectors/{tiny-pooled.onnx => tiny-masked.onnx} (72%)