You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@lucene.apache.org by dw...@apache.org on 2025/08/25 06:56:57 UTC
(lucene) branch main updated: Fix incorrect attribute comment in StandardTokenizer (#15121)
This is an automated email from the ASF dual-hosted git repository.
dweiss pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/lucene.git
The following commit(s) were added to refs/heads/main by this push:
new ec369d070b2 Fix incorrect attribute comment in StandardTokenizer (#15121)
ec369d070b2 is described below
commit ec369d070b23af0072ea8722787f8a0b198b2741
Author: Luis Negrin <51...@users.noreply.github.com>
AuthorDate: Mon Aug 25 02:56:52 2025 -0400
Fix incorrect attribute comment in StandardTokenizer (#15121)
---
.../java/org/apache/lucene/analysis/standard/StandardTokenizer.java | 4 ++--
1 file changed, 2 insertions(+), 2 deletions(-)
diff --git a/lucene/core/src/java/org/apache/lucene/analysis/standard/StandardTokenizer.java b/lucene/core/src/java/org/apache/lucene/analysis/standard/StandardTokenizer.java
index 3885894b2cf..3c1a673d753 100644
--- a/lucene/core/src/java/org/apache/lucene/analysis/standard/StandardTokenizer.java
+++ b/lucene/core/src/java/org/apache/lucene/analysis/standard/StandardTokenizer.java
@@ -135,8 +135,8 @@ public final class StandardTokenizer extends Tokenizer {
this.scanner = new StandardTokenizerImpl(input);
}
- // this tokenizer generates three attributes:
- // term offset, positionIncrement and type
+ // this tokenizer generates four attributes:
+ // term, offset, positionIncrement and type
private final CharTermAttribute termAtt = addAttribute(CharTermAttribute.class);
private final OffsetAttribute offsetAtt = addAttribute(OffsetAttribute.class);
private final PositionIncrementAttribute posIncrAtt =