You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@lucene.apache.org by dw...@apache.org on 2025/08/25 06:56:57 UTC

(lucene) branch main updated: Fix incorrect attribute comment in StandardTokenizer (#15121)

This is an automated email from the ASF dual-hosted git repository.

dweiss pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/lucene.git


The following commit(s) were added to refs/heads/main by this push:
     new ec369d070b2 Fix incorrect attribute comment in StandardTokenizer (#15121)
ec369d070b2 is described below

commit ec369d070b23af0072ea8722787f8a0b198b2741
Author: Luis Negrin <51...@users.noreply.github.com>
AuthorDate: Mon Aug 25 02:56:52 2025 -0400

    Fix incorrect attribute comment in StandardTokenizer (#15121)
---
 .../java/org/apache/lucene/analysis/standard/StandardTokenizer.java   | 4 ++--
 1 file changed, 2 insertions(+), 2 deletions(-)

diff --git a/lucene/core/src/java/org/apache/lucene/analysis/standard/StandardTokenizer.java b/lucene/core/src/java/org/apache/lucene/analysis/standard/StandardTokenizer.java
index 3885894b2cf..3c1a673d753 100644
--- a/lucene/core/src/java/org/apache/lucene/analysis/standard/StandardTokenizer.java
+++ b/lucene/core/src/java/org/apache/lucene/analysis/standard/StandardTokenizer.java
@@ -135,8 +135,8 @@ public final class StandardTokenizer extends Tokenizer {
     this.scanner = new StandardTokenizerImpl(input);
   }
 
-  // this tokenizer generates three attributes:
-  // term offset, positionIncrement and type
+  // this tokenizer generates four attributes:
+  // term, offset, positionIncrement and type
   private final CharTermAttribute termAtt = addAttribute(CharTermAttribute.class);
   private final OffsetAttribute offsetAtt = addAttribute(OffsetAttribute.class);
   private final PositionIncrementAttribute posIncrAtt =