You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@opennlp.apache.org by jk...@apache.org on 2014/03/22 05:13:26 UTC
svn commit: r1580155 -
/opennlp/trunk/opennlp-tools/src/main/java/opennlp/tools/tokenize/lang/en/TokenSampleStream.java
Author: jkosin
Date: Sat Mar 22 04:13:26 2014
New Revision: 1580155
URL: http://svn.apache.org/r1580155
Log:
OPENNLP-669 Fixed < and > usage with < and >
Modified:
opennlp/trunk/opennlp-tools/src/main/java/opennlp/tools/tokenize/lang/en/TokenSampleStream.java
Modified: opennlp/trunk/opennlp-tools/src/main/java/opennlp/tools/tokenize/lang/en/TokenSampleStream.java
URL: http://svn.apache.org/viewvc/opennlp/trunk/opennlp-tools/src/main/java/opennlp/tools/tokenize/lang/en/TokenSampleStream.java?rev=1580155&r1=1580154&r2=1580155&view=diff
==============================================================================
--- opennlp/trunk/opennlp-tools/src/main/java/opennlp/tools/tokenize/lang/en/TokenSampleStream.java (original)
+++ opennlp/trunk/opennlp-tools/src/main/java/opennlp/tools/tokenize/lang/en/TokenSampleStream.java Sat Mar 22 04:13:26 2014
@@ -30,7 +30,7 @@ import opennlp.tools.tokenize.TokenSampl
import opennlp.tools.util.Span;
/**
- * Class which produces an Iterator<TokenSample> from a file of space delimited token.
+ * Class which produces an Iterator<TokenSample> from a file of space delimited token.
* This class uses a number of English-specific heuristics to un-separate tokens which
* are typically found together in text.
*/