You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by ot...@apache.org on 2002/06/05 06:54:47 UTC

cvs commit: jakarta-lucene/src/java/org/apache/lucene/analysis/standard StandardTokenizer.jj

otis        2002/06/04 21:54:47

  Modified:    src/java/org/apache/lucene/analysis/standard
                        StandardTokenizer.jj
  Log:
  - Changed the grammar for EMAIL token in order to match user names and
    host names with additional valid user name and host name characters, such
    as '.", '-', and '_'.
  
  Revision  Changes    Path
  1.3       +1 -1      jakarta-lucene/src/java/org/apache/lucene/analysis/standard/StandardTokenizer.jj
  
  Index: StandardTokenizer.jj
  ===================================================================
  RCS file: /home/cvs/jakarta-lucene/src/java/org/apache/lucene/analysis/standard/StandardTokenizer.jj,v
  retrieving revision 1.2
  retrieving revision 1.3
  diff -u -r1.2 -r1.3
  --- StandardTokenizer.jj	25 Sep 2001 18:38:50 -0000	1.2
  +++ StandardTokenizer.jj	5 Jun 2002 04:54:47 -0000	1.3
  @@ -103,7 +103,7 @@
   | <COMPANY: <ALPHA> ("&"|"@") <ALPHA> >
   
     // email addresses
  -| <EMAIL: <ALPHANUM> "@" <ALPHANUM> ("." <ALPHANUM>)+ >
  +| <EMAIL: <ALPHANUM> ("."|"-"|"_" <ALPHANUM>)+ "@" <ALPHANUM> ("."|"-" <ALPHANUM>)+ >
   
     // hostname
   | <HOST: <ALPHANUM> ("." <ALPHANUM>)+ >
  
  
  

--
To unsubscribe, e-mail:   <ma...@jakarta.apache.org>
For additional commands, e-mail: <ma...@jakarta.apache.org>