You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@nutch.apache.org by Srinivas Gokavarapu <sr...@gmail.com> on 2010/04/28 13:34:53 UTC

Problem with Standard analyzer

Hi,

I have faced a problem which tokenizing text using standard analyzer. When I
am trying to tokenize the string "internet,art,3d,avatar,portraits"
using StandardAnalyzer the tokens I got are
internet
art,3d,avatar
portraits

I expected it to be 5 different words. Is this a bug in the analyzer ?? Has
anyone faced this kind of a problem in working with standard analyzer.

-- 
G.R.J.Srinivas
OBH 62
IIIT Hyderabad
9492756712