You are viewing a plain text version of this content. The canonical link for it is here.

Posted to java-user@lucene.apache.org by Hans Merkl <hm...@rightonpoint.us> on 2010/06/08 13:41:57 UTC

Re: Are there any tokenizers that ignore HTML tags but keep the offsets so they can be used for highlighting in the original document?

Hi Ahmet,

I am using Lucene.NET with C# so I can't test this quickly.
Will HTMLStripCharFilter maintain the character offsets or does it just
extract the plain text?

Hans


> You can use org.apache.solr.analysis.HTMLStripCharFilter. It is possible to
> add one or more org.apache.lucene.analysis.CharFilter(s) before tokenizer in
> your analyzer.
>
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
>
>

RE: Are there any tokenizers that ignore HTML tags but keep the offsets so they can be used for highlighting in the original document?

Posted by Uwe Schindler <uw...@thetaphi.de>.

> Hi Ahmet,
> 
> I am using Lucene.NET with C# so I can't test this quickly.
> Will HTMLStripCharFilter maintain the character offsets or does it just
extract
> the plain text?

Yes the CharFilter does this!

Uwe


---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org