You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by BELLINI ADAM <mb...@msn.com> on 2009/10/05 22:06:37 UTC
indexing just certain content
hi
does anybody know if it's possible to index just certain content ? i mean i need to dont index some garbage and repetitive data on my intranet.
in other way if it is possible to tell the indexer dont index the content between certain <div> tags
like:
<div id="bla bla">
plz dont index this bla bla bla
</div>
thx to all
_________________________________________________________________
New: Messenger sign-in on the MSN homepage
http://go.microsoft.com/?linkid=9677403
Re: indexing just certain content
Posted by Eric <er...@lakemeadonline.com>.
Look at the source code for the basic indexing plugin - it indexes the
title tags and some other tags: should be a good starting point.
Eric
On Oct 5, 2009, at 1:20 PM, BELLINI ADAM wrote:
>
> hi,
>
> but how will i get the HTML <div> tag ?
> is there any nutch method to get from the content the <div> tag ??
> thx
>
>
>
>
>> Subject: Re: indexing just certain content
>> From: eric@lakemeadonline.com
>> Date: Mon, 5 Oct 2009 13:09:17 -0700
>> To: nutch-user@lucene.apache.org
>>
>> Adam,
>>
>> You could turn off all the indexing plugins and write your own plugin
>> that only indexes certain meta content from your intranet - giving
>> you
>> complete control of the fields indexed.
>>
>> Eric
>>
>> On Oct 5, 2009, at 1:06 PM, BELLINI ADAM wrote:
>>
>>>
>>> hi
>>>
>>> does anybody know if it's possible to index just certain content ? i
>>> mean i need to dont index some garbage and repetitive data on my
>>> intranet.
>>>
>>> in other way if it is possible to tell the indexer dont index the
>>> content between certain <div> tags
>>> like:
>>>
>>> <div id="bla bla">
>>>
>>>
>>> plz dont index this bla bla bla
>>>
>>> </div>
>>>
>>> thx to all
>>>
>>> _________________________________________________________________
>>> New: Messenger sign-in on the MSN homepage
>>> http://go.microsoft.com/?linkid=9677403
>>
>
> _________________________________________________________________
> Click less, chat more: Messenger on MSN.ca
> http://go.microsoft.com/?linkid=9677404
RE: indexing just certain content
Posted by BELLINI ADAM <mb...@msn.com>.
hi,
but how will i get the HTML <div> tag ?
is there any nutch method to get from the content the <div> tag ??
thx
> Subject: Re: indexing just certain content
> From: eric@lakemeadonline.com
> Date: Mon, 5 Oct 2009 13:09:17 -0700
> To: nutch-user@lucene.apache.org
>
> Adam,
>
> You could turn off all the indexing plugins and write your own plugin
> that only indexes certain meta content from your intranet - giving you
> complete control of the fields indexed.
>
> Eric
>
> On Oct 5, 2009, at 1:06 PM, BELLINI ADAM wrote:
>
> >
> > hi
> >
> > does anybody know if it's possible to index just certain content ? i
> > mean i need to dont index some garbage and repetitive data on my
> > intranet.
> >
> > in other way if it is possible to tell the indexer dont index the
> > content between certain <div> tags
> > like:
> >
> > <div id="bla bla">
> >
> >
> > plz dont index this bla bla bla
> >
> > </div>
> >
> > thx to all
> >
> > _________________________________________________________________
> > New: Messenger sign-in on the MSN homepage
> > http://go.microsoft.com/?linkid=9677403
>
_________________________________________________________________
Click less, chat more: Messenger on MSN.ca
http://go.microsoft.com/?linkid=9677404
Re: indexing just certain content
Posted by Eric <er...@lakemeadonline.com>.
Adam,
You could turn off all the indexing plugins and write your own plugin
that only indexes certain meta content from your intranet - giving you
complete control of the fields indexed.
Eric
On Oct 5, 2009, at 1:06 PM, BELLINI ADAM wrote:
>
> hi
>
> does anybody know if it's possible to index just certain content ? i
> mean i need to dont index some garbage and repetitive data on my
> intranet.
>
> in other way if it is possible to tell the indexer dont index the
> content between certain <div> tags
> like:
>
> <div id="bla bla">
>
>
> plz dont index this bla bla bla
>
> </div>
>
> thx to all
>
> _________________________________________________________________
> New: Messenger sign-in on the MSN homepage
> http://go.microsoft.com/?linkid=9677403