regex-normalize.xml

[Michael Weber <m....@olserv.de>]

Hi,

to get regex-normalize.xml to work i must put:

<property>
   <name>urlnormalizer.class</name>
   <value>org.apache.nutch.net.RegexUrlNormalizer</value>
   <description>Name of the class used to normalize URLs.</description>
</property>

<property>
   <name>urlnormalizer.regex.file</name>
   <value>regex-normalize.xml</value>
   <description>Name of the config file used by the RegexUrlNormalizer 
class.</description>
</property>

in nutch-site.xml

In nutch-default.xml there is set:

<property>
   <name>urlnormalizer.class</name>
   <value>org.apache.nutch.net.BasicUrlNormalizer</value>
   <description>Name of the class used to normalize URLs.</description>
</property>

Is this a bug or a feature? =)

Greetings

Michael

http://www.nutch-wiki.de

Re: regex-normalize.xml

[Jérôme Charron <je...@gmail.com>]

> 
> i think i expressed it wrong. The Question was if its a feature or a bug
> that regex-normalize.xml is used only after this changes.

the regex-normalize.xml is used only after you specify that you want to use 
the RegexUrlNormalizer implementation. So it is used only if you specify 
urlnormalizer.class=org.apache.nutch.net.RegexUrlNormalizer.
But it must also works if you remove the urlnormalizer.class = 
org.apache.nutch.net.BasicUrlNormalizer int the nutch-default.

Regards

Jérôme


-- 
http://motrech.free.fr/
http://www.frutch.org/

nutch excerpt

[Michael Ji <fj...@yahoo.com>]

hi,

There is a class Summarizer to accept a text string
and generate summary for the hits page.

My question is:

1)
Where the raw text string from? Open db file in
segment/content/?

2)
I guess some code must call Summarizer.main to trigger
it, but I didn't find which code does that.

thanks,

Michael Ji

__________________________________________________
Do You Yahoo!?
Tired of spam?  Yahoo! Mail has the best spam protection around 
http://mail.yahoo.com 

Re: regex-normalize.xml

[Michael Weber <m....@olserv.de>]

Hi Jérôme,

i think i expressed it wrong. The Question was if its a feature or a bug 
that regex-normalize.xml is used only after this changes.

Regards

Michael

Jérôme Charron schrieb:
>>to get regex-normalize.xml to work i must put:
>>in nutch-site.xml
>>In nutch-default.xml there is set:
>>Is this a bug or a feature? =)
> 
> 
> nutch-site.xml overrides properties defined in nutch-default. So:
> * If you remove urlnormalizer.class property from nutch-default it must 
> still uses the one defined in nutch-site
> * If you remove urlnormalizer.class property from nutch-site it must use the 
> one defined in nutch-default
> * ...
> (if it works another way it is a bug, otherwise, the feature is to uses 
> nutch-site first, then nutch-default if some properties are not defined in 
> nutch-site).
> 
> Regards
> 
> Jérôme
> 
> 

Re: regex-normalize.xml

[Jérôme Charron <je...@gmail.com>]

> 
> to get regex-normalize.xml to work i must put:
> in nutch-site.xml
> In nutch-default.xml there is set:
> Is this a bug or a feature? =)

nutch-site.xml overrides properties defined in nutch-default. So:
* If you remove urlnormalizer.class property from nutch-default it must 
still uses the one defined in nutch-site
* If you remove urlnormalizer.class property from nutch-site it must use the 
one defined in nutch-default
* ...
(if it works another way it is a bug, otherwise, the feature is to uses 
nutch-site first, then nutch-default if some properties are not defined in 
nutch-site).

Regards

Jérôme


-- 
http://motrech.free.fr/
http://www.frutch.org/