You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@nutch.apache.org by Christopher Laux <ct...@googlemail.com> on 2010/10/04 17:48:24 UTC

Hadoop compression

Hi all,

I have a fundamental question about compressing the segments nutch
produces: is it switched on by default or how can I switch it on if
needed? I can only find general documentation about turning
compression on for Hadoop, but there is no hadoop-site.xml in
nutch/conf ?

Thanks,
Chris

Re: Hadoop compression

Posted by Julien Nioche <li...@gmail.com>.

Hi Chris,

You can create your own hadoop site files in conf/ to specify that, Nutch
will use them.

Julien

-- 
*
*Open Source Solutions for Text Engineering

http://digitalpebble.blogspot.com/
http://www.digitalpebble.com

On 4 October 2010 16:48, Christopher Laux <ct...@googlemail.com> wrote:

> Hi all,
>
> I have a fundamental question about compressing the segments nutch
> produces: is it switched on by default or how can I switch it on if
> needed? I can only find general documentation about turning
> compression on for Hadoop, but there is no hadoop-site.xml in
> nutch/conf ?
>
> Thanks,
> Chris
>