You are viewing a plain text version of this content. The canonical link for it is here.
Posted to general@hadoop.apache.org by Evert Lammerts <Ev...@sara.nl> on 2010/11/11 10:42:46 UTC

CDH3 / 0.20 config

Hi all,

Can I use these pages as a reference for configuration? Are they not
outdated for / ahead of version 0.20? 

core-site.xml:
http://hadoop.apache.org/common/docs/current/core-default.html
hdfs-site.xml: http://hadoop.apache.org/hdfs/docs/current/hdfs-default.html
mapred-site.xml:
http://hadoop.apache.org/mapreduce/docs/current/mapred-default.html

Are there any such pages for other config files? (fair- /
capacity-scheduler, hadoop-policy, mapred-queue-acls)

A good configuration overview is lacking at the moment, as far as I can see.
If time permits, I might provide one for 0.20.

Cheers,

Evert Lammerts
Consultant eScience Support
SARA Computing & Network Services 
High Performance Computing & Visualization

Phone: +31 20 888 4101
Email: evert.lammerts@sara.nl
http://www.sara.nl

Re: CDH3 / 0.20 config

Posted by Eli Collins <el...@cloudera.com>.
On Thu, Nov 11, 2010 at 1:42 AM, Evert Lammerts <Ev...@sara.nl>wrote:

> Hi all,
>
> Can I use these pages as a reference for configuration? Are they not
> outdated for / ahead of version 0.20?
>
> core-site.xml:
> http://hadoop.apache.org/common/docs/current/core-default.html
> hdfs-site.xml:
> http://hadoop.apache.org/hdfs/docs/current/hdfs-default.html
> mapred-site.xml:
> http://hadoop.apache.org/mapreduce/docs/current/mapred-default.html
>
> Are there any such pages for other config files? (fair- /
> capacity-scheduler, hadoop-policy, mapred-queue-acls)
>
>
These are in the docs, eg
http://hadoop.apache.org/common/docs/r0.20.2/service_level_auth.html
http://hadoop.apache.org/common/docs/r0.20.2/fair_scheduler.html
http://hadoop.apache.org/common/docs/r0.20.2/capacity_scheduler.html

A good configuration overview is lacking at the moment, as far as I can see.
> If time permits, I might provide one for 0.20.
>

That would be great.

Thanks,
Eli


>
> Cheers,
>
> Evert Lammerts
> Consultant eScience Support
> SARA Computing & Network Services
> High Performance Computing & Visualization
>
> Phone: +31 20 888 4101
> Email: evert.lammerts@sara.nl
> http://www.sara.nl
>
>
>

Re: CDH3 / 0.20 config

Posted by Harsh J <qw...@gmail.com>.
On Thu, Nov 11, 2010 at 3:44 PM, Evert Lammerts <Ev...@sara.nl> wrote:
>> hdfs-site.xml:
>> http://hadoop.apache.org/hdfs/docs/r0.20.2/hdfs-default.html
>> mapred-site.xml:
>> http://hadoop.apache.org/mapreduce/docs/r0.20.0/mapred-default.html
>
> These two don't exist. With r0.21 the URLs do work, but is that info valid
> for 0.20?

Oops, forgot that the split happened later. These should work fine,
and apply properly to 0.20.2:
http://hadoop.apache.org/common/docs/r0.20.2/hdfs-default.html
http://hadoop.apache.org/common/docs/r0.20.2/mapred-default.html

r0.21 is a minor release, so using their config page should be okay
too. I do not know how many new props have been added though.

>
> Cheers, Evert
>



-- 
Harsh J
www.harshj.com

RE: CDH3 / 0.20 config

Posted by Evert Lammerts <Ev...@sara.nl>.
> hdfs-site.xml:
> http://hadoop.apache.org/hdfs/docs/r0.20.2/hdfs-default.html
> mapred-site.xml:
> http://hadoop.apache.org/mapreduce/docs/r0.20.0/mapred-default.html

These two don't exist. With r0.21 the URLs do work, but is that info valid
for 0.20?

Cheers, Evert

Re: CDH3 / 0.20 config

Posted by Harsh J <qw...@gmail.com>.
Hello,

On Thu, Nov 11, 2010 at 3:12 PM, Evert Lammerts <Ev...@sara.nl> wrote:
> Hi all,
>
> Can I use these pages as a reference for configuration? Are they not
> outdated for / ahead of version 0.20?
>
> core-site.xml:
> http://hadoop.apache.org/common/docs/current/core-default.html
> hdfs-site.xml: http://hadoop.apache.org/hdfs/docs/current/hdfs-default.html
> mapred-site.xml:
> http://hadoop.apache.org/mapreduce/docs/current/mapred-default.html

For 0.20.2, see these specific urls:
core-site.xml:
http://hadoop.apache.org/common/docs/r0.20.2/core-default.html
hdfs-site.xml:
http://hadoop.apache.org/hdfs/docs/r0.20.2/hdfs-default.html
mapred-site.xml:
http://hadoop.apache.org/mapreduce/docs/r0.20.0/mapred-default.html

In trunk, many of these properties have been renamed, and their former
counterparts deprecated.

-- 
Harsh J
www.harshj.com