You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-user@hadoop.apache.org by Michael Bieniosek <mi...@powerset.com> on 2007/08/16 22:31:55 UTC

Is mapred-default.xml read for dfs config?

The wiki page http://wiki.apache.org/lucene-hadoop/HowToConfigure implies
that mapred-default.xml is read for the dfs configuration, as well as for
mapreduce jobs.  But this doesn't appear to be true based on the code, as
the string "mapred-default.xml" only appears in the mapred package.

So in fact, the configuration for the dfs is just

hadoop-default.xml
hadoop-site.xml

Whereas the configuration for mapred is

hadoop-default.xml
mapred-default.xml
job.xml
hadoop-site.xml

Is this correct?

Thanks,
Michael

Re: Is mapred-default.xml read for dfs config?

Posted by Doug Cutting <cu...@apache.org>.

Yes, that sounds correct.  However it will probably change in 0.15, 
since so many folks have found it confusing.  Exactly how it will change 
is still a matter of open debate.

https://issues.apache.org/jira/browse/HADOOP-785

Doug

Michael Bieniosek wrote:
> The wiki page http://wiki.apache.org/lucene-hadoop/HowToConfigure implies
> that mapred-default.xml is read for the dfs configuration, as well as for
> mapreduce jobs.  But this doesn't appear to be true based on the code, as
> the string "mapred-default.xml" only appears in the mapred package.
> 
> So in fact, the configuration for the dfs is just
> 
> hadoop-default.xml
> hadoop-site.xml
> 
> Whereas the configuration for mapred is
> 
> hadoop-default.xml
> mapred-default.xml
> job.xml
> hadoop-site.xml
> 
> Is this correct?
> 
> Thanks,
> Michael
>