You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-user@hadoop.apache.org by Panshul Whisper <ou...@gmail.com> on 2013/01/15 22:45:41 UTC

config file loactions in Hadoop 2.0.2

Hello,

I was setting up Hadoop 2.0.2.
Since I have already setup Hadoop 1.0.x so i have a fair idea where are all
the files and what to put in each of them.
In case of Hadoop 2.0.2, the config files have been moved to [hadoop
install directory]/etc/hadoop
but I still cannot find
capacity-scheduler.xml
masters  - for listing master nodes

Please help me setup this version.

Thanking You,

-- 
Regards,
Ouch Whisper
010101010101

Re: config file loactions in Hadoop 2.0.2

Posted by Harsh J <ha...@cloudera.com>.
The masters file was removed cause we now look into config files directly
and pull out the right host to start the various configured master servers
(NNs, SNN, etc.) at.


On Wed, Jan 16, 2013 at 9:56 AM, Hemanth Yamijala <yhemanth@thoughtworks.com
> wrote:

> Hi,
>
> One place where I could find the capacity-scheduler.xml was from source -
> hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/resources.
>
> AFAIK, the masters file is only used for starting the secondary namenode -
> which has in 2.x been replaced by a proper HA solution. So, I think there
> is no need for this file anymore. Please refer to this link for more
> details on the HA solution:
> http://hadoop.apache.org/docs/r2.0.2-alpha/hadoop-yarn/hadoop-yarn-site/HDFSHighAvailability.html
>
> Thanks
> hemanth
>
>
> On Wed, Jan 16, 2013 at 3:15 AM, Panshul Whisper <ou...@gmail.com>wrote:
>
>> Hello,
>>
>> I was setting up Hadoop 2.0.2.
>> Since I have already setup Hadoop 1.0.x so i have a fair idea where are
>> all the files and what to put in each of them.
>> In case of Hadoop 2.0.2, the config files have been moved to [hadoop
>> install directory]/etc/hadoop
>> but I still cannot find
>> capacity-scheduler.xml
>> masters  - for listing master nodes
>>
>> Please help me setup this version.
>>
>> Thanking You,
>>
>> --
>> Regards,
>> Ouch Whisper
>> 010101010101
>>
>
>


-- 
Harsh J

Re: config file loactions in Hadoop 2.0.2

Posted by Harsh J <ha...@cloudera.com>.
The masters file was removed cause we now look into config files directly
and pull out the right host to start the various configured master servers
(NNs, SNN, etc.) at.


On Wed, Jan 16, 2013 at 9:56 AM, Hemanth Yamijala <yhemanth@thoughtworks.com
> wrote:

> Hi,
>
> One place where I could find the capacity-scheduler.xml was from source -
> hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/resources.
>
> AFAIK, the masters file is only used for starting the secondary namenode -
> which has in 2.x been replaced by a proper HA solution. So, I think there
> is no need for this file anymore. Please refer to this link for more
> details on the HA solution:
> http://hadoop.apache.org/docs/r2.0.2-alpha/hadoop-yarn/hadoop-yarn-site/HDFSHighAvailability.html
>
> Thanks
> hemanth
>
>
> On Wed, Jan 16, 2013 at 3:15 AM, Panshul Whisper <ou...@gmail.com>wrote:
>
>> Hello,
>>
>> I was setting up Hadoop 2.0.2.
>> Since I have already setup Hadoop 1.0.x so i have a fair idea where are
>> all the files and what to put in each of them.
>> In case of Hadoop 2.0.2, the config files have been moved to [hadoop
>> install directory]/etc/hadoop
>> but I still cannot find
>> capacity-scheduler.xml
>> masters  - for listing master nodes
>>
>> Please help me setup this version.
>>
>> Thanking You,
>>
>> --
>> Regards,
>> Ouch Whisper
>> 010101010101
>>
>
>


-- 
Harsh J

Re: config file loactions in Hadoop 2.0.2

Posted by Harsh J <ha...@cloudera.com>.
The masters file was removed cause we now look into config files directly
and pull out the right host to start the various configured master servers
(NNs, SNN, etc.) at.


On Wed, Jan 16, 2013 at 9:56 AM, Hemanth Yamijala <yhemanth@thoughtworks.com
> wrote:

> Hi,
>
> One place where I could find the capacity-scheduler.xml was from source -
> hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/resources.
>
> AFAIK, the masters file is only used for starting the secondary namenode -
> which has in 2.x been replaced by a proper HA solution. So, I think there
> is no need for this file anymore. Please refer to this link for more
> details on the HA solution:
> http://hadoop.apache.org/docs/r2.0.2-alpha/hadoop-yarn/hadoop-yarn-site/HDFSHighAvailability.html
>
> Thanks
> hemanth
>
>
> On Wed, Jan 16, 2013 at 3:15 AM, Panshul Whisper <ou...@gmail.com>wrote:
>
>> Hello,
>>
>> I was setting up Hadoop 2.0.2.
>> Since I have already setup Hadoop 1.0.x so i have a fair idea where are
>> all the files and what to put in each of them.
>> In case of Hadoop 2.0.2, the config files have been moved to [hadoop
>> install directory]/etc/hadoop
>> but I still cannot find
>> capacity-scheduler.xml
>> masters  - for listing master nodes
>>
>> Please help me setup this version.
>>
>> Thanking You,
>>
>> --
>> Regards,
>> Ouch Whisper
>> 010101010101
>>
>
>


-- 
Harsh J

Re: config file loactions in Hadoop 2.0.2

Posted by Harsh J <ha...@cloudera.com>.
The masters file was removed cause we now look into config files directly
and pull out the right host to start the various configured master servers
(NNs, SNN, etc.) at.


On Wed, Jan 16, 2013 at 9:56 AM, Hemanth Yamijala <yhemanth@thoughtworks.com
> wrote:

> Hi,
>
> One place where I could find the capacity-scheduler.xml was from source -
> hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/resources.
>
> AFAIK, the masters file is only used for starting the secondary namenode -
> which has in 2.x been replaced by a proper HA solution. So, I think there
> is no need for this file anymore. Please refer to this link for more
> details on the HA solution:
> http://hadoop.apache.org/docs/r2.0.2-alpha/hadoop-yarn/hadoop-yarn-site/HDFSHighAvailability.html
>
> Thanks
> hemanth
>
>
> On Wed, Jan 16, 2013 at 3:15 AM, Panshul Whisper <ou...@gmail.com>wrote:
>
>> Hello,
>>
>> I was setting up Hadoop 2.0.2.
>> Since I have already setup Hadoop 1.0.x so i have a fair idea where are
>> all the files and what to put in each of them.
>> In case of Hadoop 2.0.2, the config files have been moved to [hadoop
>> install directory]/etc/hadoop
>> but I still cannot find
>> capacity-scheduler.xml
>> masters  - for listing master nodes
>>
>> Please help me setup this version.
>>
>> Thanking You,
>>
>> --
>> Regards,
>> Ouch Whisper
>> 010101010101
>>
>
>


-- 
Harsh J

Re: config file loactions in Hadoop 2.0.2

Posted by Hemanth Yamijala <yh...@thoughtworks.com>.
Hi,

One place where I could find the capacity-scheduler.xml was from source -
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/resources.

AFAIK, the masters file is only used for starting the secondary namenode -
which has in 2.x been replaced by a proper HA solution. So, I think there
is no need for this file anymore. Please refer to this link for more
details on the HA solution:
http://hadoop.apache.org/docs/r2.0.2-alpha/hadoop-yarn/hadoop-yarn-site/HDFSHighAvailability.html

Thanks
hemanth


On Wed, Jan 16, 2013 at 3:15 AM, Panshul Whisper <ou...@gmail.com>wrote:

> Hello,
>
> I was setting up Hadoop 2.0.2.
> Since I have already setup Hadoop 1.0.x so i have a fair idea where are
> all the files and what to put in each of them.
> In case of Hadoop 2.0.2, the config files have been moved to [hadoop
> install directory]/etc/hadoop
> but I still cannot find
> capacity-scheduler.xml
> masters  - for listing master nodes
>
> Please help me setup this version.
>
> Thanking You,
>
> --
> Regards,
> Ouch Whisper
> 010101010101
>

Re: config file loactions in Hadoop 2.0.2

Posted by Hemanth Yamijala <yh...@thoughtworks.com>.
Hi,

One place where I could find the capacity-scheduler.xml was from source -
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/resources.

AFAIK, the masters file is only used for starting the secondary namenode -
which has in 2.x been replaced by a proper HA solution. So, I think there
is no need for this file anymore. Please refer to this link for more
details on the HA solution:
http://hadoop.apache.org/docs/r2.0.2-alpha/hadoop-yarn/hadoop-yarn-site/HDFSHighAvailability.html

Thanks
hemanth


On Wed, Jan 16, 2013 at 3:15 AM, Panshul Whisper <ou...@gmail.com>wrote:

> Hello,
>
> I was setting up Hadoop 2.0.2.
> Since I have already setup Hadoop 1.0.x so i have a fair idea where are
> all the files and what to put in each of them.
> In case of Hadoop 2.0.2, the config files have been moved to [hadoop
> install directory]/etc/hadoop
> but I still cannot find
> capacity-scheduler.xml
> masters  - for listing master nodes
>
> Please help me setup this version.
>
> Thanking You,
>
> --
> Regards,
> Ouch Whisper
> 010101010101
>

Re: config file loactions in Hadoop 2.0.2

Posted by Hemanth Yamijala <yh...@thoughtworks.com>.
Hi,

One place where I could find the capacity-scheduler.xml was from source -
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/resources.

AFAIK, the masters file is only used for starting the secondary namenode -
which has in 2.x been replaced by a proper HA solution. So, I think there
is no need for this file anymore. Please refer to this link for more
details on the HA solution:
http://hadoop.apache.org/docs/r2.0.2-alpha/hadoop-yarn/hadoop-yarn-site/HDFSHighAvailability.html

Thanks
hemanth


On Wed, Jan 16, 2013 at 3:15 AM, Panshul Whisper <ou...@gmail.com>wrote:

> Hello,
>
> I was setting up Hadoop 2.0.2.
> Since I have already setup Hadoop 1.0.x so i have a fair idea where are
> all the files and what to put in each of them.
> In case of Hadoop 2.0.2, the config files have been moved to [hadoop
> install directory]/etc/hadoop
> but I still cannot find
> capacity-scheduler.xml
> masters  - for listing master nodes
>
> Please help me setup this version.
>
> Thanking You,
>
> --
> Regards,
> Ouch Whisper
> 010101010101
>

Re: config file loactions in Hadoop 2.0.2

Posted by Hemanth Yamijala <yh...@thoughtworks.com>.
Hi,

One place where I could find the capacity-scheduler.xml was from source -
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/resources.

AFAIK, the masters file is only used for starting the secondary namenode -
which has in 2.x been replaced by a proper HA solution. So, I think there
is no need for this file anymore. Please refer to this link for more
details on the HA solution:
http://hadoop.apache.org/docs/r2.0.2-alpha/hadoop-yarn/hadoop-yarn-site/HDFSHighAvailability.html

Thanks
hemanth


On Wed, Jan 16, 2013 at 3:15 AM, Panshul Whisper <ou...@gmail.com>wrote:

> Hello,
>
> I was setting up Hadoop 2.0.2.
> Since I have already setup Hadoop 1.0.x so i have a fair idea where are
> all the files and what to put in each of them.
> In case of Hadoop 2.0.2, the config files have been moved to [hadoop
> install directory]/etc/hadoop
> but I still cannot find
> capacity-scheduler.xml
> masters  - for listing master nodes
>
> Please help me setup this version.
>
> Thanking You,
>
> --
> Regards,
> Ouch Whisper
> 010101010101
>