You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by "Gauthier, Alexander" <Al...@Teradata.com> on 2011/10/18 02:41:24 UTC
Building and adding new Datanode
Hi guys, noob questions;
What do I need to install a new node soon to be added to a cluster and
how do I add it? I'm using CDH3 distribution.
Thank you!!
Alex Gauthier
Engineering Manager
Teradata Corp.
Mobile: 510-427-5447
Office: 858-485-2144
fax: 858-485-2581
www.teradata.com <http://www.teradata.com>
Re: Building and adding new Datanode
Posted by Harsh J <ha...@cloudera.com>.
Ivan,
Yes, that is correct, its the DataNode that initiates the heartbeating process.
On Tue, Oct 18, 2011 at 9:48 PM, <Iv...@emc.com> wrote:
> Hi Harsh,
>
> That brings up an interesting question i wanted to ask.
>
> The connection between the data nodes and the name node is initiated by
> the data node and not by the name node, based on the config file on the
> data node machine.
>
> Correct?
>
> Cheers,
> Ivan
>
> On 10/17/11 9:28 PM, "Harsh J" <ha...@cloudera.com> wrote:
>
>>Hey Alexander,
>>
>>Just install the DataNode packages on the machine and configure it
>>(copy over a config from existing DN perhaps, but make sure to check
>>the dfs.data.dir properties before you start), and start it up.
>>
>>It will join the cluster as long as the configuration points to the
>>right fs.default.name address. Same for TaskTracker as long as it has
>>the right mapred.job.tracker address.
>>
>>If you are using SCM, and this question is along the lines of using
>>SCM to do such a thing, please direct your question to
>>scm-user@cloudera.org
>>(https://groups.google.com/a/cloudera.org/group/scm-user)
>>
>>On Tue, Oct 18, 2011 at 6:11 AM, Gauthier, Alexander
>><Al...@teradata.com> wrote:
>>> Hi guys, noob questions;
>>>
>>>
>>>
>>> What do I need to install a new node soon to be added to a cluster and
>>> how do I add it? I'm using CDH3 distribution.
>>>
>>>
>>>
>>> Thank you!!
>>>
>>>
>>>
>>> Alex Gauthier
>>>
>>> Engineering Manager
>>> Teradata Corp.
>>> Mobile: 510-427-5447
>>> Office: 858-485-2144
>>> fax: 858-485-2581
>>> www.teradata.com <http://www.teradata.com>
>>>
>>>
>>>
>>>
>>
>>
>>
>>--
>>Harsh J
>>
>
>
--
Harsh J
Re: Building and adding new Datanode
Posted by Iv...@emc.com.
Hi Harsh,
That brings up an interesting question i wanted to ask.
The connection between the data nodes and the name node is initiated by
the data node and not by the name node, based on the config file on the
data node machine.
Correct?
Cheers,
Ivan
On 10/17/11 9:28 PM, "Harsh J" <ha...@cloudera.com> wrote:
>Hey Alexander,
>
>Just install the DataNode packages on the machine and configure it
>(copy over a config from existing DN perhaps, but make sure to check
>the dfs.data.dir properties before you start), and start it up.
>
>It will join the cluster as long as the configuration points to the
>right fs.default.name address. Same for TaskTracker as long as it has
>the right mapred.job.tracker address.
>
>If you are using SCM, and this question is along the lines of using
>SCM to do such a thing, please direct your question to
>scm-user@cloudera.org
>(https://groups.google.com/a/cloudera.org/group/scm-user)
>
>On Tue, Oct 18, 2011 at 6:11 AM, Gauthier, Alexander
><Al...@teradata.com> wrote:
>> Hi guys, noob questions;
>>
>>
>>
>> What do I need to install a new node soon to be added to a cluster and
>> how do I add it? I'm using CDH3 distribution.
>>
>>
>>
>> Thank you!!
>>
>>
>>
>> Alex Gauthier
>>
>> Engineering Manager
>> Teradata Corp.
>> Mobile: 510-427-5447
>> Office: 858-485-2144
>> fax: 858-485-2581
>> www.teradata.com <http://www.teradata.com>
>>
>>
>>
>>
>
>
>
>--
>Harsh J
>
Re: Building and adding new Datanode
Posted by Harsh J <ha...@cloudera.com>.
Hey Alexander,
Just install the DataNode packages on the machine and configure it
(copy over a config from existing DN perhaps, but make sure to check
the dfs.data.dir properties before you start), and start it up.
It will join the cluster as long as the configuration points to the
right fs.default.name address. Same for TaskTracker as long as it has
the right mapred.job.tracker address.
If you are using SCM, and this question is along the lines of using
SCM to do such a thing, please direct your question to
scm-user@cloudera.org
(https://groups.google.com/a/cloudera.org/group/scm-user)
On Tue, Oct 18, 2011 at 6:11 AM, Gauthier, Alexander
<Al...@teradata.com> wrote:
> Hi guys, noob questions;
>
>
>
> What do I need to install a new node soon to be added to a cluster and
> how do I add it? I'm using CDH3 distribution.
>
>
>
> Thank you!!
>
>
>
> Alex Gauthier
>
> Engineering Manager
> Teradata Corp.
> Mobile: 510-427-5447
> Office: 858-485-2144
> fax: 858-485-2581
> www.teradata.com <http://www.teradata.com>
>
>
>
>
--
Harsh J