You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-user@hadoop.apache.org by Shashidhar Rao <ra...@gmail.com> on 2014/03/15 07:42:53 UTC
Replicating Hadoop configuration files on all nodes
Hi,
Please let me know how to go about replicating all the Hadoop configuration
files on all nodes without using Cloudera Manager.
Thanks
Shashi
Re: Replicating Hadoop configuration files on all nodes
Posted by Ipremyadav <ip...@gmail.com>.
Use a config management tool like chef or puppet
> On 15 Mar 2014, at 06:42, Shashidhar Rao <ra...@gmail.com> wrote:
>
> Hi,
>
> Please let me know how to go about replicating all the Hadoop configuration files on all nodes without using Cloudera Manager.
>
>
> Thanks
> Shashi
Re: Replicating Hadoop configuration files on all nodes
Posted by Mingjiang Shi <ms...@gopivotal.com>.
Also massh: http://m.a.tt/er/massh/
On Sat, Mar 15, 2014 at 10:17 PM, dlmarion <dl...@hotmail.com> wrote:
> Also pdsh[1] or pssh[2].
>
>
>
> [1] http://sourceforge.net/projects/pdsh/
>
> [2] https://code.google.com/p/parallel-ssh/
>
>
>
>
>
> *From:* Geoffry Roberts [mailto:threadedblue@gmail.com]
> *Sent:* Saturday, March 15, 2014 9:55 AM
> *To:* user@hadoop.apache.org
> *Subject:* Re: Replicating Hadoop configuration files on all nodes
>
>
>
> I agree rsync is your friend here. I took a neanderthal approach and
> looped through the slaves file calling rsync each time. It worked. rynch
> also supports a batch mode for doing much the same thing.
>
>
>
> On Sat, Mar 15, 2014 at 8:07 AM, sudhakara st <su...@gmail.com>
> wrote:
>
> use 'rsync' or 'scp' in commandline
>
>
>
> On Sat, Mar 15, 2014 at 12:12 PM, Shashidhar Rao <
> raoshashidhar123@gmail.com> wrote:
>
> Hi,
>
>
>
> Please let me know how to go about replicating all the Hadoop
> configuration files on all nodes without using Cloudera Manager.
>
>
>
>
>
> Thanks
>
> Shashi
>
>
>
> --
>
>
> Regards,
> ...sudhakara
>
>
>
>
>
>
> --
>
> There are ways and there are ways,
>
>
>
> Geoffry Roberts
>
--
Cheers
-MJ
Re: Replicating Hadoop configuration files on all nodes
Posted by Mingjiang Shi <ms...@gopivotal.com>.
Also massh: http://m.a.tt/er/massh/
On Sat, Mar 15, 2014 at 10:17 PM, dlmarion <dl...@hotmail.com> wrote:
> Also pdsh[1] or pssh[2].
>
>
>
> [1] http://sourceforge.net/projects/pdsh/
>
> [2] https://code.google.com/p/parallel-ssh/
>
>
>
>
>
> *From:* Geoffry Roberts [mailto:threadedblue@gmail.com]
> *Sent:* Saturday, March 15, 2014 9:55 AM
> *To:* user@hadoop.apache.org
> *Subject:* Re: Replicating Hadoop configuration files on all nodes
>
>
>
> I agree rsync is your friend here. I took a neanderthal approach and
> looped through the slaves file calling rsync each time. It worked. rynch
> also supports a batch mode for doing much the same thing.
>
>
>
> On Sat, Mar 15, 2014 at 8:07 AM, sudhakara st <su...@gmail.com>
> wrote:
>
> use 'rsync' or 'scp' in commandline
>
>
>
> On Sat, Mar 15, 2014 at 12:12 PM, Shashidhar Rao <
> raoshashidhar123@gmail.com> wrote:
>
> Hi,
>
>
>
> Please let me know how to go about replicating all the Hadoop
> configuration files on all nodes without using Cloudera Manager.
>
>
>
>
>
> Thanks
>
> Shashi
>
>
>
> --
>
>
> Regards,
> ...sudhakara
>
>
>
>
>
>
> --
>
> There are ways and there are ways,
>
>
>
> Geoffry Roberts
>
--
Cheers
-MJ
Re: Replicating Hadoop configuration files on all nodes
Posted by Mingjiang Shi <ms...@gopivotal.com>.
Also massh: http://m.a.tt/er/massh/
On Sat, Mar 15, 2014 at 10:17 PM, dlmarion <dl...@hotmail.com> wrote:
> Also pdsh[1] or pssh[2].
>
>
>
> [1] http://sourceforge.net/projects/pdsh/
>
> [2] https://code.google.com/p/parallel-ssh/
>
>
>
>
>
> *From:* Geoffry Roberts [mailto:threadedblue@gmail.com]
> *Sent:* Saturday, March 15, 2014 9:55 AM
> *To:* user@hadoop.apache.org
> *Subject:* Re: Replicating Hadoop configuration files on all nodes
>
>
>
> I agree rsync is your friend here. I took a neanderthal approach and
> looped through the slaves file calling rsync each time. It worked. rynch
> also supports a batch mode for doing much the same thing.
>
>
>
> On Sat, Mar 15, 2014 at 8:07 AM, sudhakara st <su...@gmail.com>
> wrote:
>
> use 'rsync' or 'scp' in commandline
>
>
>
> On Sat, Mar 15, 2014 at 12:12 PM, Shashidhar Rao <
> raoshashidhar123@gmail.com> wrote:
>
> Hi,
>
>
>
> Please let me know how to go about replicating all the Hadoop
> configuration files on all nodes without using Cloudera Manager.
>
>
>
>
>
> Thanks
>
> Shashi
>
>
>
> --
>
>
> Regards,
> ...sudhakara
>
>
>
>
>
>
> --
>
> There are ways and there are ways,
>
>
>
> Geoffry Roberts
>
--
Cheers
-MJ
Re: Replicating Hadoop configuration files on all nodes
Posted by Mingjiang Shi <ms...@gopivotal.com>.
Also massh: http://m.a.tt/er/massh/
On Sat, Mar 15, 2014 at 10:17 PM, dlmarion <dl...@hotmail.com> wrote:
> Also pdsh[1] or pssh[2].
>
>
>
> [1] http://sourceforge.net/projects/pdsh/
>
> [2] https://code.google.com/p/parallel-ssh/
>
>
>
>
>
> *From:* Geoffry Roberts [mailto:threadedblue@gmail.com]
> *Sent:* Saturday, March 15, 2014 9:55 AM
> *To:* user@hadoop.apache.org
> *Subject:* Re: Replicating Hadoop configuration files on all nodes
>
>
>
> I agree rsync is your friend here. I took a neanderthal approach and
> looped through the slaves file calling rsync each time. It worked. rynch
> also supports a batch mode for doing much the same thing.
>
>
>
> On Sat, Mar 15, 2014 at 8:07 AM, sudhakara st <su...@gmail.com>
> wrote:
>
> use 'rsync' or 'scp' in commandline
>
>
>
> On Sat, Mar 15, 2014 at 12:12 PM, Shashidhar Rao <
> raoshashidhar123@gmail.com> wrote:
>
> Hi,
>
>
>
> Please let me know how to go about replicating all the Hadoop
> configuration files on all nodes without using Cloudera Manager.
>
>
>
>
>
> Thanks
>
> Shashi
>
>
>
> --
>
>
> Regards,
> ...sudhakara
>
>
>
>
>
>
> --
>
> There are ways and there are ways,
>
>
>
> Geoffry Roberts
>
--
Cheers
-MJ
RE: Replicating Hadoop configuration files on all nodes
Posted by dlmarion <dl...@hotmail.com>.
Also pdsh[1] or pssh[2].
[1] http://sourceforge.net/projects/pdsh/
[2] https://code.google.com/p/parallel-ssh/
From: Geoffry Roberts [mailto:threadedblue@gmail.com]
Sent: Saturday, March 15, 2014 9:55 AM
To: user@hadoop.apache.org
Subject: Re: Replicating Hadoop configuration files on all nodes
I agree rsync is your friend here. I took a neanderthal approach and looped
through the slaves file calling rsync each time. It worked. rynch also
supports a batch mode for doing much the same thing.
On Sat, Mar 15, 2014 at 8:07 AM, sudhakara st <su...@gmail.com>
wrote:
use 'rsync' or 'scp' in commandline
On Sat, Mar 15, 2014 at 12:12 PM, Shashidhar Rao
<ra...@gmail.com> wrote:
Hi,
Please let me know how to go about replicating all the Hadoop configuration
files on all nodes without using Cloudera Manager.
Thanks
Shashi
--
Regards,
...sudhakara
--
There are ways and there are ways,
Geoffry Roberts
RE: Replicating Hadoop configuration files on all nodes
Posted by dlmarion <dl...@hotmail.com>.
Also pdsh[1] or pssh[2].
[1] http://sourceforge.net/projects/pdsh/
[2] https://code.google.com/p/parallel-ssh/
From: Geoffry Roberts [mailto:threadedblue@gmail.com]
Sent: Saturday, March 15, 2014 9:55 AM
To: user@hadoop.apache.org
Subject: Re: Replicating Hadoop configuration files on all nodes
I agree rsync is your friend here. I took a neanderthal approach and looped
through the slaves file calling rsync each time. It worked. rynch also
supports a batch mode for doing much the same thing.
On Sat, Mar 15, 2014 at 8:07 AM, sudhakara st <su...@gmail.com>
wrote:
use 'rsync' or 'scp' in commandline
On Sat, Mar 15, 2014 at 12:12 PM, Shashidhar Rao
<ra...@gmail.com> wrote:
Hi,
Please let me know how to go about replicating all the Hadoop configuration
files on all nodes without using Cloudera Manager.
Thanks
Shashi
--
Regards,
...sudhakara
--
There are ways and there are ways,
Geoffry Roberts
RE: Replicating Hadoop configuration files on all nodes
Posted by dlmarion <dl...@hotmail.com>.
Also pdsh[1] or pssh[2].
[1] http://sourceforge.net/projects/pdsh/
[2] https://code.google.com/p/parallel-ssh/
From: Geoffry Roberts [mailto:threadedblue@gmail.com]
Sent: Saturday, March 15, 2014 9:55 AM
To: user@hadoop.apache.org
Subject: Re: Replicating Hadoop configuration files on all nodes
I agree rsync is your friend here. I took a neanderthal approach and looped
through the slaves file calling rsync each time. It worked. rynch also
supports a batch mode for doing much the same thing.
On Sat, Mar 15, 2014 at 8:07 AM, sudhakara st <su...@gmail.com>
wrote:
use 'rsync' or 'scp' in commandline
On Sat, Mar 15, 2014 at 12:12 PM, Shashidhar Rao
<ra...@gmail.com> wrote:
Hi,
Please let me know how to go about replicating all the Hadoop configuration
files on all nodes without using Cloudera Manager.
Thanks
Shashi
--
Regards,
...sudhakara
--
There are ways and there are ways,
Geoffry Roberts
RE: Replicating Hadoop configuration files on all nodes
Posted by dlmarion <dl...@hotmail.com>.
Also pdsh[1] or pssh[2].
[1] http://sourceforge.net/projects/pdsh/
[2] https://code.google.com/p/parallel-ssh/
From: Geoffry Roberts [mailto:threadedblue@gmail.com]
Sent: Saturday, March 15, 2014 9:55 AM
To: user@hadoop.apache.org
Subject: Re: Replicating Hadoop configuration files on all nodes
I agree rsync is your friend here. I took a neanderthal approach and looped
through the slaves file calling rsync each time. It worked. rynch also
supports a batch mode for doing much the same thing.
On Sat, Mar 15, 2014 at 8:07 AM, sudhakara st <su...@gmail.com>
wrote:
use 'rsync' or 'scp' in commandline
On Sat, Mar 15, 2014 at 12:12 PM, Shashidhar Rao
<ra...@gmail.com> wrote:
Hi,
Please let me know how to go about replicating all the Hadoop configuration
files on all nodes without using Cloudera Manager.
Thanks
Shashi
--
Regards,
...sudhakara
--
There are ways and there are ways,
Geoffry Roberts
Re: Replicating Hadoop configuration files on all nodes
Posted by Geoffry Roberts <th...@gmail.com>.
I agree rsync is your friend here. I took a neanderthal approach and
looped through the slaves file calling rsync each time. It worked. rynch
also supports a batch mode for doing much the same thing.
On Sat, Mar 15, 2014 at 8:07 AM, sudhakara st <su...@gmail.com>wrote:
> use 'rsync' or 'scp' in commandline
>
>
> On Sat, Mar 15, 2014 at 12:12 PM, Shashidhar Rao <
> raoshashidhar123@gmail.com> wrote:
>
>> Hi,
>>
>> Please let me know how to go about replicating all the Hadoop
>> configuration files on all nodes without using Cloudera Manager.
>>
>>
>> Thanks
>> Shashi
>>
>
>
>
> --
>
> Regards,
> ...sudhakara
>
>
--
There are ways and there are ways,
Geoffry Roberts
Re: Replicating Hadoop configuration files on all nodes
Posted by Geoffry Roberts <th...@gmail.com>.
I agree rsync is your friend here. I took a neanderthal approach and
looped through the slaves file calling rsync each time. It worked. rynch
also supports a batch mode for doing much the same thing.
On Sat, Mar 15, 2014 at 8:07 AM, sudhakara st <su...@gmail.com>wrote:
> use 'rsync' or 'scp' in commandline
>
>
> On Sat, Mar 15, 2014 at 12:12 PM, Shashidhar Rao <
> raoshashidhar123@gmail.com> wrote:
>
>> Hi,
>>
>> Please let me know how to go about replicating all the Hadoop
>> configuration files on all nodes without using Cloudera Manager.
>>
>>
>> Thanks
>> Shashi
>>
>
>
>
> --
>
> Regards,
> ...sudhakara
>
>
--
There are ways and there are ways,
Geoffry Roberts
Re: Replicating Hadoop configuration files on all nodes
Posted by Geoffry Roberts <th...@gmail.com>.
I agree rsync is your friend here. I took a neanderthal approach and
looped through the slaves file calling rsync each time. It worked. rynch
also supports a batch mode for doing much the same thing.
On Sat, Mar 15, 2014 at 8:07 AM, sudhakara st <su...@gmail.com>wrote:
> use 'rsync' or 'scp' in commandline
>
>
> On Sat, Mar 15, 2014 at 12:12 PM, Shashidhar Rao <
> raoshashidhar123@gmail.com> wrote:
>
>> Hi,
>>
>> Please let me know how to go about replicating all the Hadoop
>> configuration files on all nodes without using Cloudera Manager.
>>
>>
>> Thanks
>> Shashi
>>
>
>
>
> --
>
> Regards,
> ...sudhakara
>
>
--
There are ways and there are ways,
Geoffry Roberts
Re: Replicating Hadoop configuration files on all nodes
Posted by Geoffry Roberts <th...@gmail.com>.
I agree rsync is your friend here. I took a neanderthal approach and
looped through the slaves file calling rsync each time. It worked. rynch
also supports a batch mode for doing much the same thing.
On Sat, Mar 15, 2014 at 8:07 AM, sudhakara st <su...@gmail.com>wrote:
> use 'rsync' or 'scp' in commandline
>
>
> On Sat, Mar 15, 2014 at 12:12 PM, Shashidhar Rao <
> raoshashidhar123@gmail.com> wrote:
>
>> Hi,
>>
>> Please let me know how to go about replicating all the Hadoop
>> configuration files on all nodes without using Cloudera Manager.
>>
>>
>> Thanks
>> Shashi
>>
>
>
>
> --
>
> Regards,
> ...sudhakara
>
>
--
There are ways and there are ways,
Geoffry Roberts
Re: Replicating Hadoop configuration files on all nodes
Posted by sudhakara st <su...@gmail.com>.
use 'rsync' or 'scp' in commandline
On Sat, Mar 15, 2014 at 12:12 PM, Shashidhar Rao <raoshashidhar123@gmail.com
> wrote:
> Hi,
>
> Please let me know how to go about replicating all the Hadoop
> configuration files on all nodes without using Cloudera Manager.
>
>
> Thanks
> Shashi
>
--
Regards,
...sudhakara
Re: Replicating Hadoop configuration files on all nodes
Posted by Ipremyadav <ip...@gmail.com>.
Use a config management tool like chef or puppet
> On 15 Mar 2014, at 06:42, Shashidhar Rao <ra...@gmail.com> wrote:
>
> Hi,
>
> Please let me know how to go about replicating all the Hadoop configuration files on all nodes without using Cloudera Manager.
>
>
> Thanks
> Shashi
Re: Replicating Hadoop configuration files on all nodes
Posted by Ipremyadav <ip...@gmail.com>.
Use a config management tool like chef or puppet
> On 15 Mar 2014, at 06:42, Shashidhar Rao <ra...@gmail.com> wrote:
>
> Hi,
>
> Please let me know how to go about replicating all the Hadoop configuration files on all nodes without using Cloudera Manager.
>
>
> Thanks
> Shashi
Re: Replicating Hadoop configuration files on all nodes
Posted by sudhakara st <su...@gmail.com>.
use 'rsync' or 'scp' in commandline
On Sat, Mar 15, 2014 at 12:12 PM, Shashidhar Rao <raoshashidhar123@gmail.com
> wrote:
> Hi,
>
> Please let me know how to go about replicating all the Hadoop
> configuration files on all nodes without using Cloudera Manager.
>
>
> Thanks
> Shashi
>
--
Regards,
...sudhakara
Re: Replicating Hadoop configuration files on all nodes
Posted by Ipremyadav <ip...@gmail.com>.
Use a config management tool like chef or puppet
> On 15 Mar 2014, at 06:42, Shashidhar Rao <ra...@gmail.com> wrote:
>
> Hi,
>
> Please let me know how to go about replicating all the Hadoop configuration files on all nodes without using Cloudera Manager.
>
>
> Thanks
> Shashi
Re: Replicating Hadoop configuration files on all nodes
Posted by sudhakara st <su...@gmail.com>.
use 'rsync' or 'scp' in commandline
On Sat, Mar 15, 2014 at 12:12 PM, Shashidhar Rao <raoshashidhar123@gmail.com
> wrote:
> Hi,
>
> Please let me know how to go about replicating all the Hadoop
> configuration files on all nodes without using Cloudera Manager.
>
>
> Thanks
> Shashi
>
--
Regards,
...sudhakara
Re: Replicating Hadoop configuration files on all nodes
Posted by sudhakara st <su...@gmail.com>.
use 'rsync' or 'scp' in commandline
On Sat, Mar 15, 2014 at 12:12 PM, Shashidhar Rao <raoshashidhar123@gmail.com
> wrote:
> Hi,
>
> Please let me know how to go about replicating all the Hadoop
> configuration files on all nodes without using Cloudera Manager.
>
>
> Thanks
> Shashi
>
--
Regards,
...sudhakara