You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-user@hadoop.apache.org by hadoop hive <ha...@gmail.com> on 2014/01/20 19:34:15 UTC

Admin Scripts

Hi Folks,

Does anyone have idea regrading, start and stop services on all the nodes
in parallel. i am facing an issue i have a big cluster like 1000 nodes and
i want services to start and stop , if i do it sequentially it will take
around 30-50mins , what can i do to make it parallelly, does anyone have
any sample scripts for this thing.

i don't have passwordless connectivity, i nodes have same user and password.

thanks
hadoophive

Re: Admin Scripts

Posted by hadoop hive <ha...@gmail.com>.
Hey Haohui,

Do you have something handy , just for an idea

thanks


On Mon, Jan 20, 2014 at 10:36 AM, Haohui Mai <hm...@hortonworks.com> wrote:

> Hi,
>
> pssh should be able do to the job.
>
> ~Haohui
>
>
> On Mon, Jan 20, 2014 at 10:34 AM, hadoop hive <ha...@gmail.com>wrote:
>
>> Hi Folks,
>>
>> Does anyone have idea regrading, start and stop services on all the nodes
>> in parallel. i am facing an issue i have a big cluster like 1000 nodes and
>> i want services to start and stop , if i do it sequentially it will take
>> around 30-50mins , what can i do to make it parallelly, does anyone have
>> any sample scripts for this thing.
>>
>> i don't have passwordless connectivity, i nodes have same user and
>> password.
>>
>> thanks
>> hadoophive
>>
>>
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity
> to which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.

Re: Admin Scripts

Posted by hadoop hive <ha...@gmail.com>.
Hey Haohui,

Do you have something handy , just for an idea

thanks


On Mon, Jan 20, 2014 at 10:36 AM, Haohui Mai <hm...@hortonworks.com> wrote:

> Hi,
>
> pssh should be able do to the job.
>
> ~Haohui
>
>
> On Mon, Jan 20, 2014 at 10:34 AM, hadoop hive <ha...@gmail.com>wrote:
>
>> Hi Folks,
>>
>> Does anyone have idea regrading, start and stop services on all the nodes
>> in parallel. i am facing an issue i have a big cluster like 1000 nodes and
>> i want services to start and stop , if i do it sequentially it will take
>> around 30-50mins , what can i do to make it parallelly, does anyone have
>> any sample scripts for this thing.
>>
>> i don't have passwordless connectivity, i nodes have same user and
>> password.
>>
>> thanks
>> hadoophive
>>
>>
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity
> to which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.

Re: Admin Scripts

Posted by hadoop hive <ha...@gmail.com>.
Hey Haohui,

Do you have something handy , just for an idea

thanks


On Mon, Jan 20, 2014 at 10:36 AM, Haohui Mai <hm...@hortonworks.com> wrote:

> Hi,
>
> pssh should be able do to the job.
>
> ~Haohui
>
>
> On Mon, Jan 20, 2014 at 10:34 AM, hadoop hive <ha...@gmail.com>wrote:
>
>> Hi Folks,
>>
>> Does anyone have idea regrading, start and stop services on all the nodes
>> in parallel. i am facing an issue i have a big cluster like 1000 nodes and
>> i want services to start and stop , if i do it sequentially it will take
>> around 30-50mins , what can i do to make it parallelly, does anyone have
>> any sample scripts for this thing.
>>
>> i don't have passwordless connectivity, i nodes have same user and
>> password.
>>
>> thanks
>> hadoophive
>>
>>
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity
> to which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.

Re: Admin Scripts

Posted by hadoop hive <ha...@gmail.com>.
Hey Haohui,

Do you have something handy , just for an idea

thanks


On Mon, Jan 20, 2014 at 10:36 AM, Haohui Mai <hm...@hortonworks.com> wrote:

> Hi,
>
> pssh should be able do to the job.
>
> ~Haohui
>
>
> On Mon, Jan 20, 2014 at 10:34 AM, hadoop hive <ha...@gmail.com>wrote:
>
>> Hi Folks,
>>
>> Does anyone have idea regrading, start and stop services on all the nodes
>> in parallel. i am facing an issue i have a big cluster like 1000 nodes and
>> i want services to start and stop , if i do it sequentially it will take
>> around 30-50mins , what can i do to make it parallelly, does anyone have
>> any sample scripts for this thing.
>>
>> i don't have passwordless connectivity, i nodes have same user and
>> password.
>>
>> thanks
>> hadoophive
>>
>>
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity
> to which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.

Re: Admin Scripts

Posted by Haohui Mai <hm...@hortonworks.com>.
Hi,

pssh should be able do to the job.

~Haohui


On Mon, Jan 20, 2014 at 10:34 AM, hadoop hive <ha...@gmail.com> wrote:

> Hi Folks,
>
> Does anyone have idea regrading, start and stop services on all the nodes
> in parallel. i am facing an issue i have a big cluster like 1000 nodes and
> i want services to start and stop , if i do it sequentially it will take
> around 30-50mins , what can i do to make it parallelly, does anyone have
> any sample scripts for this thing.
>
> i don't have passwordless connectivity, i nodes have same user and
> password.
>
> thanks
> hadoophive
>
>

-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.

Re: Admin Scripts

Posted by Haohui Mai <hm...@hortonworks.com>.
Hi,

pssh should be able do to the job.

~Haohui


On Mon, Jan 20, 2014 at 10:34 AM, hadoop hive <ha...@gmail.com> wrote:

> Hi Folks,
>
> Does anyone have idea regrading, start and stop services on all the nodes
> in parallel. i am facing an issue i have a big cluster like 1000 nodes and
> i want services to start and stop , if i do it sequentially it will take
> around 30-50mins , what can i do to make it parallelly, does anyone have
> any sample scripts for this thing.
>
> i don't have passwordless connectivity, i nodes have same user and
> password.
>
> thanks
> hadoophive
>
>

-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.

Re: Admin Scripts

Posted by Nitin Pawar <ni...@gmail.com>.
please look at
1) pdsh
2)clustered shells


On Tue, Jan 21, 2014 at 12:04 AM, hadoop hive <ha...@gmail.com> wrote:

> Hi Folks,
>
> Does anyone have idea regrading, start and stop services on all the nodes
> in parallel. i am facing an issue i have a big cluster like 1000 nodes and
> i want services to start and stop , if i do it sequentially it will take
> around 30-50mins , what can i do to make it parallelly, does anyone have
> any sample scripts for this thing.
>
> i don't have passwordless connectivity, i nodes have same user and
> password.
>
> thanks
> hadoophive
>
>


-- 
Nitin Pawar

Re: Admin Scripts

Posted by Nitin Pawar <ni...@gmail.com>.
please look at
1) pdsh
2)clustered shells


On Tue, Jan 21, 2014 at 12:04 AM, hadoop hive <ha...@gmail.com> wrote:

> Hi Folks,
>
> Does anyone have idea regrading, start and stop services on all the nodes
> in parallel. i am facing an issue i have a big cluster like 1000 nodes and
> i want services to start and stop , if i do it sequentially it will take
> around 30-50mins , what can i do to make it parallelly, does anyone have
> any sample scripts for this thing.
>
> i don't have passwordless connectivity, i nodes have same user and
> password.
>
> thanks
> hadoophive
>
>


-- 
Nitin Pawar

Re: Admin Scripts

Posted by Haohui Mai <hm...@hortonworks.com>.
Hi,

pssh should be able do to the job.

~Haohui


On Mon, Jan 20, 2014 at 10:34 AM, hadoop hive <ha...@gmail.com> wrote:

> Hi Folks,
>
> Does anyone have idea regrading, start and stop services on all the nodes
> in parallel. i am facing an issue i have a big cluster like 1000 nodes and
> i want services to start and stop , if i do it sequentially it will take
> around 30-50mins , what can i do to make it parallelly, does anyone have
> any sample scripts for this thing.
>
> i don't have passwordless connectivity, i nodes have same user and
> password.
>
> thanks
> hadoophive
>
>

-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.

Re: Admin Scripts

Posted by Nitin Pawar <ni...@gmail.com>.
please look at
1) pdsh
2)clustered shells


On Tue, Jan 21, 2014 at 12:04 AM, hadoop hive <ha...@gmail.com> wrote:

> Hi Folks,
>
> Does anyone have idea regrading, start and stop services on all the nodes
> in parallel. i am facing an issue i have a big cluster like 1000 nodes and
> i want services to start and stop , if i do it sequentially it will take
> around 30-50mins , what can i do to make it parallelly, does anyone have
> any sample scripts for this thing.
>
> i don't have passwordless connectivity, i nodes have same user and
> password.
>
> thanks
> hadoophive
>
>


-- 
Nitin Pawar

Re: Admin Scripts

Posted by Nitin Pawar <ni...@gmail.com>.
please look at
1) pdsh
2)clustered shells


On Tue, Jan 21, 2014 at 12:04 AM, hadoop hive <ha...@gmail.com> wrote:

> Hi Folks,
>
> Does anyone have idea regrading, start and stop services on all the nodes
> in parallel. i am facing an issue i have a big cluster like 1000 nodes and
> i want services to start and stop , if i do it sequentially it will take
> around 30-50mins , what can i do to make it parallelly, does anyone have
> any sample scripts for this thing.
>
> i don't have passwordless connectivity, i nodes have same user and
> password.
>
> thanks
> hadoophive
>
>


-- 
Nitin Pawar

Re: Admin Scripts

Posted by Haohui Mai <hm...@hortonworks.com>.
Hi,

pssh should be able do to the job.

~Haohui


On Mon, Jan 20, 2014 at 10:34 AM, hadoop hive <ha...@gmail.com> wrote:

> Hi Folks,
>
> Does anyone have idea regrading, start and stop services on all the nodes
> in parallel. i am facing an issue i have a big cluster like 1000 nodes and
> i want services to start and stop , if i do it sequentially it will take
> around 30-50mins , what can i do to make it parallelly, does anyone have
> any sample scripts for this thing.
>
> i don't have passwordless connectivity, i nodes have same user and
> password.
>
> thanks
> hadoophive
>
>

-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.