You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-user@hadoop.apache.org by hadoop hive <ha...@gmail.com> on 2014/01/20 19:34:15 UTC
Admin Scripts
Hi Folks,
Does anyone have idea regrading, start and stop services on all the nodes
in parallel. i am facing an issue i have a big cluster like 1000 nodes and
i want services to start and stop , if i do it sequentially it will take
around 30-50mins , what can i do to make it parallelly, does anyone have
any sample scripts for this thing.
i don't have passwordless connectivity, i nodes have same user and password.
thanks
hadoophive
Re: Admin Scripts
Posted by hadoop hive <ha...@gmail.com>.
Hey Haohui,
Do you have something handy , just for an idea
thanks
On Mon, Jan 20, 2014 at 10:36 AM, Haohui Mai <hm...@hortonworks.com> wrote:
> Hi,
>
> pssh should be able do to the job.
>
> ~Haohui
>
>
> On Mon, Jan 20, 2014 at 10:34 AM, hadoop hive <ha...@gmail.com>wrote:
>
>> Hi Folks,
>>
>> Does anyone have idea regrading, start and stop services on all the nodes
>> in parallel. i am facing an issue i have a big cluster like 1000 nodes and
>> i want services to start and stop , if i do it sequentially it will take
>> around 30-50mins , what can i do to make it parallelly, does anyone have
>> any sample scripts for this thing.
>>
>> i don't have passwordless connectivity, i nodes have same user and
>> password.
>>
>> thanks
>> hadoophive
>>
>>
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity
> to which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
Re: Admin Scripts
Posted by hadoop hive <ha...@gmail.com>.
Hey Haohui,
Do you have something handy , just for an idea
thanks
On Mon, Jan 20, 2014 at 10:36 AM, Haohui Mai <hm...@hortonworks.com> wrote:
> Hi,
>
> pssh should be able do to the job.
>
> ~Haohui
>
>
> On Mon, Jan 20, 2014 at 10:34 AM, hadoop hive <ha...@gmail.com>wrote:
>
>> Hi Folks,
>>
>> Does anyone have idea regrading, start and stop services on all the nodes
>> in parallel. i am facing an issue i have a big cluster like 1000 nodes and
>> i want services to start and stop , if i do it sequentially it will take
>> around 30-50mins , what can i do to make it parallelly, does anyone have
>> any sample scripts for this thing.
>>
>> i don't have passwordless connectivity, i nodes have same user and
>> password.
>>
>> thanks
>> hadoophive
>>
>>
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity
> to which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
Re: Admin Scripts
Posted by hadoop hive <ha...@gmail.com>.
Hey Haohui,
Do you have something handy , just for an idea
thanks
On Mon, Jan 20, 2014 at 10:36 AM, Haohui Mai <hm...@hortonworks.com> wrote:
> Hi,
>
> pssh should be able do to the job.
>
> ~Haohui
>
>
> On Mon, Jan 20, 2014 at 10:34 AM, hadoop hive <ha...@gmail.com>wrote:
>
>> Hi Folks,
>>
>> Does anyone have idea regrading, start and stop services on all the nodes
>> in parallel. i am facing an issue i have a big cluster like 1000 nodes and
>> i want services to start and stop , if i do it sequentially it will take
>> around 30-50mins , what can i do to make it parallelly, does anyone have
>> any sample scripts for this thing.
>>
>> i don't have passwordless connectivity, i nodes have same user and
>> password.
>>
>> thanks
>> hadoophive
>>
>>
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity
> to which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
Re: Admin Scripts
Posted by hadoop hive <ha...@gmail.com>.
Hey Haohui,
Do you have something handy , just for an idea
thanks
On Mon, Jan 20, 2014 at 10:36 AM, Haohui Mai <hm...@hortonworks.com> wrote:
> Hi,
>
> pssh should be able do to the job.
>
> ~Haohui
>
>
> On Mon, Jan 20, 2014 at 10:34 AM, hadoop hive <ha...@gmail.com>wrote:
>
>> Hi Folks,
>>
>> Does anyone have idea regrading, start and stop services on all the nodes
>> in parallel. i am facing an issue i have a big cluster like 1000 nodes and
>> i want services to start and stop , if i do it sequentially it will take
>> around 30-50mins , what can i do to make it parallelly, does anyone have
>> any sample scripts for this thing.
>>
>> i don't have passwordless connectivity, i nodes have same user and
>> password.
>>
>> thanks
>> hadoophive
>>
>>
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity
> to which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
Re: Admin Scripts
Posted by Haohui Mai <hm...@hortonworks.com>.
Hi,
pssh should be able do to the job.
~Haohui
On Mon, Jan 20, 2014 at 10:34 AM, hadoop hive <ha...@gmail.com> wrote:
> Hi Folks,
>
> Does anyone have idea regrading, start and stop services on all the nodes
> in parallel. i am facing an issue i have a big cluster like 1000 nodes and
> i want services to start and stop , if i do it sequentially it will take
> around 30-50mins , what can i do to make it parallelly, does anyone have
> any sample scripts for this thing.
>
> i don't have passwordless connectivity, i nodes have same user and
> password.
>
> thanks
> hadoophive
>
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: Admin Scripts
Posted by Haohui Mai <hm...@hortonworks.com>.
Hi,
pssh should be able do to the job.
~Haohui
On Mon, Jan 20, 2014 at 10:34 AM, hadoop hive <ha...@gmail.com> wrote:
> Hi Folks,
>
> Does anyone have idea regrading, start and stop services on all the nodes
> in parallel. i am facing an issue i have a big cluster like 1000 nodes and
> i want services to start and stop , if i do it sequentially it will take
> around 30-50mins , what can i do to make it parallelly, does anyone have
> any sample scripts for this thing.
>
> i don't have passwordless connectivity, i nodes have same user and
> password.
>
> thanks
> hadoophive
>
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: Admin Scripts
Posted by Nitin Pawar <ni...@gmail.com>.
please look at
1) pdsh
2)clustered shells
On Tue, Jan 21, 2014 at 12:04 AM, hadoop hive <ha...@gmail.com> wrote:
> Hi Folks,
>
> Does anyone have idea regrading, start and stop services on all the nodes
> in parallel. i am facing an issue i have a big cluster like 1000 nodes and
> i want services to start and stop , if i do it sequentially it will take
> around 30-50mins , what can i do to make it parallelly, does anyone have
> any sample scripts for this thing.
>
> i don't have passwordless connectivity, i nodes have same user and
> password.
>
> thanks
> hadoophive
>
>
--
Nitin Pawar
Re: Admin Scripts
Posted by Nitin Pawar <ni...@gmail.com>.
please look at
1) pdsh
2)clustered shells
On Tue, Jan 21, 2014 at 12:04 AM, hadoop hive <ha...@gmail.com> wrote:
> Hi Folks,
>
> Does anyone have idea regrading, start and stop services on all the nodes
> in parallel. i am facing an issue i have a big cluster like 1000 nodes and
> i want services to start and stop , if i do it sequentially it will take
> around 30-50mins , what can i do to make it parallelly, does anyone have
> any sample scripts for this thing.
>
> i don't have passwordless connectivity, i nodes have same user and
> password.
>
> thanks
> hadoophive
>
>
--
Nitin Pawar
Re: Admin Scripts
Posted by Haohui Mai <hm...@hortonworks.com>.
Hi,
pssh should be able do to the job.
~Haohui
On Mon, Jan 20, 2014 at 10:34 AM, hadoop hive <ha...@gmail.com> wrote:
> Hi Folks,
>
> Does anyone have idea regrading, start and stop services on all the nodes
> in parallel. i am facing an issue i have a big cluster like 1000 nodes and
> i want services to start and stop , if i do it sequentially it will take
> around 30-50mins , what can i do to make it parallelly, does anyone have
> any sample scripts for this thing.
>
> i don't have passwordless connectivity, i nodes have same user and
> password.
>
> thanks
> hadoophive
>
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: Admin Scripts
Posted by Nitin Pawar <ni...@gmail.com>.
please look at
1) pdsh
2)clustered shells
On Tue, Jan 21, 2014 at 12:04 AM, hadoop hive <ha...@gmail.com> wrote:
> Hi Folks,
>
> Does anyone have idea regrading, start and stop services on all the nodes
> in parallel. i am facing an issue i have a big cluster like 1000 nodes and
> i want services to start and stop , if i do it sequentially it will take
> around 30-50mins , what can i do to make it parallelly, does anyone have
> any sample scripts for this thing.
>
> i don't have passwordless connectivity, i nodes have same user and
> password.
>
> thanks
> hadoophive
>
>
--
Nitin Pawar
Re: Admin Scripts
Posted by Nitin Pawar <ni...@gmail.com>.
please look at
1) pdsh
2)clustered shells
On Tue, Jan 21, 2014 at 12:04 AM, hadoop hive <ha...@gmail.com> wrote:
> Hi Folks,
>
> Does anyone have idea regrading, start and stop services on all the nodes
> in parallel. i am facing an issue i have a big cluster like 1000 nodes and
> i want services to start and stop , if i do it sequentially it will take
> around 30-50mins , what can i do to make it parallelly, does anyone have
> any sample scripts for this thing.
>
> i don't have passwordless connectivity, i nodes have same user and
> password.
>
> thanks
> hadoophive
>
>
--
Nitin Pawar
Re: Admin Scripts
Posted by Haohui Mai <hm...@hortonworks.com>.
Hi,
pssh should be able do to the job.
~Haohui
On Mon, Jan 20, 2014 at 10:34 AM, hadoop hive <ha...@gmail.com> wrote:
> Hi Folks,
>
> Does anyone have idea regrading, start and stop services on all the nodes
> in parallel. i am facing an issue i have a big cluster like 1000 nodes and
> i want services to start and stop , if i do it sequentially it will take
> around 30-50mins , what can i do to make it parallelly, does anyone have
> any sample scripts for this thing.
>
> i don't have passwordless connectivity, i nodes have same user and
> password.
>
> thanks
> hadoophive
>
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.