You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by sandeep <sa...@huawei.com> on 2011/01/06 12:35:01 UTC

How to Achieve TaskTracker Decommission

 

Hi 

 

Can any one  you let me know what command do I need to execute  for
Decommissioning TaskTracker?

 

Datanode decommissioning I have achieved using hadoop dfsadmin
-refreshNodes. 

 

Similar to HDFS is there any command for Mapreduce Decommission.

 

I have gone through the defect [HADOOP-5643 ] ..but I was unable to find
what command I need to execute.

 

I have tried ./mapred jobtracker -decommission  but not working .

 

Please help me .

 

Thanks

sandeep

****************************************************************************
***********
This e-mail and attachments contain confidential information from HUAWEI,
which is intended only for the person or entity whose address is listed
above. Any use of the information contained herein in any way (including,
but not limited to, total or partial disclosure, reproduction, or
dissemination) by persons other than the intended recipient's) is
prohibited. If you receive this e-mail in error, please notify the sender by
phone or email immediately and delete it!

 


RE: How to Achieve TaskTracker Decommission

Posted by sandeep <sa...@huawei.com>.
Thank you Allen :)

****************************************************************************
***********
This e-mail and attachments contain confidential information from HUAWEI,
which is intended only for the person or entity whose address is listed
above. Any use of the information contained herein in any way (including,
but not limited to, total or partial disclosure, reproduction, or
dissemination) by persons other than the intended recipient's) is
prohibited. If you receive this e-mail in error, please notify the sender by
phone or email immediately and delete it!


-----Original Message-----
From: Allen Wittenauer [mailto:awittenauer@linkedin.com] 
Sent: Thursday, January 06, 2011 10:08 PM
To: <co...@hadoop.apache.org>
Subject: Re: How to Achieve TaskTracker Decommission


On Jan 6, 2011, at 3:35 AM, sandeep wrote:

> Can any one  you let me know what command do I need to execute  for
> Decommissioning TaskTracker?

	mradmin -refreshNodes was added in 0.21.  



Data Platform Engineer at Turn Inc.

Posted by Songting Chen <So...@turn.com>.
Data Platform Engineer at Turn Inc.

If you're passionate about large-scale distributed systems, petabyte data warehouses, NoSQL key-value stores, high throughput
real-time reporting system and are interested in joining a world class engineering team you might well be the person we're 
looking for. This hands-on role contributes to the organization's success through expertise in large scale MapReduce systems, 
advanced database programming and database architecture. 

We are a small team but build innovative and powerful systems. Our results were published in top-tier conferences 
such as VLDB (http://www.vldb2010.org/proceedings/files/papers/I08.pdf). 

If any of the following areas interest you, please send your resume to jobs@turn.com
    * Hybrid MapReduce/Database system 
    * Distributed and parallel computing
    * Performance tuning and optimization
    * Large scale semi-structured data store
    * Real time reporting system in 24 x 7 environment
    * Turning research results into enterprise class software 

About Turn Inc.

Turn was founded to bring the efficiencies of search to digital advertising and empower the world's premier advertising 
agencies and brands to reach custom audiences at scale. We are a software and services company with the industry's only 
end-to-end platform for delivering the most effective data-driven digital advertising in the world. Our technology 
infrastructure, self-service interface, optimization algorithms, real-time analytics, and interoperability represent 
the future of media and data management. The company is based in Silicon Valley with locations in New York City, 
Charlotte, Chicago, London, Los Angeles, and San Francisco.

We are a rapidly growing, well funded startup in Redwood City, CA, with a growing business, a working business model 
and a seasoned executive team. We're changing the way the world thinks about online advertising and we are looking 
for talented engineers to help us take it to the next level.


Re: How to Achieve TaskTracker Decommission

Posted by Allen Wittenauer <aw...@linkedin.com>.
On Jan 6, 2011, at 3:35 AM, sandeep wrote:

> Can any one  you let me know what command do I need to execute  for
> Decommissioning TaskTracker?

	mradmin -refreshNodes was added in 0.21.  



Re: How to Achieve TaskTracker Decommission

Posted by Adarsh Sharma <ad...@orkash.com>.
sandeep wrote:
>  
>
> Hi 
>
>  
>
> Can any one  you let me know what command do I need to execute  for
> Decommissioning TaskTracker?
>
>  
>
> Datanode decommissioning I have achieved using hadoop dfsadmin
> -refreshNodes. 
>
>  
>
> Similar to HDFS is there any command for Mapreduce Decommission.
>
>  
>
> I have gone through the defect [HADOOP-5643 ] ..but I was unable to find
> what command I need to execute.
>
>  
>
> I have tried ./mapred jobtracker -decommission  but not working .
>
>  
>   

There is no command  in HDFS like this .

U must specify the hosts to exclude in mapred.hosts.exclude parameter in 
mapred.site.xml
And

hadoop dfsadmin -refreshNodes. 
 

is sufficient to do the work.


> Please help me .
>
>  
>
> Thanks
>
> sandeep
>
> ****************************************************************************
> ***********
> This e-mail and attachments contain confidential information from HUAWEI,
> which is intended only for the person or entity whose address is listed
> above. Any use of the information contained herein in any way (including,
> but not limited to, total or partial disclosure, reproduction, or
> dissemination) by persons other than the intended recipient's) is
> prohibited. If you receive this e-mail in error, please notify the sender by
> phone or email immediately and delete it!
>
>  
>
>
>