You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-user@hadoop.apache.org by "Navraj S. Chohan" <nl...@gmail.com> on 2010/01/06 15:29:55 UTC

Dynamically Adding Map Slots

Hello,
Is it possible to add more map slots per node during the runtime of a MR
job?
Thanks.

-- 
Navraj S. Chohan
nlake44@gmail.com

Re: Dynamically Adding Map Slots

Posted by Matei Zaharia <ma...@eecs.berkeley.edu>.

Not in any nice way, as far as I know. You could shut down the TaskTrackers one at a time, update their config files to add slots, and start them up again, but you'd cause some tasks to fail this way, and you might also have the JobTracker deciding that map outputs on a given TT can't be fetched and re-running those maps elsewhere.

On Jan 6, 2010, at 9:29 AM, Navraj S. Chohan wrote:

> Hello,
> Is it possible to add more map slots per node during the runtime of a MR
> job?
> Thanks.
> 
> -- 
> Navraj S. Chohan
> nlake44@gmail.com