You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-commits@hadoop.apache.org by Apache Wiki <wi...@apache.org> on 2010/12/08 23:34:01 UTC
[Hadoop Wiki] Update of "LimitingTaskSlotUsage" by SomeOtherAccount
Dear Wiki user,
You have subscribed to a wiki page or wiki category on "Hadoop Wiki" for change notification.
The "LimitingTaskSlotUsage" page has been changed by SomeOtherAccount.
http://wiki.apache.org/hadoop/LimitingTaskSlotUsage?action=diff&rev1=6&rev2=7
--------------------------------------------------
If a task absolutely must break the rules, there are a few things one can do:
+ * Disable SpeculativeExecution .
* Deploy ZooKeeper and use it as a persistent lock to keep track of how many tasks are running concurrently
* Use a scheduler with a maximum task-per-queue feature and submit the job to that queue, such as FairShareScheduler or CapacityScheduler