You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Rajiv Chittajallu (JIRA)" <ji...@apache.org> on 2009/06/04 03:00:08 UTC
[jira] Created: (HADOOP-5966) Option to limit max tasks started per
job/queue
Option to limit max tasks started per job/queue
------------------------------------------------
Key: HADOOP-5966
URL: https://issues.apache.org/jira/browse/HADOOP-5966
Project: Hadoop Core
Issue Type: New Feature
Components: contrib/capacity-sched
Reporter: Rajiv Chittajallu
For jobs which call external services, (eg: distcp, crawlers) user/admin should be able to control max parallel tasks spawned. There should be a mechanism to cap the capacity available for a queue/job.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-5966) Option to limit max tasks started
per job/queue
Posted by "Devaraj Das (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12716124#action_12716124 ]
Devaraj Das commented on HADOOP-5966:
-------------------------------------
Does HADOOP-5170 address the requirements?
> Option to limit max tasks started per job/queue
> ------------------------------------------------
>
> Key: HADOOP-5966
> URL: https://issues.apache.org/jira/browse/HADOOP-5966
> Project: Hadoop Core
> Issue Type: New Feature
> Components: contrib/capacity-sched
> Reporter: Rajiv Chittajallu
>
> For jobs which call external services, (eg: distcp, crawlers) user/admin should be able to control max parallel tasks spawned. There should be a mechanism to cap the capacity available for a queue/job.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-5966) Option to limit max tasks started
per job/queue
Posted by "Rajiv Chittajallu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-5966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12716134#action_12716134 ]
Rajiv Chittajallu commented on HADOOP-5966:
-------------------------------------------
For job limits, Yes. Can we add similar limits per queue?
mapred.max.maps.per.queue and mapred.max.reduces.per.queue
> Option to limit max tasks started per job/queue
> ------------------------------------------------
>
> Key: HADOOP-5966
> URL: https://issues.apache.org/jira/browse/HADOOP-5966
> Project: Hadoop Core
> Issue Type: New Feature
> Components: contrib/capacity-sched
> Reporter: Rajiv Chittajallu
>
> For jobs which call external services, (eg: distcp, crawlers) user/admin should be able to control max parallel tasks spawned. There should be a mechanism to cap the capacity available for a queue/job.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.