You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Chris Li (JIRA)" <ji...@apache.org> on 2014/01/25 01:13:37 UTC

[jira] [Updated] (HADOOP-10281) Create a scheduler, which assigns schedulables a priority level

     [ https://issues.apache.org/jira/browse/HADOOP-10281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Chris Li updated HADOOP-10281:
------------------------------

    Attachment: subtask4_scheduler.patch

The scheduler assigns schedulables a priority level based the past history of requests.

It can be configured as follows:

ipc.8020.history-scheduler.history-length = 1000 

The number of past requests to remember and compare

ipc.8020.history-scheduler.thresholds = 33, 66

Dependent on the history-length and the number of priority levels: defines the thresholds that separate each priority level. In this example, we have 3 priority levels and a history length of 100, so we assign thusly:
* Queue 2 if count > 66
* Queue 1 if count > 33
* Queue 0 otherwise



> Create a scheduler, which assigns schedulables a priority level
> ---------------------------------------------------------------
>
>                 Key: HADOOP-10281
>                 URL: https://issues.apache.org/jira/browse/HADOOP-10281
>             Project: Hadoop Common
>          Issue Type: Sub-task
>            Reporter: Chris Li
>         Attachments: subtask4_scheduler.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.1.5#6160)