You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-dev@hadoop.apache.org by "wangwj (JIRA)" <ji...@apache.org> on 2018/01/31 02:57:00 UTC
[jira] [Created] (YARN-7859) New further: add queue scheduling
deadLine in fairScheduler.
wangwj created YARN-7859:
----------------------------
Summary: New further: add queue scheduling deadLine in fairScheduler.
Key: YARN-7859
URL: https://issues.apache.org/jira/browse/YARN-7859
Project: Hadoop YARN
Issue Type: New Feature
Components: fairscheduler
Affects Versions: 3.0.0-alpha2
Environment: The environment of my company is hadoop2.6.0-cdh5.4.7
Reporter: wangwj
Fix For: 3.0.0-alpha2, 2.9.0
Attachments: YARN-XXXX.patch
As everyone knows.In FairScheduler the phenomenon of queue scheduling starvation often occurs when the number of cluster jobs is large.The App in one or more queue are pending.So I have thought a way to solve this problem.Add queue scheduling deadLine in fairScheduler.When a queue is not scheduled for FairScheduler within a specified time.We mandatory scheduler it!
Now the way of community solves queue scheduling to starvation is preempt container.But this way may increases the failure rate of the job.
On the basis of the above, I propose this issue...
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org