You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Zhaohui Xin (JIRA)" <ji...@apache.org> on 2019/02/03 06:58:00 UTC
[jira] [Updated] (YARN-9276) Filter non-existent resource requests
actively
[ https://issues.apache.org/jira/browse/YARN-9276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Zhaohui Xin updated YARN-9276:
------------------------------
Description:
In some scenarios, applications will request nonexistent resource name in this cluster, such as nonexistent hosts or racks.
Obviously, we should filter or degrade these invaild resource requests actively.
This is especially effective when HDFS and Yarn are deployed on different nodes, and the scheduling throughput of one of our clusters has improved by 5X.
> Filter non-existent resource requests actively
> ----------------------------------------------
>
> Key: YARN-9276
> URL: https://issues.apache.org/jira/browse/YARN-9276
> Project: Hadoop YARN
> Issue Type: Bug
> Components: RM, scheduler
> Affects Versions: 2.6.0, 2.7.0, 2.8.0, 2.9.0, 3.0.0, 3.1.0
> Reporter: Zhaohui Xin
> Assignee: Zhaohui Xin
> Priority: Major
>
> In some scenarios, applications will request nonexistent resource name in this cluster, such as nonexistent hosts or racks.
> Obviously, we should filter or degrade these invaild resource requests actively.
> This is especially effective when HDFS and Yarn are deployed on different nodes, and the scheduling throughput of one of our clusters has improved by 5X.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org