[jira] [Commented] (YARN-7679) Application blacklist to drop misbehave AM requests

["Arun Suresh (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/YARN-7679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16301611#comment-16301611 ] 

Arun Suresh commented on YARN-7679:
-----------------------------------

Thanks for starting the discussion. We actually introduced YARN-6355 to solve a similar problem. Essentially, we can use the pre-processing framework to add a processor that limits requests from misbehaving apps. This can be done in the RM.
In production, we actually use an AMRMProxy plugin, introduced in YARN-2884, installed on the NM to intercept AM calls to RM to perform the job limiting. Since we are using the AMRMProxy anyway for federation.

> Application blacklist to drop misbehave AM requests
> ---------------------------------------------------
>
>                 Key: YARN-7679
>                 URL: https://issues.apache.org/jira/browse/YARN-7679
>             Project: Hadoop YARN
>          Issue Type: New Feature
>          Components: client, RM
>            Reporter: Weiwei Yang
>              Labels: admin, command-line
>
> Sometimes there might be some malicious or mis-behave AMs that keep sending invalid resource requests to RM, this causes resource wastes. If such application provides online services, we cannot simply KILL them. Instead it will be extremely useful if RM can black list such applications, drop their requests. So admin could have time to check and then decide how to process. Propose to add an admin command to blacklist applications.
> Open this JIRA for discussion, will upload a design doc shortly.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org