You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Chris Trezzo (JIRA)" <ji...@apache.org> on 2016/06/02 02:39:59 UTC

[jira] [Created] (YARN-5192) Limit the number of resources a container can localize

Chris Trezzo created YARN-5192:
----------------------------------

             Summary: Limit the number of resources a container can localize
                 Key: YARN-5192
                 URL: https://issues.apache.org/jira/browse/YARN-5192
             Project: Hadoop YARN
          Issue Type: New Feature
            Reporter: Chris Trezzo


Users will sometimes submit YARN applications where containers localize a large number of resources. This thrashes the YARN local cache on the node managers and can impact other running applications. It would be nice if there was server-side enforcement of localization limits that an admin could configure. For example:

# Total size of the resources a container can localize.
# Total number of files a container can localize.
# The maximum size of an individual resource (i.e. a large fat jar) that a container can localize.

MAPREDUCE-6690 is being worked on to provide a set of MapReduce client-side limits.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org