You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Chris Trezzo (JIRA)" <ji...@apache.org> on 2016/06/02 02:39:59 UTC
[jira] [Created] (YARN-5192) Limit the number of resources a
container can localize
Chris Trezzo created YARN-5192:
----------------------------------
Summary: Limit the number of resources a container can localize
Key: YARN-5192
URL: https://issues.apache.org/jira/browse/YARN-5192
Project: Hadoop YARN
Issue Type: New Feature
Reporter: Chris Trezzo
Users will sometimes submit YARN applications where containers localize a large number of resources. This thrashes the YARN local cache on the node managers and can impact other running applications. It would be nice if there was server-side enforcement of localization limits that an admin could configure. For example:
# Total size of the resources a container can localize.
# Total number of files a container can localize.
# The maximum size of an individual resource (i.e. a large fat jar) that a container can localize.
MAPREDUCE-6690 is being worked on to provide a set of MapReduce client-side limits.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org