You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-dev@hadoop.apache.org by "zhoukang (Jira)" <ji...@apache.org> on 2019/12/19 12:06:01 UTC
[jira] [Created] (YARN-10047) container memory monitor may make
container exit
zhoukang created YARN-10047:
-------------------------------
Summary: container memory monitor may make container exit
Key: YARN-10047
URL: https://issues.apache.org/jira/browse/YARN-10047
Project: Hadoop YARN
Issue Type: Bug
Components: nodemanager
Reporter: zhoukang
Assignee: zhoukang
As below, we have a case which spark driver execute some scripts.Then sometimes the driver will be killed.
{code:java}
yarn.174410.log.2019-12-17.000002:2019-12-17,06:59:14,831 WARN org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Container [pid=50529,containerID=container_e917_1576303656075_174957_01_003197] is running beyond physical memory limits. Current usage: 50.28 GB of 5.25 GB physical memory used; xxx. Killing container.
{code}
{code:java}
boolean isProcessTreeOverLimit(String containerId,
long currentMemUsage,
long curMemUsageOfAgedProcesses,
long vmemLimit) {
boolean isOverLimit = false;
/**
if (currentMemUsage > (2 * vmemLimit)) {
LOG.warn("Process tree for container: " + containerId
+ " running over twice " + "the configured limit. Limit=" + vmemLimit
+ ", current usage = " + currentMemUsage);
isOverLimit = true;
}
{code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org