You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Weiwei Yang (JIRA)" <ji...@apache.org> on 2016/11/23 05:54:58 UTC
[jira] [Comment Edited] (YARN-5040) CPU Isolation with CGroups
triggers kernel panics on Centos 7.1/7.2 when
yarn.nodemanager.resource.percentage-physical-cpu-limit < 100
[ https://issues.apache.org/jira/browse/YARN-5040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15689035#comment-15689035 ]
Weiwei Yang edited comment on YARN-5040 at 11/23/16 5:54 AM:
-------------------------------------------------------------
Hi [~Tao Jie]
Have you analysed the vmcore dump file? Do you think it is a same issue reported in this bugzilla ticket https://bugzilla.linux.ibm.com/show_bug.cgi?id=128504
was (Author: cheersyang):
Hi [~Tao Jie]
Have you analysed the vmcore dump file? Do you think it is a same issue reported in this bugzilla ticket https://bugzilla.linux.ibm.com/show_bug.cgi?id=128504?
> CPU Isolation with CGroups triggers kernel panics on Centos 7.1/7.2 when yarn.nodemanager.resource.percentage-physical-cpu-limit < 100
> --------------------------------------------------------------------------------------------------------------------------------------
>
> Key: YARN-5040
> URL: https://issues.apache.org/jira/browse/YARN-5040
> Project: Hadoop YARN
> Issue Type: Bug
> Affects Versions: 2.9.0
> Reporter: Sidharta Seethana
> Assignee: Varun Vasudev
>
> /cc [~vvasudev]
> We have been running some benchmarks internally with resource isolation enabled. We have consistently run into kernel panics when running a large job ( a large pi job, terasort ). These kernel panics wen't away when we set yarn.nodemanager.resource.percentage-physical-cpu-limit=100 . Anything less than 100 triggers different behavior in YARN's CPU resource handler which seems to cause these issues. Looking at the kernel crash dumps, the backtraces were different - sometimes pointing to java processes, sometimes not.
> Kernel versions used : 3.10.0-229.14.1.el7.x86_64 and 3.10.0-327.13.1.el7.x86_64 .
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org