You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-dev@hadoop.apache.org by "Vinod Kumar Vavilapalli (JIRA)" <ji...@apache.org> on 2015/05/03 04:07:06 UTC
[jira] [Resolved] (YARN-492) Too many open files error to launch a
container
[ https://issues.apache.org/jira/browse/YARN-492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vinod Kumar Vavilapalli resolved YARN-492.
------------------------------------------
Resolution: Won't Fix
Agree with analysis from [~hitesh] and [~revans2]. Resolving this as won't fix.
May be YARN-220 can help though, if we come around to having a fix there.
> Too many open files error to launch a container
> -----------------------------------------------
>
> Key: YARN-492
> URL: https://issues.apache.org/jira/browse/YARN-492
> Project: Hadoop YARN
> Issue Type: Bug
> Affects Versions: 2.0.0-alpha
> Environment: RedHat Linux
> Reporter: Krishna Kishore Bonagiri
>
> I am running a date command with YARN's distributed shell example in a loop of 1000 times in this way:
> yarn jar /home/kbonagir/yarn/hadoop-2.0.0-alpha/share/hadoop/mapreduce/hadoop-yarn-applications-distributedshell-2.0.0-alpha.jar org.apache.hadoop.yarn.applications.distributedshell.Client --jar /home/kbonagir/yarn/hadoop-2.0.0-alpha/share/hadoop/mapreduce/hadoop-yarn-applications-distributedshell-2.0.0-alpha.jar --shell_command date --num_containers 2
> Around 730th time or so, I am getting an error in node manager's log saying that it failed to launch container because there are "Too many open files" and when I observe through lsof command,I find that there is one instance of this kind of file is left for each run of Application Master, and it kept growing as I am running it in loop.
> node1:44871->node1:50010
> Thanks,
> Kishore
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)