You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Yuqi Wang (JIRA)" <ji...@apache.org> on 2017/09/10 03:47:02 UTC
[jira] [Comment Edited] (HADOOP-14846) Wrong shell exit code if the
shell process cannot be even started
[ https://issues.apache.org/jira/browse/HADOOP-14846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16160202#comment-16160202 ]
Yuqi Wang edited comment on HADOOP-14846 at 9/10/17 3:46 AM:
-------------------------------------------------------------
[~stevel@apache.org]
This issue shows that it happens on winutils and windows. However, the process creation failure may happen on any platform (both windows and linux).
Overall, the point is that, the shell will *hide failures happen before setting the shell exit code to the real shell sub process exit code* (including process creation failures and other failures which may happen before setting).
Anyway, we should avoid this kind of hiding failures, init the exitcode to 0 is easy to hide bugs.
was (Author: yqwang):
[~stevel@apache.org]
This issue shows that it happens on winutils and windows. However, the process creation failure may happen on any platform (both windows and linux).
Overall, the point is that, the shell will *hide failures happen before setting it to the real shell sub process exit code* (including process creation failures and other failures which may happen before setting).
> Wrong shell exit code if the shell process cannot be even started
> -----------------------------------------------------------------
>
> Key: HADOOP-14846
> URL: https://issues.apache.org/jira/browse/HADOOP-14846
> Project: Hadoop Common
> Issue Type: Bug
> Components: util
> Affects Versions: 2.7.1
> Reporter: Yuqi Wang
> Labels: shell
> Fix For: 3.0.0-alpha4
>
> Attachments: HADOOP-14846.001.patch, HADOOP-14846.002.patch
>
>
> *Hadoop may hide shell failures (including start container and fs operation failures), such as:*
> Container exit diagnostics (note the container exit code is 0):
> {code:java}
> Exception from container-launch. Container id: container_e5620_1503888150197_2979_01_003320
> Exit code: 0
> Exception message:
> Cannot run program "D:\data\hadoop.latest\bin\winutils.exe" (in directory "\data\yarnnm\local\usercache\hadoop\appcache\application_1503888150197_2979\container_e5620_1503888150197_2979_01_003320"):
> CreateProcess error=2, The system cannot find the file specified
> Stack trace: java.io.IOException: Cannot run program "D:\data\hadoop.latest\bin\winutils.exe" (in directory "\data\yarnnm\local\usercache\hadoop\appcache\application_1503888150197_2979\container_e5620_1503888150197_2979_01_003320"): CreateProcess error=2, The system cannot find the file specified
> at java.lang.ProcessBuilder.start(ProcessBuilder.java:1048)
> at org.apache.hadoop.util.Shell.runCommand(Shell.java:517)
> at org.apache.hadoop.util.Shell.run(Shell.java:490)
> at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:756)
> at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:212)
> at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:329)
> at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:86)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> {code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org