[jira] [Created] (MAPREDUCE-6322) MapReduce Integration tests with mini cluster fail on Jenkins when path to workspace contains characters which need to be escaped in shell scripts

["Jens Rabe (JIRA)" <ji...@apache.org>]

Jens Rabe created MAPREDUCE-6322:
------------------------------------

             Summary: MapReduce Integration tests with mini cluster fail on Jenkins when path to workspace contains characters which need to be escaped in shell scripts
                 Key: MAPREDUCE-6322
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6322
             Project: Hadoop Map/Reduce
          Issue Type: Bug
    Affects Versions: 2.4.0
         Environment: Jenkins on Linux
            Reporter: Jens Rabe


When building a project with Jenkins which contains integration tests for Map/Reduce jobs, the tests fail when the path to the workspace Jenkins builds in contains characters which need to be escaped in shell scripts, like whitespaces or parentheses.

Example output:
{code}
/application_1429525168682_0001/container_1429525168682_0001_02_000001/default_container_executor.sh: line 3: `echo $$ > /home/jenkins/data/workspace/Some project with whitespaces (and parentheses)/path/to/com.example.someproject/target/test-cluster-cff13b33-ab3f-443d-9e50-c28ce37e9a2a/test-cluster-cff13b33-ab3f-443d-9e50-c28ce37e9a2a-localDir-nm-1_0/nmPrivate/container_1429525168682_0001_02_000001.pid.tmp'

	at org.apache.hadoop.util.Shell.runCommand(Shell.java:505)
	at org.apache.hadoop.util.Shell.run(Shell.java:418)
	at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:650)
	at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:195)
	at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:300)
	at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:81)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)


Container exited with a non-zero exit code 2
.Failing this attempt.. Failing the application.
{code}

The script default_container_executor.sh should be generated in a way that such characters are escaped.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)