[jira] [Created] (BEAM-1203) Exception when running apex runner in non embedded mode

["Pramod Immaneni (JIRA)" <ji...@apache.org>]

Pramod Immaneni created BEAM-1203:
-------------------------------------

             Summary: Exception when running apex runner in non embedded mode
                 Key: BEAM-1203
                 URL: https://issues.apache.org/jira/browse/BEAM-1203
             Project: Beam
          Issue Type: Bug
          Components: runner-apex
    Affects Versions: 0.5.0-incubating
            Reporter: Pramod Immaneni


Tried to run the word count example application using apex runner on yarn with the command below (the command refers to local files so app when running will not be able to access these files but that is a different issue). There is an exception and the application does not get launched.

mvn exec:java -Dexec.mainClass=org.apache.beam.examples.WordCount -Dexec.args="--inputFile=/home/pramod/Development/test/kinglear.txt --output=/home/pramod/Development/test/wordcounts.txt --runner=ApexRunner --embeddedExecution=false" -Papex-runner

java.nio.file.FileAlreadyExistsException: META-INF/
	at com.sun.nio.zipfs.ZipFileSystem.createDirectory(ZipFileSystem.java:422)
	at com.sun.nio.zipfs.ZipPath.createDirectory(ZipPath.java:634)
	at com.sun.nio.zipfs.ZipFileSystemProvider.createDirectory(ZipFileSystemProvider.java:201)
	at java.nio.file.Files.createDirectory(Files.java:630)
	at org.apache.beam.runners.apex.ApexYarnLauncher$2.preVisitDirectory(ApexYarnLauncher.java:266)
	at org.apache.beam.runners.apex.ApexYarnLauncher$2.preVisitDirectory(ApexYarnLauncher.java:252)
	at java.nio.file.FileTreeWalker.walk(FileTreeWalker.java:192)
	at java.nio.file.FileTreeWalker.walk(FileTreeWalker.java:199)
	at java.nio.file.FileTreeWalker.walk(FileTreeWalker.java:69)
	at java.nio.file.Files.walkFileTree(Files.java:2602)
	at java.nio.file.Files.walkFileTree(Files.java:2635)
	at org.apache.beam.runners.apex.ApexYarnLauncher.createJar(ApexYarnLauncher.java:252)
	at org.apache.beam.runners.apex.ApexYarnLauncher.launchApp(ApexYarnLauncher.java:90)
	at org.apache.beam.runners.apex.ApexRunner.run(ApexRunner.java:149)
	at org.apache.beam.runners.apex.ApexRunner.run(ApexRunner.java:63)
	at org.apache.beam.sdk.Pipeline.run(Pipeline.java:176)
	at org.apache.beam.examples.WordCount.main(WordCount.java:184)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.codehaus.mojo.exec.ExecJavaMojo$1.run(ExecJavaMojo.java:293)
	at java.lang.Thread.run(Thread.java:745)




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)