[jira] [Created] (BEAM-1141) Beam Quickstart doesn't work on DataflowRunner

["Jason Kuster (JIRA)" <ji...@apache.org>]

Jason Kuster created BEAM-1141:
----------------------------------

             Summary: Beam Quickstart doesn't work on DataflowRunner
                 Key: BEAM-1141
                 URL: https://issues.apache.org/jira/browse/BEAM-1141
             Project: Beam
          Issue Type: Bug
            Reporter: Jason Kuster
            Assignee: Davor Bonaci


Repro steps:

In new dir, run current archetype:generate command:

{code}
mvn archetype:generate \
      -DarchetypeRepository=https://repository.apache.org/content/groups/snapshots \
      -DarchetypeGroupId=org.apache.beam \
      -DarchetypeArtifactId=beam-sdks-java-maven-archetypes-examples \
      -DarchetypeVersion=LATEST \
      -DgroupId=org.example \
      -DartifactId=word-count-beam \
      -Dversion="0.1" \
      -Dpackage=org.apache.beam.examples \
      -DinteractiveMode=false
{code}

Then run the sample command for DataflowRunner:

{code}
mvn compile exec:java -Dexec.mainClass=org.apache.beam.examples.WordCount \
	 -Dexec.args="--runner=DataflowRunner --gcpTempLocation=gs://<your-gcs-bucket>/tmp \
	              --inputFile=gs://apache-beam-samples/shakespeare/* --output=gs://<your-gcs-bucket>/counts"
{code}

Expected outcome: WordCount runs on Dataflow

Actual outcome:

{code}
[INFO] --- exec-maven-plugin:1.4.0:java (default-cli) @ word-count-beam ---
[WARNING]
java.lang.reflect.InvocationTargetException
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.codehaus.mojo.exec.ExecJavaMojo$1.run(ExecJavaMojo.java:293)
	at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.IllegalArgumentException: Unknown 'runner' specified 'DataflowRunner', supported pipeline runners [DirectRunner]
	at org.apache.beam.sdk.options.PipelineOptionsFactory.parseObjects(PipelineOptionsFactory.java:1610)
	at org.apache.beam.sdk.options.PipelineOptionsFactory.access$400(PipelineOptionsFactory.java:105)
	at org.apache.beam.sdk.options.PipelineOptionsFactory$Builder.as(PipelineOptionsFactory.java:290)
	at org.apache.beam.examples.WordCount.main(WordCount.java:174)
	... 6 more
Caused by: java.lang.ClassNotFoundException: DataflowRunner
	at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
	at java.lang.Class.forName0(Native Method)
	at java.lang.Class.forName(Class.java:264)
	at org.apache.beam.sdk.options.PipelineOptionsFactory.parseObjects(PipelineOptionsFactory.java:1596)
	... 9 more
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 17.916 s
[INFO] Finished at: 2016-12-12T16:38:55-08:00
[INFO] Final Memory: 29M/266M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.4.0:java (default-cli) on project word-count-beam: An exception occured while executing the Java class. null: InvocationTargetException: Unknown 'runner' specified 'DataflowRunner', supported pipeline runners [DirectRunner] -> [Help 1]
{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)