You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by "Julien Tournay (JIRA)" <ji...@apache.org> on 2018/03/26 10:10:00 UTC
[jira] [Created] (BEAM-3924) FlinkRunner fails to execute some of
beam examples
Julien Tournay created BEAM-3924:
------------------------------------
Summary: FlinkRunner fails to execute some of beam examples
Key: BEAM-3924
URL: https://issues.apache.org/jira/browse/BEAM-3924
Project: Beam
Issue Type: Bug
Components: runner-flink
Affects Versions: 2.4.0
Reporter: Julien Tournay
Assignee: Aljoscha Krettek
I'm using:
* java version "1.8.0_162"
Java(TM) SE Runtime Environment (build 1.8.0_162-b12)
Java HotSpot(TM) 64-Bit Server VM (build 25.162-b12, mixed mode)
* Fink Version: 1.4.2, Commit ID: 04e4c85
* Beam 2.4.0
The examples are executed using a local Flink cluster as in [Flink's Quickstart|https://ci.apache.org/projects/flink/flink-docs-stable/quickstart/setup_quickstart.html].
Most of the examples (WordCount, WindowedWordCount, etc.) are running fine.
h4. The following example runs but thrown an exception:
{code:java}
mvn exec:java -Dexec.mainClass=org.apache.beam.examples.complete.TrafficRoutes \
-Pflink-runner \
-Dexec.args="--runner=FlinkRunner \
--flinkMaster=localhost:6123 \
--filesToStage=/private/tmp/word-count-beam/target/word-count-beam-bundled-0.1.jar \
--tempLocation=gs://julient/temp \
--bigQueryDataset=julient \
--bigQueryTable=traffic_routes"
{code}
{code:java}
[WARNING]
java.lang.UnsupportedOperationException: FlinkRunnerResult does not support cancel.
at org.apache.beam.runners.flink.FlinkRunnerResult.cancel (FlinkRunnerResult.java:64)
at org.apache.beam.examples.common.ExampleUtils.lambda$addShutdownHook$0 (ExampleUtils.java:357)
at java.lang.Thread.run (Thread.java:748)
{code}
Although an exception is thrown, the output BigQuery table is populated.
h4. The following example runs but throws an exception and do not produce any output data:
{code}
mvn exec:java -Dexec.mainClass=org.apache.beam.examples.complete.TrafficMaxLaneFlow \
-Pflink-runner \
-Dexec.args="--runner=FlinkRunner \
--inputFile=gs://apache-beam-samples/traffic_sensor/Freeways-5Minaa2010-01-01_to_2010-02-15_test2.csv \
--flinkMaster=localhost:6123 \
--filesToStage=target/word-count-beam-bundled-0.1.jar \
--tempLocation=gs://julient/temp \
--bigQueryDataset=julient \
--bigQueryTable=traffic_max_lane_flow"
{code}
The exception is the same as the previous example:
{code:java}
[WARNING]
java.lang.UnsupportedOperationException: FlinkRunnerResult does not support cancel.
at org.apache.beam.runners.flink.FlinkRunnerResult.cancel (FlinkRunnerResult.java:64)
at org.apache.beam.examples.common.ExampleUtils.lambda$addShutdownHook$0 (ExampleUtils.java:357)
at java.lang.Thread.run (Thread.java:748){code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)