You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by "Julien Tournay (JIRA)" <ji...@apache.org> on 2018/03/26 10:10:00 UTC

[jira] [Created] (BEAM-3924) FlinkRunner fails to execute some of beam examples

Julien Tournay created BEAM-3924:
------------------------------------

             Summary: FlinkRunner fails to execute some of beam examples
                 Key: BEAM-3924
                 URL: https://issues.apache.org/jira/browse/BEAM-3924
             Project: Beam
          Issue Type: Bug
          Components: runner-flink
    Affects Versions: 2.4.0
            Reporter: Julien Tournay
            Assignee: Aljoscha Krettek


I'm using:
 * java version "1.8.0_162"
Java(TM) SE Runtime Environment (build 1.8.0_162-b12)
Java HotSpot(TM) 64-Bit Server VM (build 25.162-b12, mixed mode)
 * Fink Version: 1.4.2, Commit ID: 04e4c85
 * Beam 2.4.0

The examples are executed using a local Flink cluster as in [Flink's Quickstart|https://ci.apache.org/projects/flink/flink-docs-stable/quickstart/setup_quickstart.html].
Most of the examples (WordCount, WindowedWordCount, etc.) are running fine.
h4. The following example runs but thrown an exception:
{code:java}
mvn exec:java -Dexec.mainClass=org.apache.beam.examples.complete.TrafficRoutes \
    -Pflink-runner \
    -Dexec.args="--runner=FlinkRunner \
      --flinkMaster=localhost:6123 \
      --filesToStage=/private/tmp/word-count-beam/target/word-count-beam-bundled-0.1.jar \
      --tempLocation=gs://julient/temp \
      --bigQueryDataset=julient \
      --bigQueryTable=traffic_routes"
{code}
{code:java}
[WARNING]
java.lang.UnsupportedOperationException: FlinkRunnerResult does not support cancel.
    at org.apache.beam.runners.flink.FlinkRunnerResult.cancel (FlinkRunnerResult.java:64)
    at org.apache.beam.examples.common.ExampleUtils.lambda$addShutdownHook$0 (ExampleUtils.java:357)
    at java.lang.Thread.run (Thread.java:748)
{code}
Although an exception is thrown, the output BigQuery table is populated. 
h4. The following example runs but throws an exception and do not produce any output data:
{code}
mvn exec:java -Dexec.mainClass=org.apache.beam.examples.complete.TrafficMaxLaneFlow \
    -Pflink-runner \
    -Dexec.args="--runner=FlinkRunner \
      --inputFile=gs://apache-beam-samples/traffic_sensor/Freeways-5Minaa2010-01-01_to_2010-02-15_test2.csv \
      --flinkMaster=localhost:6123 \
      --filesToStage=target/word-count-beam-bundled-0.1.jar \
      --tempLocation=gs://julient/temp \
      --bigQueryDataset=julient \
      --bigQueryTable=traffic_max_lane_flow"
{code}
The exception is the same as the previous example:
{code:java}
[WARNING]
java.lang.UnsupportedOperationException: FlinkRunnerResult does not support cancel.
at org.apache.beam.runners.flink.FlinkRunnerResult.cancel (FlinkRunnerResult.java:64)
at org.apache.beam.examples.common.ExampleUtils.lambda$addShutdownHook$0 (ExampleUtils.java:357)
at java.lang.Thread.run (Thread.java:748){code}
 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)