You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by GitBox <gi...@apache.org> on 2022/06/03 20:29:42 UTC

[GitHub] [beam] kennknowles opened a new issue, #18800: FlinkRunner fails to execute some of beam examples

kennknowles opened a new issue, #18800:
URL: https://github.com/apache/beam/issues/18800

   I'm using:
    * java version "1.8.0_162"
   Java(TM) SE Runtime Environment (build 1.8.0_162-b12)
   Java HotSpot(TM) 64-Bit Server VM (build 25.162-b12, mixed mode)
    * Fink Version: 1.4.2, Commit ID: 04e4c85
    * Beam 2.4.0
   
   The examples are executed using a local Flink cluster as in [Flink's Quickstart](https://ci.apache.org/projects/flink/flink-docs-stable/quickstart/setup_quickstart.html).
   Most of the examples (WordCount, WindowedWordCount, etc.) are running fine.
   #### The following example runs but thrown an exception:
   ```
   
   mvn exec:java -Dexec.mainClass=org.apache.beam.examples.complete.TrafficRoutes \
       -Pflink-runner
   \
       -Dexec.args="--runner=FlinkRunner \
         --flinkMaster=localhost:6123 \
         --filesToStage=/private/tmp/word-count-beam/target/word-count-beam-bundled-0.1.jar
   \
         --tempLocation=gs://julient/temp \
         --bigQueryDataset=julient \
         --bigQueryTable=traffic_routes"
   
   ```
   
   ```
   
   [WARNING]
   java.lang.UnsupportedOperationException: FlinkRunnerResult does not support cancel.
     
    at org.apache.beam.runners.flink.FlinkRunnerResult.cancel (FlinkRunnerResult.java:64)
       at org.apache.beam.examples.common.ExampleUtils.lambda$addShutdownHook$0
   (ExampleUtils.java:357)
       at java.lang.Thread.run (Thread.java:748)
   
   ```
   
   Although an exception is thrown, the output BigQuery table is populated. 
   #### The following example runs but throws an exception and do not produce any output data:
   ```
   
   mvn exec:java -Dexec.mainClass=org.apache.beam.examples.complete.TrafficMaxLaneFlow \
       -Pflink-runner
   \
       -Dexec.args="--runner=FlinkRunner \
         --inputFile=gs://apache-beam-samples/traffic_sensor/Freeways-5Minaa2010-01-01_to_2010-02-15_test2.csv
   \
         --flinkMaster=localhost:6123 \
         --filesToStage=target/word-count-beam-bundled-0.1.jar
   \
         --tempLocation=gs://julient/temp \
         --bigQueryDataset=julient \
         --bigQueryTable=traffic_max_lane_flow"
   
   ```
   
   The exception is the same as the previous example:
   ```
   
   [WARNING]
   java.lang.UnsupportedOperationException: FlinkRunnerResult does not support cancel.
   at
   org.apache.beam.runners.flink.FlinkRunnerResult.cancel (FlinkRunnerResult.java:64)
   at org.apache.beam.examples.common.ExampleUtils.lambda$addShutdownHook$0
   (ExampleUtils.java:357)
   at java.lang.Thread.run (Thread.java:748)
   ```
   
    
   
   Imported from Jira [BEAM-3924](https://issues.apache.org/jira/browse/BEAM-3924). Original Jira may contain additional context.
   Reported by: jto.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [beam] kennknowles closed issue #18800: FlinkRunner fails to execute some of beam examples

Posted by "kennknowles (via GitHub)" <gi...@apache.org>.
kennknowles closed issue #18800: FlinkRunner fails to execute some of beam examples
URL: https://github.com/apache/beam/issues/18800


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [beam] jto commented on issue #18800: FlinkRunner fails to execute some of beam examples

Posted by "jto (via GitHub)" <gi...@apache.org>.
jto commented on issue #18800:
URL: https://github.com/apache/beam/issues/18800#issuecomment-1437210967

   Hey there! 
   We've been using the Flink runner in production for a while now and never ran into the issue.
   Feel free to close the issue (I am the original reporter) :)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [beam] kennknowles commented on issue #18800: FlinkRunner fails to execute some of beam examples

Posted by "kennknowles (via GitHub)" <gi...@apache.org>.
kennknowles commented on issue #18800:
URL: https://github.com/apache/beam/issues/18800#issuecomment-1448656637

   Thanks!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org