You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by GitBox <gi...@apache.org> on 2022/06/04 21:03:36 UTC

[GitHub] [beam] damccorm opened a new issue, #21085: Flink's job server container attempts to invoke docker

damccorm opened a new issue, #21085:
URL: https://github.com/apache/beam/issues/21085

   I want to run a Java pipeline with `--runner PortableRunner`, so I do the following:
    * Run the Flink's job server with:
   
   ```
   
   docker run --rm --net=host apache/beam_flink1.13_job_server:latest
   
   ```
   
   
    * Run the pipeline with:
   
   ```
   
   mvn exec:java -Dexec.mainClass=org.foo.bar.MyMainClass -Pportable-runner -Dexec.args="--runner=PortableRunner
   --jobEndpoint=localhost:8099"
   
   ```
   
   
   After this I get the error:
   ```
   
   java.lang.Exception: The user defined 'open()' method caused an exception: java.io.IOException: Cannot
   run program "docker": error=2, No such file or directory
   	at org.apache.flink.runtime.operators.BatchTask.run(BatchTask.java:513)
   	at
   org.apache.flink.runtime.operators.BatchTask.invoke(BatchTask.java:360)
   	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:779)
   	at
   org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
   	at java.lang.Thread.run(Thread.java:748)
   ```
   
   What I did to workaround this is to use the `gradlew` script from the Git repository like this:
   ```
   
   ./gradlew :runners:flink:1.13:job-server:runShadow
   
   ```
   
   and it works without problem.
   
   Imported from Jira [BEAM-12642](https://issues.apache.org/jira/browse/BEAM-12642). Original Jira may contain additional context.
   Reported by: itaranto.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org