You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Ignacio Taranto (Jira)" <ji...@apache.org> on 2021/07/21 14:02:00 UTC

[jira] [Created] (BEAM-12642) Flink's job server container attempts to invoke docker

Ignacio Taranto created BEAM-12642:
--------------------------------------

             Summary: Flink's job server container attempts to invoke docker
                 Key: BEAM-12642
                 URL: https://issues.apache.org/jira/browse/BEAM-12642
             Project: Beam
          Issue Type: Bug
          Components: runner-flink
    Affects Versions: 2.31.0
         Environment: Linux
            Reporter: Ignacio Taranto


I want to run a Java pipeline with {{--runner PortableRunner}}, so I do the following:
 * Run the Flink's job server with:

{code:java}
docker run --rm --net=host apache/beam_flink1.13_job_server:latest
{code}

 * Run the pipeline with:

{code:java}
mvn exec:java -Dexec.mainClass=org.foo.bar.MyMainClass -Pportable-runner -Dexec.args="--runner=PortableRunner --jobEndpoint=localhost:8099"
{code}

After this I get the error:
{code:java}
java.lang.Exception: The user defined 'open()' method caused an exception: java.io.IOException: Cannot run program "docker": error=2, No such file or directory
	at org.apache.flink.runtime.operators.BatchTask.run(BatchTask.java:513)
	at org.apache.flink.runtime.operators.BatchTask.invoke(BatchTask.java:360)
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:779)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
	at java.lang.Thread.run(Thread.java:748){code}
What I did to workaround this is to use the {{gradlew}} script from the Git repository like this:
{code:java}
./gradlew :runners:flink:1.13:job-server:runShadow
{code}
and it works without problem.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)