You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flink.apache.org by Alexander Smirnov <as...@five9.com> on 2017/10/12 14:30:29 UTC

Submitting a job via command line

Hello All,

I got the following error while attempting to execute a job via command line:

[root@flink01 bin]# ./flink run -c com.five9.stream.PrecomputeJob /vagrant/flink-precompute-1.0-SNAPSHOT.jar -Xmx2048m -Xms2048m
Cluster configuration: Standalone cluster with JobManager at flink01.pb.lx-draskin5.five9.com/10.11.132.110:6123
Using address flink01.pb.lx-draskin5.five9.com:6123 to connect to JobManager.
JobManager web interface address http://flink01.pb.lx-draskin5.five9.com:8081<http://flink01.pb.lx-draskin5.five9.com:8081/>
Starting execution of program
Submitting job with JobID: 222a9d44d2069ab3cc41866c8f37777a. Waiting for job completion.
Connected to JobManager at Actor[akka.tcp://flink@flink01.pb.lx-draskin5.five9.com<ma...@flink01.pb.lx-draskin5.five9.com>:6123/user/jobmanager#-1899708478] with leader session id 00000000-0000-0000-0000-000000000000.

------------------------------------------------------------
The program finished with the following exception:

org.apache.flink.client.program.ProgramInvocationException: The program execution failed: Couldn't retrieve the JobExecutionResult from the JobManager.
        at org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:478)
        at org.apache.flink.client.program.StandaloneClusterClient.submitJob(StandaloneClusterClient.java:105)
        at org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:442)
        at org.apache.flink.streaming.api.environment.StreamContextEnvironment.execute(StreamContextEnvironment.java:73)
        at org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.execute(StreamExecutionEnvironment.java:1499)
        at com.five9.stream.PrecomputeJob.execute(PrecomputeJob.java:137)
        at com.five9.stream.PrecomputeJob.configureAndExecute(PrecomputeJob.java:78)
        at com.five9.stream.PrecomputeJob.main(PrecomputeJob.java:65)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:528)
        at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:419)
        at org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:381)
        at org.apache.flink.client.CliFrontend.executeProgram(CliFrontend.java:838)
        at org.apache.flink.client.CliFrontend.run(CliFrontend.java:259)
        at org.apache.flink.client.CliFrontend.parseParameters(CliFrontend.java:1086)
        at org.apache.flink.client.CliFrontend$2.call(CliFrontend.java:1133)
        at org.apache.flink.client.CliFrontend$2.call(CliFrontend.java:1130)
        at org.apache.flink.runtime.security.HadoopSecurityContext$1.run(HadoopSecurityContext.java:43)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
        at org.apache.flink.runtime.security.HadoopSecurityContext.runSecured(HadoopSecurityContext.java:40)
        at org.apache.flink.client.CliFrontend.main(CliFrontend.java:1130)
Caused by: org.apache.flink.runtime.client.JobExecutionException: Couldn't retrieve the JobExecutionResult from the JobManager.
        at org.apache.flink.runtime.client.JobClient.awaitJobResult(JobClient.java:309)
        at org.apache.flink.runtime.client.JobClient.submitJobAndWait(JobClient.java:396)
        at org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:467)
        ... 25 more
Caused by: org.apache.flink.runtime.client.JobClientActorSubmissionTimeoutException: Job submission to the JobManager timed out. You may increase 'akka.client.timeout' in case the JobManager needs more time to configure and confirm the job submission.
        at org.apache.flink.runtime.client.JobSubmissionClientActor.handleCustomMessage(JobSubmissionClientActor.java:119)
        at org.apache.flink.runtime.client.JobClientActor.handleMessage(JobClientActor.java:251)
        at org.apache.flink.runtime.akka.FlinkUntypedActor.handleLeaderSessionID(FlinkUntypedActor.java:89)
        at org.apache.flink.runtime.akka.FlinkUntypedActor.onReceive(FlinkUntypedActor.java:68)
        at akka.actor.UntypedActor$$anonfun$receive$1.applyOrElse(UntypedActor.scala:167)
        at akka.actor.Actor$class.aroundReceive(Actor.scala:467)
        at akka.actor.UntypedActor.aroundReceive(UntypedActor.scala:97)
        at akka.actor.ActorCell.receiveMessage(ActorCell.scala:516)
        at akka.actor.ActorCell.invoke(ActorCell.scala:487)
        at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:238)
        at akka.dispatch.Mailbox.run(Mailbox.scala:220)
        at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:397)
        at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
        at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
        at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
        at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)

But it has been successfully submitted through Web UI using ‘Submit new Job’.

Can you please help me to understand what is the difference between CLI ‘flink run’ and WEB ‘Submit new Job’?
And how do I run the job via CLI?

--
Thanks,
Alex

________________________________

CONFIDENTIALITY NOTICE: This e-mail and any files attached may contain confidential information of Five9 and/or its affiliated entities. Access by the intended recipient only is authorized. Any liability arising from any party acting, or refraining from acting, on any information contained in this e-mail is hereby excluded. If you are not the intended recipient, please notify the sender immediately, destroy the original transmission and its attachments and do not disclose the contents to any other person, use it for any purpose, or store or copy the information in any medium. Copyright in this e-mail and any attachments belongs to Five9 and/or its affiliated entities.

Re: Submitting a job via command line

Posted by Piotr Nowojski <pi...@data-artisans.com>.
Good to hear that :)


> On 13 Oct 2017, at 14:40, Alexander Smirnov <as...@five9.com> wrote:
> 
> Thank you so much, it helped!
> 
> From: Piotr Nowojski <piotr@data-artisans.com <ma...@data-artisans.com>>
> Date: Thursday, October 12, 2017 at 6:00 PM
> To: Alexander Smirnov <asmirnov@five9.com <ma...@five9.com>>
> Cc: "user@flink.apache.org <ma...@flink.apache.org>" <user@flink.apache.org <ma...@flink.apache.org>>
> Subject: Re: Submitting a job via command line
> 
> Have you tried this 
> http://mail-archives.apache.org/mod_mbox/flink-user/201705.mbox/%3CCAGr9p8BXhLJseEXwzvXLk+drotyp1yxjY4N4_qgeRdzxz8UQEA@mail.gmail.com%3E <http://mail-archives.apache.org/mod_mbox/flink-user/201705.mbox/%3CCAGr9p8BXhLJseEXwzvXLk+drotyp1yxjY4N4_qgeRdzxz8UQEA@mail.gmail.com%3E>
> ?
> 
> Piotrek
> 
>> On 12 Oct 2017, at 16:30, Alexander Smirnov <asmirnov@five9.com <ma...@five9.com>> wrote:
>> 
>> Hello All,
>>  
>> I got the following error while attempting to execute a job via command line:
>> 
>> [root@flink01 bin]# ./flink run -c com.five9.stream.PrecomputeJob /vagrant/flink-precompute-1.0-SNAPSHOT.jar -Xmx2048m -Xms2048m
>> Cluster configuration: Standalone cluster with JobManager at flink01.pb.lx-draskin5.five9.com/10.11.132.110:6123 <http://flink01.pb.lx-draskin5.five9.com/10.11.132.110:6123>
>> Using address flink01.pb.lx-draskin5.five9.com:6123 <http://flink01.pb.lx-draskin5.five9.com:6123/> to connect to JobManager.
>> JobManager web interface address http://flink01.pb.lx-draskin5.five9.com:8081 <http://flink01.pb.lx-draskin5.five9.com:8081/>
>> Starting execution of program
>> Submitting job with JobID: 222a9d44d2069ab3cc41866c8f37777a. Waiting for job completion.
>> Connected to JobManager at Actor[akka.tcp://flink@flink01.pb.lx-draskin5.five9.com <ma...@flink01.pb.lx-draskin5.five9.com>:6123/user/jobmanager#-1899708478] with leader session id 00000000-0000-0000-0000-000000000000.
>>  
>> ------------------------------------------------------------
>> The program finished with the following exception:
>>  
>> org.apache.flink.client.program.ProgramInvocationException: The program execution failed: Couldn't retrieve the JobExecutionResult from the JobManager.
>>         at org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:478)
>>         at org.apache.flink.client.program.StandaloneClusterClient.submitJob(StandaloneClusterClient.java:105)
>>         at org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:442)
>>         at org.apache.flink.streaming.api.environment.StreamContextEnvironment.execute(StreamContextEnvironment.java:73)
>>         at org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.execute(StreamExecutionEnvironment.java:1499)
>>         at com.five9.stream.PrecomputeJob.execute(PrecomputeJob.java:137)
>>         at com.five9.stream.PrecomputeJob.configureAndExecute(PrecomputeJob.java:78)
>>         at com.five9.stream.PrecomputeJob.main(PrecomputeJob.java:65)
>>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>         at java.lang.reflect.Method.invoke(Method.java:498)
>>         at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:528)
>>         at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:419)
>>         at org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:381)
>>         at org.apache.flink.client.CliFrontend.executeProgram(CliFrontend.java:838)
>>         at org.apache.flink.client.CliFrontend.run(CliFrontend.java:259)
>>         at org.apache.flink.client.CliFrontend.parseParameters(CliFrontend.java:1086)
>>         at org.apache.flink.client.CliFrontend$2.call(CliFrontend.java:1133)
>>         at org.apache.flink.client.CliFrontend$2.call(CliFrontend.java:1130)
>>         at org.apache.flink.runtime.security.HadoopSecurityContext$1.run(HadoopSecurityContext.java:43)
>>         at java.security.AccessController.doPrivileged(Native Method)
>>         at javax.security.auth.Subject.doAs(Subject.java:422)
>>         at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
>>         at org.apache.flink.runtime.security.HadoopSecurityContext.runSecured(HadoopSecurityContext.java:40)
>>         at org.apache.flink.client.CliFrontend.main(CliFrontend.java:1130)
>> Caused by: org.apache.flink.runtime.client.JobExecutionException: Couldn't retrieve the JobExecutionResult from the JobManager.
>>         at org.apache.flink.runtime.client.JobClient.awaitJobResult(JobClient.java:309)
>>         at org.apache.flink.runtime.client.JobClient.submitJobAndWait(JobClient.java:396)
>>         at org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:467)
>>         ... 25 more
>> Caused by: org.apache.flink.runtime.client.JobClientActorSubmissionTimeoutException: Job submission to the JobManager timed out. You may increase 'akka.client.timeout' in case the JobManager needs more time to configure and confirm the job submission.
>>         at org.apache.flink.runtime.client.JobSubmissionClientActor.handleCustomMessage(JobSubmissionClientActor.java:119)
>>         at org.apache.flink.runtime.client.JobClientActor.handleMessage(JobClientActor.java:251)
>>         at org.apache.flink.runtime.akka.FlinkUntypedActor.handleLeaderSessionID(FlinkUntypedActor.java:89)
>>         at org.apache.flink.runtime.akka.FlinkUntypedActor.onReceive(FlinkUntypedActor.java:68)
>>         at akka.actor.UntypedActor$$anonfun$receive$1.applyOrElse(UntypedActor.scala:167)
>>         at akka.actor.Actor$class.aroundReceive(Actor.scala:467)
>>         at akka.actor.UntypedActor.aroundReceive(UntypedActor.scala:97)
>>         at akka.actor.ActorCell.receiveMessage(ActorCell.scala:516)
>>         at akka.actor.ActorCell.invoke(ActorCell.scala:487)
>>         at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:238)
>>         at akka.dispatch.Mailbox.run(Mailbox.scala:220)
>>         at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:397)
>>         at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
>>         at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
>>         at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
>>         at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
>>  
>> But it has been successfully submitted through Web UI using ‘Submit new Job’.
>> 
>> Can you please help me to understand what is the difference between CLI ‘flink run’ and WEB ‘Submit new Job’?
>> And how do I run the job via CLI?
>> 
>> -- 
>> Thanks,
>> Alex
>> 
>> 
>> CONFIDENTIALITY NOTICE: This e-mail and any files attached may contain confidential information of Five9 and/or its affiliated entities. Access by the intended recipient only is authorized. Any liability arising from any party acting, or refraining from acting, on any information contained in this e-mail is hereby excluded. If you are not the intended recipient, please notify the sender immediately, destroy the original transmission and its attachments and do not disclose the contents to any other person, use it for any purpose, or store or copy the information in any medium. Copyright in this e-mail and any attachments belongs to Five9 and/or its affiliated entities.
> 
> 
> 
> CONFIDENTIALITY NOTICE: This e-mail and any files attached may contain confidential information of Five9 and/or its affiliated entities. Access by the intended recipient only is authorized. Any liability arising from any party acting, or refraining from acting, on any information contained in this e-mail is hereby excluded. If you are not the intended recipient, please notify the sender immediately, destroy the original transmission and its attachments and do not disclose the contents to any other person, use it for any purpose, or store or copy the information in any medium. Copyright in this e-mail and any attachments belongs to Five9 and/or its affiliated entities.

Re: Submitting a job via command line

Posted by Alexander Smirnov <as...@five9.com>.
Thank you so much, it helped!

From: Piotr Nowojski <pi...@data-artisans.com>>
Date: Thursday, October 12, 2017 at 6:00 PM
To: Alexander Smirnov <as...@five9.com>>
Cc: "user@flink.apache.org<ma...@flink.apache.org>" <us...@flink.apache.org>>
Subject: Re: Submitting a job via command line

Have you tried this
http://mail-archives.apache.org/mod_mbox/flink-user/201705.mbox/%3CCAGr9p8BXhLJseEXwzvXLk+drotyp1yxjY4N4_qgeRdzxz8UQEA@mail.gmail.com%3E<ht...@mail.gmail.com>>
?

Piotrek

On 12 Oct 2017, at 16:30, Alexander Smirnov <as...@five9.com>> wrote:

Hello All,

I got the following error while attempting to execute a job via command line:

[root@flink01 bin]# ./flink run -c com.five9.stream.PrecomputeJob /vagrant/flink-precompute-1.0-SNAPSHOT.jar -Xmx2048m -Xms2048m
Cluster configuration: Standalone cluster with JobManager at flink01.pb.lx-draskin5.five9.com/10.11.132.110:6123<http://flink01.pb.lx-draskin5.five9.com/10.11.132.110:6123>
Using address flink01.pb.lx-draskin5.five9.com:6123<http://flink01.pb.lx-draskin5.five9.com:6123> to connect to JobManager.
JobManager web interface address http://flink01.pb.lx-draskin5.five9.com:8081<http://flink01.pb.lx-draskin5.five9.com:8081/>
Starting execution of program
Submitting job with JobID: 222a9d44d2069ab3cc41866c8f37777a. Waiting for job completion.
Connected to JobManager at Actor[akka.tcp://flink@flink01.pb.lx-draskin5.five9.com<ma...@flink01.pb.lx-draskin5.five9.com>:6123/user/jobmanager#-1899708478] with leader session id 00000000-0000-0000-0000-000000000000.

------------------------------------------------------------
The program finished with the following exception:

org.apache.flink.client.program.ProgramInvocationException: The program execution failed: Couldn't retrieve the JobExecutionResult from the JobManager.
        at org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:478)
        at org.apache.flink.client.program.StandaloneClusterClient.submitJob(StandaloneClusterClient.java:105)
        at org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:442)
        at org.apache.flink.streaming.api.environment.StreamContextEnvironment.execute(StreamContextEnvironment.java:73)
        at org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.execute(StreamExecutionEnvironment.java:1499)
        at com.five9.stream.PrecomputeJob.execute(PrecomputeJob.java:137)
        at com.five9.stream.PrecomputeJob.configureAndExecute(PrecomputeJob.java:78)
        at com.five9.stream.PrecomputeJob.main(PrecomputeJob.java:65)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:528)
        at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:419)
        at org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:381)
        at org.apache.flink.client.CliFrontend.executeProgram(CliFrontend.java:838)
        at org.apache.flink.client.CliFrontend.run(CliFrontend.java:259)
        at org.apache.flink.client.CliFrontend.parseParameters(CliFrontend.java:1086)
        at org.apache.flink.client.CliFrontend$2.call(CliFrontend.java:1133)
        at org.apache.flink.client.CliFrontend$2.call(CliFrontend.java:1130)
        at org.apache.flink.runtime.security.HadoopSecurityContext$1.run(HadoopSecurityContext.java:43)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
        at org.apache.flink.runtime.security.HadoopSecurityContext.runSecured(HadoopSecurityContext.java:40)
        at org.apache.flink.client.CliFrontend.main(CliFrontend.java:1130)
Caused by: org.apache.flink.runtime.client.JobExecutionException: Couldn't retrieve the JobExecutionResult from the JobManager.
        at org.apache.flink.runtime.client.JobClient.awaitJobResult(JobClient.java:309)
        at org.apache.flink.runtime.client.JobClient.submitJobAndWait(JobClient.java:396)
        at org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:467)
        ... 25 more
Caused by: org.apache.flink.runtime.client.JobClientActorSubmissionTimeoutException: Job submission to the JobManager timed out. You may increase 'akka.client.timeout' in case the JobManager needs more time to configure and confirm the job submission.
        at org.apache.flink.runtime.client.JobSubmissionClientActor.handleCustomMessage(JobSubmissionClientActor.java:119)
        at org.apache.flink.runtime.client.JobClientActor.handleMessage(JobClientActor.java:251)
        at org.apache.flink.runtime.akka.FlinkUntypedActor.handleLeaderSessionID(FlinkUntypedActor.java:89)
        at org.apache.flink.runtime.akka.FlinkUntypedActor.onReceive(FlinkUntypedActor.java:68)
        at akka.actor.UntypedActor$$anonfun$receive$1.applyOrElse(UntypedActor.scala:167)
        at akka.actor.Actor$class.aroundReceive(Actor.scala:467)
        at akka.actor.UntypedActor.aroundReceive(UntypedActor.scala:97)
        at akka.actor.ActorCell.receiveMessage(ActorCell.scala:516)
        at akka.actor.ActorCell.invoke(ActorCell.scala:487)
        at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:238)
        at akka.dispatch.Mailbox.run(Mailbox.scala:220)
        at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:397)
        at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
        at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
        at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
        at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)

But it has been successfully submitted through Web UI using ‘Submit new Job’.

Can you please help me to understand what is the difference between CLI ‘flink run’ and WEB ‘Submit new Job’?
And how do I run the job via CLI?

--
Thanks,
Alex

________________________________

CONFIDENTIALITY NOTICE: This e-mail and any files attached may contain confidential information of Five9 and/or its affiliated entities. Access by the intended recipient only is authorized. Any liability arising from any party acting, or refraining from acting, on any information contained in this e-mail is hereby excluded. If you are not the intended recipient, please notify the sender immediately, destroy the original transmission and its attachments and do not disclose the contents to any other person, use it for any purpose, or store or copy the information in any medium. Copyright in this e-mail and any attachments belongs to Five9 and/or its affiliated entities.


________________________________

CONFIDENTIALITY NOTICE: This e-mail and any files attached may contain confidential information of Five9 and/or its affiliated entities. Access by the intended recipient only is authorized. Any liability arising from any party acting, or refraining from acting, on any information contained in this e-mail is hereby excluded. If you are not the intended recipient, please notify the sender immediately, destroy the original transmission and its attachments and do not disclose the contents to any other person, use it for any purpose, or store or copy the information in any medium. Copyright in this e-mail and any attachments belongs to Five9 and/or its affiliated entities.

Re: Submitting a job via command line

Posted by Piotr Nowojski <pi...@data-artisans.com>.
Have you tried this 
http://mail-archives.apache.org/mod_mbox/flink-user/201705.mbox/%3CCAGr9p8BXhLJseEXwzvXLk+drotyp1yxjY4N4_qgeRdzxz8UQEA@mail.gmail.com%3E <http://mail-archives.apache.org/mod_mbox/flink-user/201705.mbox/%3CCAGr9p8BXhLJseEXwzvXLk+drotyp1yxjY4N4_qgeRdzxz8UQEA@mail.gmail.com%3E>
?

Piotrek

> On 12 Oct 2017, at 16:30, Alexander Smirnov <as...@five9.com> wrote:
> 
> Hello All,
>  
> I got the following error while attempting to execute a job via command line:
> 
> [root@flink01 bin]# ./flink run -c com.five9.stream.PrecomputeJob /vagrant/flink-precompute-1.0-SNAPSHOT.jar -Xmx2048m -Xms2048m
> Cluster configuration: Standalone cluster with JobManager at flink01.pb.lx-draskin5.five9.com/10.11.132.110:6123
> Using address flink01.pb.lx-draskin5.five9.com:6123 to connect to JobManager.
> JobManager web interface address http://flink01.pb.lx-draskin5.five9.com:8081 <http://flink01.pb.lx-draskin5.five9.com:8081/>
> Starting execution of program
> Submitting job with JobID: 222a9d44d2069ab3cc41866c8f37777a. Waiting for job completion.
> Connected to JobManager at Actor[akka.tcp://flink@flink01.pb.lx-draskin5.five9.com <ma...@flink01.pb.lx-draskin5.five9.com>:6123/user/jobmanager#-1899708478] with leader session id 00000000-0000-0000-0000-000000000000.
>  
> ------------------------------------------------------------
> The program finished with the following exception:
>  
> org.apache.flink.client.program.ProgramInvocationException: The program execution failed: Couldn't retrieve the JobExecutionResult from the JobManager.
>         at org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:478)
>         at org.apache.flink.client.program.StandaloneClusterClient.submitJob(StandaloneClusterClient.java:105)
>         at org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:442)
>         at org.apache.flink.streaming.api.environment.StreamContextEnvironment.execute(StreamContextEnvironment.java:73)
>         at org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.execute(StreamExecutionEnvironment.java:1499)
>         at com.five9.stream.PrecomputeJob.execute(PrecomputeJob.java:137)
>         at com.five9.stream.PrecomputeJob.configureAndExecute(PrecomputeJob.java:78)
>         at com.five9.stream.PrecomputeJob.main(PrecomputeJob.java:65)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:498)
>         at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:528)
>         at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:419)
>         at org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:381)
>         at org.apache.flink.client.CliFrontend.executeProgram(CliFrontend.java:838)
>         at org.apache.flink.client.CliFrontend.run(CliFrontend.java:259)
>         at org.apache.flink.client.CliFrontend.parseParameters(CliFrontend.java:1086)
>         at org.apache.flink.client.CliFrontend$2.call(CliFrontend.java:1133)
>         at org.apache.flink.client.CliFrontend$2.call(CliFrontend.java:1130)
>         at org.apache.flink.runtime.security.HadoopSecurityContext$1.run(HadoopSecurityContext.java:43)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at javax.security.auth.Subject.doAs(Subject.java:422)
>         at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
>         at org.apache.flink.runtime.security.HadoopSecurityContext.runSecured(HadoopSecurityContext.java:40)
>         at org.apache.flink.client.CliFrontend.main(CliFrontend.java:1130)
> Caused by: org.apache.flink.runtime.client.JobExecutionException: Couldn't retrieve the JobExecutionResult from the JobManager.
>         at org.apache.flink.runtime.client.JobClient.awaitJobResult(JobClient.java:309)
>         at org.apache.flink.runtime.client.JobClient.submitJobAndWait(JobClient.java:396)
>         at org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:467)
>         ... 25 more
> Caused by: org.apache.flink.runtime.client.JobClientActorSubmissionTimeoutException: Job submission to the JobManager timed out. You may increase 'akka.client.timeout' in case the JobManager needs more time to configure and confirm the job submission.
>         at org.apache.flink.runtime.client.JobSubmissionClientActor.handleCustomMessage(JobSubmissionClientActor.java:119)
>         at org.apache.flink.runtime.client.JobClientActor.handleMessage(JobClientActor.java:251)
>         at org.apache.flink.runtime.akka.FlinkUntypedActor.handleLeaderSessionID(FlinkUntypedActor.java:89)
>         at org.apache.flink.runtime.akka.FlinkUntypedActor.onReceive(FlinkUntypedActor.java:68)
>         at akka.actor.UntypedActor$$anonfun$receive$1.applyOrElse(UntypedActor.scala:167)
>         at akka.actor.Actor$class.aroundReceive(Actor.scala:467)
>         at akka.actor.UntypedActor.aroundReceive(UntypedActor.scala:97)
>         at akka.actor.ActorCell.receiveMessage(ActorCell.scala:516)
>         at akka.actor.ActorCell.invoke(ActorCell.scala:487)
>         at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:238)
>         at akka.dispatch.Mailbox.run(Mailbox.scala:220)
>         at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:397)
>         at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
>         at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
>         at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
>         at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
>  
> But it has been successfully submitted through Web UI using ‘Submit new Job’.
> 
> Can you please help me to understand what is the difference between CLI ‘flink run’ and WEB ‘Submit new Job’?
> And how do I run the job via CLI?
> 
> -- 
> Thanks,
> Alex
> 
> 
> CONFIDENTIALITY NOTICE: This e-mail and any files attached may contain confidential information of Five9 and/or its affiliated entities. Access by the intended recipient only is authorized. Any liability arising from any party acting, or refraining from acting, on any information contained in this e-mail is hereby excluded. If you are not the intended recipient, please notify the sender immediately, destroy the original transmission and its attachments and do not disclose the contents to any other person, use it for any purpose, or store or copy the information in any medium. Copyright in this e-mail and any attachments belongs to Five9 and/or its affiliated entities.