You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flink.apache.org by ro...@informatik.uni-leipzig.de on 2017/12/08 09:23:08 UTC

Problem with runGatherSumApplyIteration

Dear All,

I got the following error when I use the function  
"runGatherSumApplyIteration":
... java.lang.NoSuchMethodError:  
org.apache.flink.api.common.functions.RuntimeContext.hasBroadcastVariable(Ljava/lang/String;)Z

I got this problem even when I use the given example from Flink documentation.

Anyone saw such a problem?

Regards,
Ali

Re: Problem with runGatherSumApplyIteration

Posted by ro...@informatik.uni-leipzig.de.
Dear Stefan,

thanks for your answer.

Here is the flink version:
         <dependency>
             <groupId>org.apache.flink</groupId>
             <artifactId>flink-java</artifactId>
             <version>1.3.2</version>
         </dependency>
         <dependency>
             <groupId>org.apache.flink</groupId>
             <artifactId>flink-gelly_2.11</artifactId>
             <version>1.3.2</version>
         </dependency>
         <dependency>
             <groupId>org.apache.flink</groupId>
             <artifactId>flink-clients_2.11</artifactId>
             <version>1.3.2</version>
         </dependency>

This is the full stack trace:

org.apache.flink.runtime.client.JobExecutionException: Job execution failed.
	at  
org.apache.flink.runtime.jobmanager.JobManager$$anonfun$handleMessage$1$$anonfun$applyOrElse$7.apply$mcV$sp(JobManager.scala:717)
	at  
org.apache.flink.runtime.jobmanager.JobManager$$anonfun$handleMessage$1$$anonfun$applyOrElse$7.apply(JobManager.scala:663)
	at  
org.apache.flink.runtime.jobmanager.JobManager$$anonfun$handleMessage$1$$anonfun$applyOrElse$7.apply(JobManager.scala:663)
	at  
scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
	at  
scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
	at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:41)
	at  
akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:401)
	at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
	at  
scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.pollAndExecAll(ForkJoinPool.java:1253)
	at  
scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1346)
	at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
	at  
scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
Caused by: java.lang.Exception: The user defined 'open()' method  
caused an exception:  
org.apache.flink.api.common.functions.RuntimeContext.hasBroadcastVariable(Ljava/lang/String;)Z
	at org.apache.flink.runtime.operators.BatchTask.run(BatchTask.java:475)
	at  
org.apache.flink.runtime.iterative.task.AbstractIterativeTask.run(AbstractIterativeTask.java:145)
	at  
org.apache.flink.runtime.iterative.task.IterationIntermediateTask.run(IterationIntermediateTask.java:92)
	at org.apache.flink.runtime.operators.BatchTask.invoke(BatchTask.java:345)
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:559)
	at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.NoSuchMethodError:  
org.apache.flink.api.common.functions.RuntimeContext.hasBroadcastVariable(Ljava/lang/String;)Z
	at  
org.apache.flink.graph.spargel.ScatterGatherIteration$ScatterUdfWithEdgeValues.open(ScatterGatherIteration.java:249)
	at  
org.apache.flink.api.common.functions.util.FunctionUtils.openFunction(FunctionUtils.java:38)
	at org.apache.flink.runtime.operators.BatchTask.run(BatchTask.java:471)
	... 5 more

Regards,
Ali


Quoting Stefan Richter <s....@data-artisans.com>:

> Hi,
>
> it would be helpful if you could tell us the Flink version you are  
> using and the full stacktrace. However, this looks like there could  
> be a version conflict, e.g. is your cluster running the same version  
> of Flink that you build your job against?
>
> Best,
> Stefan
>
>> Am 08.12.2017 um 10:23 schrieb rostami@informatik.uni-leipzig.de:
>>
>> Dear All,
>>
>> I got the following error when I use the function  
>> "runGatherSumApplyIteration":
>> ... java.lang.NoSuchMethodError:  
>> org.apache.flink.api.common.functions.RuntimeContext.hasBroadcastVariable(Ljava/lang/String;)Z
>>
>> I got this problem even when I use the given example from Flink  
>> documentation.
>>
>> Anyone saw such a problem?
>>
>> Regards,
>> Ali
>>

Re: Problem with runGatherSumApplyIteration

Posted by Stefan Richter <s....@data-artisans.com>.
Hi,

it would be helpful if you could tell us the Flink version you are using and the full stacktrace. However, this looks like there could be a version conflict, e.g. is your cluster running the same version of Flink that you build your job against?

Best,
Stefan
 
> Am 08.12.2017 um 10:23 schrieb rostami@informatik.uni-leipzig.de:
> 
> Dear All,
> 
> I got the following error when I use the function "runGatherSumApplyIteration":
> ... java.lang.NoSuchMethodError: org.apache.flink.api.common.functions.RuntimeContext.hasBroadcastVariable(Ljava/lang/String;)Z
> 
> I got this problem even when I use the given example from Flink documentation.
> 
> Anyone saw such a problem?
> 
> Regards,
> Ali
>