You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flink.apache.org by ram kumar <ra...@gmail.com> on 2016/02/24 10:38:05 UTC

Error when executing job

Hi,


getting below error when executing twitter flink job,

org.apache.flink.client.program.ProgramInvocationException: The program
execution failed: Job execution failed.
    at org.apache.flink.client.program.Client.runBlocking(Client.java:370)
    at
org.apache.flink.streaming.api.environment.StreamContextEnvironment.execute(StreamContextEnvironment.java:96)
    at com.flink.TwitterFlink.main(TwitterFlink.java:45)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
    at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:606)
    at
org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:497)
    at
org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:395)
    at org.apache.flink.client.program.Client.runBlocking(Client.java:252)
    at
org.apache.flink.client.CliFrontend.executeProgramBlocking(CliFrontend.java:676)
    at org.apache.flink.client.CliFrontend.run(CliFrontend.java:326)
    at
org.apache.flink.client.CliFrontend.parseParameters(CliFrontend.java:978)
    at org.apache.flink.client.CliFrontend.main(CliFrontend.java:1028)
Caused by: org.apache.flink.runtime.client.JobExecutionException: Job
execution failed.
    at
org.apache.flink.runtime.jobmanager.JobManager$$anonfun$handleMessage$1$$anonfun$applyOrElse$5.apply$mcV$sp(JobManager.scala:563)
    at
org.apache.flink.runtime.jobmanager.JobManager$$anonfun$handleMessage$1$$anonfun$applyOrElse$5.apply(JobManager.scala:509)
    at
org.apache.flink.runtime.jobmanager.JobManager$$anonfun$handleMessage$1$$anonfun$applyOrElse$5.apply(JobManager.scala:509)
    at
scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
    at
scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
    at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:41)
    at
akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:401)
    at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
    at
scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
    at
scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
    at
scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
Caused by: java.lang.Exception: Call to registerInputOutput() of invokable
failed
    at org.apache.flink.runtime.taskmanager.Task.run(Task.java:529)
    at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.flink.streaming.runtime.tasks.StreamTaskException:
Cannot load user class:
org.apache.flink.streaming.connectors.twitter.TwitterFilterSource
ClassLoader info: URL ClassLoader:
    file:
'/tmp/blobStore-f32e1c65-7412-4f59-9767-9fd6a1dd41ad/cache/blob_29086aa8f430f5335f527a0fba05b9e6837e0e1b'
(valid JAR)
Class not resolvable through given classloader.
    at
org.apache.flink.streaming.api.graph.StreamConfig.getStreamOperator(StreamConfig.java:187)
    at
org.apache.flink.streaming.runtime.tasks.StreamTask.registerInputOutput(StreamTask.java:174)
    at org.apache.flink.runtime.taskmanager.Task.run(Task.java:526)
    ... 1 more


but i have TwitterFilterSource in pom.xml





















*pom.xml<dependency>        <groupId>com.twitter</groupId>
<artifactId>hbc-core</artifactId>
<version>2.2.0</version></dependency>       <dependency>
<groupId>org.apache.flink</groupId>
<artifactId>flink-streaming-java</artifactId>
<version>0.10.1</version></dependency><dependency>
<groupId>org.apache.flink</groupId>
<artifactId>flink-connector-twitter</artifactId>
<version>0.10.1</version></dependency>*
any inputs?

Thanks

Re: Error when executing job

Posted by Till Rohrmann <tr...@apache.org>.
I assume that you included the flink-connector-twitter dependency in your
job jar, right? Alternatively, you might also put the jar in the lib folder
on each of your machines.

Cheers,
Till
​

On Wed, Feb 24, 2016 at 10:38 AM, ram kumar <ra...@gmail.com> wrote:

> Hi,
>
>
> getting below error when executing twitter flink job,
>
> org.apache.flink.client.program.ProgramInvocationException: The program
> execution failed: Job execution failed.
>     at org.apache.flink.client.program.Client.runBlocking(Client.java:370)
>     at
> org.apache.flink.streaming.api.environment.StreamContextEnvironment.execute(StreamContextEnvironment.java:96)
>     at com.flink.TwitterFlink.main(TwitterFlink.java:45)
>     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>     at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>     at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>     at java.lang.reflect.Method.invoke(Method.java:606)
>     at
> org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:497)
>     at
> org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:395)
>     at org.apache.flink.client.program.Client.runBlocking(Client.java:252)
>     at
> org.apache.flink.client.CliFrontend.executeProgramBlocking(CliFrontend.java:676)
>     at org.apache.flink.client.CliFrontend.run(CliFrontend.java:326)
>     at
> org.apache.flink.client.CliFrontend.parseParameters(CliFrontend.java:978)
>     at org.apache.flink.client.CliFrontend.main(CliFrontend.java:1028)
> Caused by: org.apache.flink.runtime.client.JobExecutionException: Job
> execution failed.
>     at
> org.apache.flink.runtime.jobmanager.JobManager$$anonfun$handleMessage$1$$anonfun$applyOrElse$5.apply$mcV$sp(JobManager.scala:563)
>     at
> org.apache.flink.runtime.jobmanager.JobManager$$anonfun$handleMessage$1$$anonfun$applyOrElse$5.apply(JobManager.scala:509)
>     at
> org.apache.flink.runtime.jobmanager.JobManager$$anonfun$handleMessage$1$$anonfun$applyOrElse$5.apply(JobManager.scala:509)
>     at
> scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
>     at
> scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
>     at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:41)
>     at
> akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:401)
>     at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
>     at
> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
>     at
> scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
>     at
> scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
> Caused by: java.lang.Exception: Call to registerInputOutput() of invokable
> failed
>     at org.apache.flink.runtime.taskmanager.Task.run(Task.java:529)
>     at java.lang.Thread.run(Thread.java:745)
> Caused by: org.apache.flink.streaming.runtime.tasks.StreamTaskException:
> Cannot load user class:
> org.apache.flink.streaming.connectors.twitter.TwitterFilterSource
> ClassLoader info: URL ClassLoader:
>     file:
> '/tmp/blobStore-f32e1c65-7412-4f59-9767-9fd6a1dd41ad/cache/blob_29086aa8f430f5335f527a0fba05b9e6837e0e1b'
> (valid JAR)
> Class not resolvable through given classloader.
>     at
> org.apache.flink.streaming.api.graph.StreamConfig.getStreamOperator(StreamConfig.java:187)
>     at
> org.apache.flink.streaming.runtime.tasks.StreamTask.registerInputOutput(StreamTask.java:174)
>     at org.apache.flink.runtime.taskmanager.Task.run(Task.java:526)
>     ... 1 more
>
>
> but i have TwitterFilterSource in pom.xml
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
> *pom.xml<dependency>        <groupId>com.twitter</groupId>
> <artifactId>hbc-core</artifactId>
> <version>2.2.0</version></dependency>       <dependency>
> <groupId>org.apache.flink</groupId>
> <artifactId>flink-streaming-java</artifactId>
> <version>0.10.1</version></dependency><dependency>
> <groupId>org.apache.flink</groupId>
> <artifactId>flink-connector-twitter</artifactId>
> <version>0.10.1</version></dependency>*
> any inputs?
>
> Thanks
>
>