You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user-zh@flink.apache.org by hechuan <ti...@163.com> on 2020/07/28 09:37:43 UTC

Re: flink作业提交到集群执行异常

Hi，
遇到了同样的问题，请教下是如何解决的？
编译jar包为单独的jar，非jar-with-dependencies的方式，依赖的jar包放到了自定义一个目录lib1
修改了bin/flink脚本，CC_CLASSPATH追加了自定义jar目录lib1，lib1目录下能找到这个类
$ grep org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer *
Binary file flink-sql-connector-kafka_2.12-1.11.1.jar matches

flink/lib目录和自定义的lib目录里面没有重复的文件

org.apache.flink.streaming.runtime.tasks.StreamTaskException: Cannot load
user class: org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer
ClassLoader info: URL ClassLoader:
    file:
'/tmp/blobStore-72796b24-2be1-4bc7-ac86-7acd1fe16b48/job_f532b11a7342424cdc0695126071f96e/blob_p-3dc0956f6379ef65c8f54997d7fe4a4d0918064c-b96f6980c6e06d9618abd63d25c1cee6'
(valid JAR)
Class not resolvable through given classloader.
        at
org.apache.flink.streaming.api.graph.StreamConfig.getStreamOperatorFactory(StreamConfig.java:288)
~[flink-dist_2.11-1.11.1.jar:1.11.1]
        at
org.apache.flink.streaming.runtime.tasks.OperatorChain.<init>(OperatorChain.java:126)
~[flink-dist_2.11-1.11.1.jar:1.11.1]
        at
org.apache.flink.streaming.runtime.tasks.StreamTask.beforeInvoke(StreamTask.java:453)
~[flink-dist_2.11-1.11.1.jar:1.11.1]
        at
org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:522)
~[flink-dist_2.11-1.11.1.jar:1.11.1]
        at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:721)
~[flink-dist_2.11-1.11.1.jar:1.11.1]
        at org.apache.flink.runtime.taskmanager.Task.run(Task.java:546)
~[flink-dist_2.11-1.11.1.jar:1.11.1]
        at java.lang.Thread.run(Thread.java:748) ~[?:1.8.0_251]
Caused by: java.lang.ClassNotFoundException:
org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer
        at java.net.URLClassLoader.findClass(URLClassLoader.java:382)
~[?:1.8.0_251]
        at java.lang.ClassLoader.loadClass(ClassLoader.java:418)
~[?:1.8.0_251]
        at
org.apache.flink.util.FlinkUserCodeClassLoader.loadClassWithoutExceptionHandling(FlinkUserCodeClassLoader.java:61)
~[flink-dist_2.11-1.11.1.jar:1.11.1]




--
Sent from: http://apache-flink.147419.n8.nabble.com/

Re: flink作业提交到集群执行异常

Posted by hechuan <ti...@163.com>.
定位到问题了，我这里是scala的版本不一致导致的
部分maven引用的2.11，部分引用的2.12，统一版本后这个报错就不存在了




--
Sent from: http://apache-flink.147419.n8.nabble.com/