[jira] [Created] (FLINK-31939) ClassNotFoundException on org.apache.beam.runners.flink.translation.wrappers.SourceInputFormat when running Flink 1.14 and up with Beam 2.46.0

["AmitK (Jira)" <ji...@apache.org>]

AmitK created FLINK-31939:
-----------------------------

             Summary: ClassNotFoundException on org.apache.beam.runners.flink.translation.wrappers.SourceInputFormat when running Flink 1.14 and up with Beam 2.46.0
                 Key: FLINK-31939
                 URL: https://issues.apache.org/jira/browse/FLINK-31939
             Project: Flink
          Issue Type: Bug
    Affects Versions: 1.15.4, 1.16.0, 1.14.2
            Reporter: AmitK


While running some basic Beam code that is reading a file and transforming it for further processing, I am unable to get past the following error thrown, that prevents the job master from starting up when I try to run/deploy a fat jar on Flink. I'm using Apache Beam 2.46.0, with Java 11 and beam flink runner 1.14 with a local Flink instance that's on 1.14.2.

 

It looks to be some form of class-loading issue, and while I've tried later version of Flink, all produce the same error. Appreciate any help with this.

 

Caused by: java.lang.ClassNotFoundException: org.apache.beam.runners.flink.translation.wrappers.SourceInputFormat
        at java.base/java.net.URLClassLoader.findClass(URLClassLoader.java:476)
        at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:589)
        at org.apache.flink.util.FlinkUserCodeClassLoader.loadClassWithoutExceptionHandling(FlinkUserCodeClassLoader.java:64)
        at org.apache.flink.util.ChildFirstClassLoader.loadClassWithoutExceptionHandling(ChildFirstClassLoader.java:74)
        at org.apache.flink.util.FlinkUserCodeClassLoader.loadClass(FlinkUserCodeClassLoader.java:48)
        at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:522)
        at org.apache.flink.runtime.execution.librarycache.FlinkUserCodeClassLoaders$SafetyNetWrapperClassLoader.loadClass(FlinkUserCodeClassLoaders.java:172)
        at java.base/java.lang.Class.forName0(Native Method)
        at java.base/java.lang.Class.forName(Class.java:398)
        at org.apache.flink.util.InstantiationUtil$ClassLoaderObjectInputStream.resolveClass(InstantiationUtil.java:78)

 

 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)