Question regarding java.lang.NoSuchMethodError in flink-s3-fs-hadoop.jar

[Leon Xu <lx...@attentivemobile.com>]

Hi Flink Users,

I am getting this exception after upgrading flink-s3-fs-hadoop from 1.15.3
to 1.16.0.

*java.lang.NoSuchMethodError:
'com.google.protobuf.Descriptors$FileDescriptor
org.apache.hadoop.security.proto.SecurityProtos.getDescriptor()'*

After looking into the content of the flink-s3-fs-hadoop:1.16.0 jar. It
looks like in the org.apache.hadoop.security.proto.SecurityProtos class,
the method signature is:
*public static
org.apache.hadoop.thirdparty.protobuf.Descriptors$FileDescriptor
getDescriptor();*
while in flink-s3-fs-hadoop:1.15.3 jar, I can see the correct method
signature in SecurityProtos.class below:
*public static com.google.protobuf.Descriptors$FileDescriptor
getDescriptor();*

I guess that's why I see the exception in 1.16.0 but not in 1.15.3. I am
wondering if there's any workaround/solution for that exception in 1.16.0?


Thanks
Leon