You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Hangxiang Yu (Jira)" <ji...@apache.org> on 2023/04/21 02:34:00 UTC

[jira] [Created] (FLINK-31875) OSS throwns NoClassDefFoundError due to old hadoop-common version

Hangxiang Yu created FLINK-31875:
------------------------------------

             Summary: OSS throwns NoClassDefFoundError due to old hadoop-common version
                 Key: FLINK-31875
                 URL: https://issues.apache.org/jira/browse/FLINK-31875
             Project: Flink
          Issue Type: Bug
          Components: FileSystems
    Affects Versions: 1.17.0
            Reporter: Hangxiang Yu
            Assignee: Hangxiang Yu
             Fix For: 1.17.1


h2. Problem

When using OSS in 1.17, an exception will be thrown:
{code:java}
java.lang.NoClassDefFoundError: org/apache/hadoop/thirdparty/com/google/common/base/Preconditions

at org.apache.hadoop.fs.aliyun.oss.AliyunOSSUtils.longOption(AliyunOSSUtils.java:221)
at org.apache.hadoop.fs.aliyun.oss.AliyunOSSFileSystem.initialize(AliyunOSSFileSystem.java:343)
at org.apache.flink.fs.osshadoop.OSSFileSystemFactory.create(OSSFileSystemFactory.java:147)
at org.apache.flink.core.fs.FileSystem.getUnguardedFileSystem(FileSystem.java:508)
at org.apache.flink.core.fs.FileSystem.get(FileSystem.java:409)
at org.apache.flink.core.fs.Path.getFileSystem(Path.java:274){code}
h2. Why


After https://issues.apache.org/jira/browse/FLINK-27308 and  https://issues.apache.org/jira/browse/FLINK-29502 ,hadoop-aliyun has also be upgraded to 3.3.4 which relys on the newest version of hadoop-common.

OSS still uses the old version (2.10.2) extended from flink-parent so that some classes cannot be found.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)