You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Hangxiang Yu (Jira)" <ji...@apache.org> on 2023/04/21 02:35:00 UTC

[jira] [Updated] (FLINK-31875) OSS throwns NoClassDefFoundError due to old hadoop-common version

     [ https://issues.apache.org/jira/browse/FLINK-31875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Hangxiang Yu updated FLINK-31875:
---------------------------------
        Fix Version/s: 1.16.2
    Affects Version/s: 1.16.0

> OSS throwns NoClassDefFoundError due to old hadoop-common version
> -----------------------------------------------------------------
>
>                 Key: FLINK-31875
>                 URL: https://issues.apache.org/jira/browse/FLINK-31875
>             Project: Flink
>          Issue Type: Bug
>          Components: FileSystems
>    Affects Versions: 1.16.0, 1.17.0
>            Reporter: Hangxiang Yu
>            Assignee: Hangxiang Yu
>            Priority: Major
>             Fix For: 1.16.2, 1.17.1
>
>
> h2. Problem
> When using OSS in 1.17, an exception will be thrown:
> {code:java}
> java.lang.NoClassDefFoundError: org/apache/hadoop/thirdparty/com/google/common/base/Preconditions
> at org.apache.hadoop.fs.aliyun.oss.AliyunOSSUtils.longOption(AliyunOSSUtils.java:221)
> at org.apache.hadoop.fs.aliyun.oss.AliyunOSSFileSystem.initialize(AliyunOSSFileSystem.java:343)
> at org.apache.flink.fs.osshadoop.OSSFileSystemFactory.create(OSSFileSystemFactory.java:147)
> at org.apache.flink.core.fs.FileSystem.getUnguardedFileSystem(FileSystem.java:508)
> at org.apache.flink.core.fs.FileSystem.get(FileSystem.java:409)
> at org.apache.flink.core.fs.Path.getFileSystem(Path.java:274){code}
> h2. Why
> After https://issues.apache.org/jira/browse/FLINK-27308 and  https://issues.apache.org/jira/browse/FLINK-29502 ,hadoop-aliyun has also be upgraded to 3.3.4 which relys on the newest version of hadoop-common.
> OSS still uses the old version (2.10.2) extended from flink-parent so that some classes cannot be found.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)