You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Hangxiang Yu (Jira)" <ji...@apache.org> on 2023/04/21 02:34:00 UTC
[jira] [Created] (FLINK-31875) OSS throwns NoClassDefFoundError due to old hadoop-common version
Hangxiang Yu created FLINK-31875:
------------------------------------
Summary: OSS throwns NoClassDefFoundError due to old hadoop-common version
Key: FLINK-31875
URL: https://issues.apache.org/jira/browse/FLINK-31875
Project: Flink
Issue Type: Bug
Components: FileSystems
Affects Versions: 1.17.0
Reporter: Hangxiang Yu
Assignee: Hangxiang Yu
Fix For: 1.17.1
h2. Problem
When using OSS in 1.17, an exception will be thrown:
{code:java}
java.lang.NoClassDefFoundError: org/apache/hadoop/thirdparty/com/google/common/base/Preconditions
at org.apache.hadoop.fs.aliyun.oss.AliyunOSSUtils.longOption(AliyunOSSUtils.java:221)
at org.apache.hadoop.fs.aliyun.oss.AliyunOSSFileSystem.initialize(AliyunOSSFileSystem.java:343)
at org.apache.flink.fs.osshadoop.OSSFileSystemFactory.create(OSSFileSystemFactory.java:147)
at org.apache.flink.core.fs.FileSystem.getUnguardedFileSystem(FileSystem.java:508)
at org.apache.flink.core.fs.FileSystem.get(FileSystem.java:409)
at org.apache.flink.core.fs.Path.getFileSystem(Path.java:274){code}
h2. Why
After https://issues.apache.org/jira/browse/FLINK-27308 and https://issues.apache.org/jira/browse/FLINK-29502 ,hadoop-aliyun has also be upgraded to 3.3.4 which relys on the newest version of hadoop-common.
OSS still uses the old version (2.10.2) extended from flink-parent so that some classes cannot be found.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)