You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@fluss.apache.org by "929359291 (via GitHub)" <gi...@apache.org> on 2025/08/22 09:53:45 UTC

[I] Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hdfs.HdfsConfiguration [fluss]

929359291 opened a new issue, #1576:
URL: https://github.com/apache/fluss/issues/1576

   ### Search before asking
   
   - [x] I searched in the [issues](https://github.com/alibaba/fluss/issues) and found nothing similar.
   
   
   ### Fluss version
   
   0.7.0 (latest release)
   
   ### Please describe the bug 🐞
   
   cat conf/server.yaml
   ```
   zookeeper.address: pro08:12181
   
   default.bucket.number: 1
   
   default.replication.factor: 1
   
   data.dir: /tmp/fluss-data
   
   remote.data.dir: hdfs:///fluss
   
   bind.listeners: FLUSS://pro08:9123
   ```
   
   ./bin/local-cluster.sh start
   ```
   2025-08-22 17:48:21,575 ERROR com.alibaba.fluss.server.ServerBase                          [] - Could not start the CoordinatorServer.
   com.alibaba.fluss.fs.UnsupportedFileSystemSchemeException: Cannot support file system for 'hdfs' via Hadoop, because Hadoop is not in the classpath, or some classes are missing from the classpath.
           at com.alibaba.fluss.fs.hdfs.HadoopFsPlugin.create(HadoopFsPlugin.java:160) ~[?:?]
           at com.alibaba.fluss.fs.PluginFileSystemWrapper.create(PluginFileSystemWrapper.java:58) ~[fluss-server-0.7.0.jar:0.7.0]
           at com.alibaba.fluss.fs.FileSystem.lambda$getUnguardedFileSystem$3(FileSystem.java:400) ~[fluss-server-0.7.0.jar:0.7.0]
           at com.alibaba.fluss.utils.concurrent.LockUtils.inLock(LockUtils.java:41) ~[fluss-server-0.7.0.jar:0.7.0]
           at com.alibaba.fluss.fs.FileSystem.getUnguardedFileSystem(FileSystem.java:305) ~[fluss-server-0.7.0.jar:0.7.0]
           at com.alibaba.fluss.fs.FileSystem.get(FileSystem.java:300) ~[fluss-server-0.7.0.jar:0.7.0]
           at com.alibaba.fluss.fs.FsPath.getFileSystem(FsPath.java:264) ~[fluss-server-0.7.0.jar:0.7.0]
           at com.alibaba.fluss.server.ServerBase.start(ServerBase.java:116) [fluss-server-0.7.0.jar:0.7.0]
           at com.alibaba.fluss.server.ServerBase.startServer(ServerBase.java:88) [fluss-server-0.7.0.jar:0.7.0]
           at com.alibaba.fluss.server.coordinator.CoordinatorServer.main(CoordinatorServer.java:154) [fluss-server-0.7.0.jar:0.7.0]
   Caused by: java.lang.NoClassDefFoundError: org/apache/hadoop/hdfs/HdfsConfiguration
           at com.alibaba.fluss.fs.hdfs.HadoopFsPlugin.create(HadoopFsPlugin.java:70) ~[?:?]
           ... 9 more
   Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hdfs.HdfsConfiguration
           at java.net.URLClassLoader.findClass(URLClassLoader.java:387) ~[?:1.8.0_392]
           at java.lang.ClassLoader.loadClass(ClassLoader.java:418) ~[?:1.8.0_392]
           at com.alibaba.fluss.classloading.ComponentClassLoader.loadClassFromComponentOnly(ComponentClassLoader.java:152) ~[fluss-server-0.7.0.jar:0.7.0]
           at com.alibaba.fluss.classloading.ComponentClassLoader.loadClass(ComponentClassLoader.java:115) ~[fluss-server-0.7.0.jar:0.7.0]
           at java.lang.ClassLoader.loadClass(ClassLoader.java:351) ~[?:1.8.0_392]
           at com.alibaba.fluss.fs.hdfs.HadoopFsPlugin.create(HadoopFsPlugin.java:70) ~[?:?]
           ... 9 more
   2025-08-22 17:48:21,581 ERROR com.alibaba.fluss.server.ServerBase                          [] - Could not start CoordinatorServer.
   com.alibaba.fluss.exception.FlussException: Failed to start the CoordinatorServer.
           at com.alibaba.fluss.server.ServerBase.start(ServerBase.java:131) ~[fluss-server-0.7.0.jar:0.7.0]
           at com.alibaba.fluss.server.ServerBase.startServer(ServerBase.java:88) [fluss-server-0.7.0.jar:0.7.0]
           at com.alibaba.fluss.server.coordinator.CoordinatorServer.main(CoordinatorServer.java:154) [fluss-server-0.7.0.jar:0.7.0]
   Caused by: com.alibaba.fluss.fs.UnsupportedFileSystemSchemeException: Cannot support file system for 'hdfs' via Hadoop, because Hadoop is not in the classpath, or some classes are missing from the classpath.
           at com.alibaba.fluss.fs.hdfs.HadoopFsPlugin.create(HadoopFsPlugin.java:160) ~[?:?]
           at com.alibaba.fluss.fs.PluginFileSystemWrapper.create(PluginFileSystemWrapper.java:58) ~[fluss-server-0.7.0.jar:0.7.0]
           at com.alibaba.fluss.fs.FileSystem.lambda$getUnguardedFileSystem$3(FileSystem.java:400) ~[fluss-server-0.7.0.jar:0.7.0]
           at com.alibaba.fluss.utils.concurrent.LockUtils.inLock(LockUtils.java:41) ~[fluss-server-0.7.0.jar:0.7.0]
           at com.alibaba.fluss.fs.FileSystem.getUnguardedFileSystem(FileSystem.java:305) ~[fluss-server-0.7.0.jar:0.7.0]
           at com.alibaba.fluss.fs.FileSystem.get(FileSystem.java:300) ~[fluss-server-0.7.0.jar:0.7.0]
           at com.alibaba.fluss.fs.FsPath.getFileSystem(FsPath.java:264) ~[fluss-server-0.7.0.jar:0.7.0]
           at com.alibaba.fluss.server.ServerBase.start(ServerBase.java:116) ~[fluss-server-0.7.0.jar:0.7.0]
           ... 2 more
   Caused by: java.lang.NoClassDefFoundError: org/apache/hadoop/hdfs/HdfsConfiguration
           at com.alibaba.fluss.fs.hdfs.HadoopFsPlugin.create(HadoopFsPlugin.java:70) ~[?:?]
           at com.alibaba.fluss.fs.PluginFileSystemWrapper.create(PluginFileSystemWrapper.java:58) ~[fluss-server-0.7.0.jar:0.7.0]
           at com.alibaba.fluss.fs.FileSystem.lambda$getUnguardedFileSystem$3(FileSystem.java:400) ~[fluss-server-0.7.0.jar:0.7.0]
           at com.alibaba.fluss.utils.concurrent.LockUtils.inLock(LockUtils.java:41) ~[fluss-server-0.7.0.jar:0.7.0]
           at com.alibaba.fluss.fs.FileSystem.getUnguardedFileSystem(FileSystem.java:305) ~[fluss-server-0.7.0.jar:0.7.0]
           at com.alibaba.fluss.fs.FileSystem.get(FileSystem.java:300) ~[fluss-server-0.7.0.jar:0.7.0]
           at com.alibaba.fluss.fs.FsPath.getFileSystem(FsPath.java:264) ~[fluss-server-0.7.0.jar:0.7.0]
           at com.alibaba.fluss.server.ServerBase.start(ServerBase.java:116) ~[fluss-server-0.7.0.jar:0.7.0]
           ... 2 more
   Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hdfs.HdfsConfiguration
           at java.net.URLClassLoader.findClass(URLClassLoader.java:387) ~[?:1.8.0_392]
           at java.lang.ClassLoader.loadClass(ClassLoader.java:418) ~[?:1.8.0_392]
           at com.alibaba.fluss.classloading.ComponentClassLoader.loadClassFromComponentOnly(ComponentClassLoader.java:152) ~[fluss-server-0.7.0.jar:0.7.0]
           at com.alibaba.fluss.classloading.ComponentClassLoader.loadClass(ComponentClassLoader.java:115) ~[fluss-server-0.7.0.jar:0.7.0]
           at java.lang.ClassLoader.loadClass(ClassLoader.java:351) ~[?:1.8.0_392]
           at com.alibaba.fluss.fs.hdfs.HadoopFsPlugin.create(HadoopFsPlugin.java:70) ~[?:?]
           at com.alibaba.fluss.fs.PluginFileSystemWrapper.create(PluginFileSystemWrapper.java:58) ~[fluss-server-0.7.0.jar:0.7.0]
           at com.alibaba.fluss.fs.FileSystem.lambda$getUnguardedFileSystem$3(FileSystem.java:400) ~[fluss-server-0.7.0.jar:0.7.0]
           at com.alibaba.fluss.utils.concurrent.LockUtils.inLock(LockUtils.java:41) ~[fluss-server-0.7.0.jar:0.7.0]
           at com.alibaba.fluss.fs.FileSystem.getUnguardedFileSystem(FileSystem.java:305) ~[fluss-server-0.7.0.jar:0.7.0]
           at com.alibaba.fluss.fs.FileSystem.get(FileSystem.java:300) ~[fluss-server-0.7.0.jar:0.7.0]
           at com.alibaba.fluss.fs.FsPath.getFileSystem(FsPath.java:264) ~[fluss-server-0.7.0.jar:0.7.0]
           at com.alibaba.fluss.server.ServerBase.start(ServerBase.java:116) ~[fluss-server-0.7.0.jar:0.7.0]
           ... 2 more
   ```
   
   ll fluss/lib
   ```
   -rw-r--r--. 1 502 games 83967330 Jun 12  2023 fluss-server-0.7.0.jar
   -rw-r--r--. 1 502 games   208006 Jun 12  2023 log4j-1.2-api-2.17.1.jar
   -rw-r--r--. 1 502 games   301872 Jun 12  2023 log4j-api-2.17.1.jar
   -rw-r--r--. 1 502 games  1790452 Jun 12  2023 log4j-core-2.17.1.jar
   -rw-r--r--. 1 502 games    24279 Jun 12  2023 log4j-slf4j-impl-2.17.1.jar
   ```
   
   ll fluss/plugins/hdfs/
   ```
   -rw-r--r--. 1 root root  43317025 Aug 22 17:48 flink-shaded-hadoop-2-uber-2.8.3-10.0.jar
   -rw-r--r--. 1  502 games 47931693 Jun 12  2023 fluss-fs-hadoop-0.7.0.jar
   ```
   
   
   
   ### Solution
   
   _No response_
   
   ### Are you willing to submit a PR?
   
   - [ ] I'm willing to submit a PR!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@fluss.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hdfs.HdfsConfiguration [fluss]

Posted by "wuchong (via GitHub)" <gi...@apache.org>.
wuchong closed issue #1576: Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hdfs.HdfsConfiguration
URL: https://github.com/apache/fluss/issues/1576


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@fluss.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hdfs.HdfsConfiguration [fluss]

Posted by "wuchong (via GitHub)" <gi...@apache.org>.
wuchong closed issue #1576: Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hdfs.HdfsConfiguration
URL: https://github.com/apache/fluss/issues/1576


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@fluss.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hdfs.HdfsConfiguration [fluss]

Posted by "luoyuxia (via GitHub)" <gi...@apache.org>.
luoyuxia commented on issue #1576:
URL: https://github.com/apache/fluss/issues/1576#issuecomment-3213794436

   Seem same issue to #1314 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@fluss.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org