[GitHub] [incubator-doris] aubdiy commented on issue #7983: [Bug] Broker Load 从 hdfs3.3.1 导入数据到 doris 中, 日志提示Could not initialize class org.apache.hadoop.util.StringUtils

[GitBox <gi...@apache.org>]

aubdiy commented on issue #7983:
URL: https://github.com/apache/incubator-doris/issues/7983#issuecomment-1032392489


   问题已经修复.
   修复过程:
   1.  进入 fs_brokers/apache_hdfs_broker
   2. 执行编译, 编译成功后将 `output/apache_hdfs_broker/lib/apache_hdfs_broker.jar` 保留代用,  然后删除掉 `output` 目录 
   3. 修改 pom.xml 文件中 hadoop 相关依赖,  将 2.7.3 改为 3.3.1
   4. 修改 pom.xml 文件, 删除 hadoop-hdfs 包, 增加  hadoop-hdfs-client 包(3.3.1) 版本
   5. 修改 pom.xml 文件中 hadoop-aws 相关依赖,  将 2.7.3 改为 3.3.1
   6. 修改 `fs_brokers/apache_hdfs_broker/src/main/java/org/apache/doris/broker/hdfs/FileSystemManager.java:[636,15]` 代码, 将 ' } catch (IOException e) {'   替换为 ' } catch (Exception e) {' , 否则编译会提示 
     ```
     [ERROR] /root/incubator-doris-DORIS-0.15.0-release/apache-doris-0.15.0-incubating-src/fs_brokers/apache_hdfs_broker/src/main/java/org/apache/doris/broker/hdfs/FileSystemManager.java:[636,15] exception java.io.IOException is never thrown in body of corresponding try statement
    ```
   7. 执行编译 sh build.sh 
   8. 编译成功后,  将第2 步中的  `apache_hdfs_broker.jar` 覆盖  `output/apache_hdfs_broker/lib/apache_hdfs_broker.jar` 
   9. 重新部署 hdf_broker ,   可以正常导入  


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org