[GitHub] [dolphinscheduler] dachn commented on issue #7878: [Bug] [task-api] java.lang.NoClassDefFoundError: org/apache/hadoop/conf/Configuration

[GitBox <gi...@apache.org>]

dachn commented on issue #7878:
URL: https://github.com/apache/dolphinscheduler/issues/7878#issuecomment-1100624784

   i got the same problems when is run hive sql in 2.0.0:
   
   
   [ERROR] 2022-04-16 17:33:41.835 org.apache.dolphinscheduler.server.worker.runner.TaskExecuteThread:[210] - task scheduler failure
   java.lang.NoClassDefFoundError: org/apache/hadoop/conf/Configuration
           at org.apache.dolphinscheduler.plugin.task.util.CommonUtils.loadKerberosConf(CommonUtils.java:84)
           at org.apache.dolphinscheduler.plugin.task.datasource.hive.HiveDatasourceProcessor.getConnection(HiveDatasourceProcessor.java:129)
           at org.apache.dolphinscheduler.plugin.task.datasource.DatasourceUtil.getConnection(DatasourceUtil.java:59)
           at org.apache.dolphinscheduler.plugin.task.sql.SqlTask.executeFuncAndSql(SqlTask.java:184)
           at org.apache.dolphinscheduler.plugin.task.sql.SqlTask.handle(SqlTask.java:155)
           at org.apache.dolphinscheduler.server.worker.runner.TaskExecuteThread.run(TaskExecuteThread.java:192)
           at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
           at java.util.concurrent.FutureTask.run(FutureTask.java:266)
           at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
           at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
           at java.lang.Thread.run(Thread.java:748)
   [INFO] 2022-04-16 17:33:42.835 org.apache.dolphinscheduler.service.log.LogClientService:[117] - view log path /dolphinscheduler-2.0.0/logs/5205789032448_1/11348/20123.log。
   
   but i found the jar(hadoop-common-2.7.3.jar) exists in lib path:
   lib]# ls |grep hadoop
   hadoop-annotations-2.7.3.jar
   hadoop-auth-2.7.3.jar
   hadoop-aws-2.7.3.jar
   hadoop-client-2.7.3.jar
   **hadoop-common-2.7.3.jar**
   hadoop-hdfs-2.7.3.jar
   hadoop-mapreduce-client-app-2.7.3.jar
   hadoop-mapreduce-client-common-2.7.3.jar
   hadoop-mapreduce-client-core-2.7.3.jar
   hadoop-mapreduce-client-jobclient-2.7.3.jar
   hadoop-mapreduce-client-shuffle-2.7.3.jar
   hadoop-yarn-api-2.7.3.jar
   hadoop-yarn-client-2.7.3.jar
   hadoop-yarn-common-2.7.3.jar
   hadoop-yarn-server-common-2.7.3.jar
   parquet-hadoop-bundle-1.8.1.jar
   
   i don't know why it cannot load the jar?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org