You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@dolphinscheduler.apache.org by "SbloodyS (via GitHub)" <gi...@apache.org> on 2025/09/10 06:32:43 UTC

[PR] [Fix-17370] Fix worker server start failed when using hdfs storage type [dolphinscheduler]

SbloodyS opened a new pull request, #17496:
URL: https://github.com/apache/dolphinscheduler/pull/17496

   <!--Thanks very much for contributing to Apache DolphinScheduler, we are happy that you want to help us improve DolphinScheduler! -->
   
   ## Purpose of the pull request
   
   close #17370
   close #17488
   
   ## Brief change log
   
   <!--*(for example:)*
   - *Add maven-checkstyle-plugin to root pom.xml*
   -->
   
   ## Verify this pull request
   
   <!--*(Please pick either of the following options)*-->
   
   This pull request is code cleanup without any test coverage.
   
   *(or)*
   
   This pull request is already covered by existing tests, such as *(please describe tests)*.
   
   (or)
   
   This change added tests and can be verified as follows:
   
   <!--*(example:)*
   - *Added dolphinscheduler-dao tests for end-to-end.*
   - *Added CronUtilsTest to verify the change.*
   - *Manually verified the change by testing locally.* -->
   
   (or)
   
   ## Pull Request Notice
   [Pull Request Notice](https://github.com/apache/dolphinscheduler/blob/dev/docs/docs/en/contribute/join/pull-request.md)
   
   If your pull request contains incompatible change, you should also add it to `docs/docs/en/guide/upgrade/incompatible.md`
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [PR] [Fix-17370] Fix worker server start failed when using hdfs storage type [dolphinscheduler]

Posted by "sonarqubecloud[bot] (via GitHub)" <gi...@apache.org>.
sonarqubecloud[bot] commented on PR #17496:
URL: https://github.com/apache/dolphinscheduler/pull/17496#issuecomment-3273740928

   ## [![Quality Gate Passed](https://sonarsource.github.io/sonarcloud-github-static-resources/v2/checks/QualityGateBadge/qg-passed-20px.png 'Quality Gate Passed')](https://sonarcloud.io/dashboard?id=apache-dolphinscheduler&pullRequest=17496) **Quality Gate passed**  
   Issues  
   ![](https://sonarsource.github.io/sonarcloud-github-static-resources/v2/common/passed-16px.png '') [0 New issues](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler&pullRequest=17496&issueStatuses=OPEN,CONFIRMED&sinceLeakPeriod=true)  
   ![](https://sonarsource.github.io/sonarcloud-github-static-resources/v2/common/accepted-16px.png '') [0 Accepted issues](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler&pullRequest=17496&issueStatuses=ACCEPTED)
   
   Measures  
   ![](https://sonarsource.github.io/sonarcloud-github-static-resources/v2/common/passed-16px.png '') [0 Security Hotspots](https://sonarcloud.io/project/security_hotspots?id=apache-dolphinscheduler&pullRequest=17496&issueStatuses=OPEN,CONFIRMED&sinceLeakPeriod=true)  
   ![](https://sonarsource.github.io/sonarcloud-github-static-resources/v2/common/passed-16px.png '') [0.0% Coverage on New Code](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler&pullRequest=17496&metric=new_coverage&view=list)  
   ![](https://sonarsource.github.io/sonarcloud-github-static-resources/v2/common/passed-16px.png '') [0.0% Duplication on New Code](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler&pullRequest=17496&metric=new_duplicated_lines_density&view=list)  
     
   [See analysis details on SonarQube Cloud](https://sonarcloud.io/dashboard?id=apache-dolphinscheduler&pullRequest=17496)
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [PR] [Fix-17370] Fix worker server start failed when using hdfs storage type [dolphinscheduler]

Posted by "Gallardot (via GitHub)" <gi...@apache.org>.
Gallardot merged PR #17496:
URL: https://github.com/apache/dolphinscheduler/pull/17496


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [PR] [Fix-17370] Fix worker server start failed when using hdfs storage type [dolphinscheduler]

Posted by "ruanwenjun (via GitHub)" <gi...@apache.org>.
ruanwenjun commented on PR #17496:
URL: https://github.com/apache/dolphinscheduler/pull/17496#issuecomment-3311762546

   @Kinsonx Is your plugin dir exit `dolphinscheduler-datasource-hive-3.3.1-shade.jar`? `hbase-noop-htrace` should be shaded in this jar


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [PR] [Fix-17370] Fix worker server start failed when using hdfs storage type [dolphinscheduler]

Posted by "Kinsonx (via GitHub)" <gi...@apache.org>.
Kinsonx commented on PR #17496:
URL: https://github.com/apache/dolphinscheduler/pull/17496#issuecomment-3314362618

   > @Kinsonx Is your plugin dir exit `dolphinscheduler-datasource-hive-3.3.1-shade.jar`? `hbase-noop-htrace` should be shaded in this jar
   
   No datasource-plugins, only storage-plugins which contains 'storage-hdfs' 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [PR] [Fix-17370] Fix worker server start failed when using hdfs storage type [dolphinscheduler]

Posted by "Kinsonx (via GitHub)" <gi...@apache.org>.
Kinsonx commented on PR #17496:
URL: https://github.com/apache/dolphinscheduler/pull/17496#issuecomment-3311604937

   After adding '-Dclassifier=shade' based on 3.3.1-release version, still got the 'java.lang.ClassNotFoundException: org.apache.htrace.core.Tracer$Builder' when start worker-server.   It seems that jar file 'dolphinscheduler-storage-hdfs-3.3.1-shade.jar' dose not hive classes related to htrace. Did I miss any configurations ?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [PR] [Fix-17370] Fix worker server start failed when using hdfs storage type [dolphinscheduler]

Posted by "Mrhs121 (via GitHub)" <gi...@apache.org>.
Mrhs121 commented on PR #17496:
URL: https://github.com/apache/dolphinscheduler/pull/17496#issuecomment-3311736349

   > After adding '-Dclassifier=shade' based on 3.3.1-release version, still got the 'java.lang.ClassNotFoundException: org.apache.htrace.core.Tracer$Builder' when start worker-server. It seems that jar file 'dolphinscheduler-storage-hdfs-3.3.1-shade.jar' dose not hive classes related to htrace. Did I miss any configurations ?
   
   You haven't missed any configuration. The current workaround solution is to copy hbase-noop-htrace-4.1.1.jar to worker-server/libs.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [PR] [Fix-17370] Fix worker server start failed when using hdfs storage type [dolphinscheduler]

Posted by "sonarqubecloud[bot] (via GitHub)" <gi...@apache.org>.
sonarqubecloud[bot] commented on PR #17496:
URL: https://github.com/apache/dolphinscheduler/pull/17496#issuecomment-3273738310

   ## [![Quality Gate Passed](https://sonarsource.github.io/sonarcloud-github-static-resources/v2/checks/QualityGateBadge/qg-passed-20px.png 'Quality Gate Passed')](https://sonarcloud.io/dashboard?id=apache-dolphinscheduler&pullRequest=17496) **Quality Gate passed**  
   Issues  
   ![](https://sonarsource.github.io/sonarcloud-github-static-resources/v2/common/passed-16px.png '') [0 New issues](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler&pullRequest=17496&issueStatuses=OPEN,CONFIRMED&sinceLeakPeriod=true)  
   ![](https://sonarsource.github.io/sonarcloud-github-static-resources/v2/common/accepted-16px.png '') [0 Accepted issues](https://sonarcloud.io/project/issues?id=apache-dolphinscheduler&pullRequest=17496&issueStatuses=ACCEPTED)
   
   Measures  
   ![](https://sonarsource.github.io/sonarcloud-github-static-resources/v2/common/passed-16px.png '') [0 Security Hotspots](https://sonarcloud.io/project/security_hotspots?id=apache-dolphinscheduler&pullRequest=17496&issueStatuses=OPEN,CONFIRMED&sinceLeakPeriod=true)  
   ![](https://sonarsource.github.io/sonarcloud-github-static-resources/v2/common/passed-16px.png '') [0.0% Coverage on New Code](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler&pullRequest=17496&metric=new_coverage&view=list)  
   ![](https://sonarsource.github.io/sonarcloud-github-static-resources/v2/common/passed-16px.png '') [0.0% Duplication on New Code](https://sonarcloud.io/component_measures?id=apache-dolphinscheduler&pullRequest=17496&metric=new_duplicated_lines_density&view=list)  
     
   [See analysis details on SonarQube Cloud](https://sonarcloud.io/dashboard?id=apache-dolphinscheduler&pullRequest=17496)
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [PR] [Fix-17370] Fix worker server start failed when using hdfs storage type [dolphinscheduler]

Posted by "Mrhs121 (via GitHub)" <gi...@apache.org>.
Mrhs121 commented on PR #17496:
URL: https://github.com/apache/dolphinscheduler/pull/17496#issuecomment-3311860329

   > @Kinsonx Is your plugin dir exit `dolphinscheduler-datasource-hive-3.3.1-shade.jar`? `hbase-noop-htrace` should be shaded in this jar
   
   I've created FOLLOWUP PR https://github.com/apache/dolphinscheduler/pull/17524 to fix it.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [PR] [Fix-17370] Fix worker server start failed when using hdfs storage type [dolphinscheduler]

Posted by "Kinsonx (via GitHub)" <gi...@apache.org>.
Kinsonx commented on PR #17496:
URL: https://github.com/apache/dolphinscheduler/pull/17496#issuecomment-3314367562

   > > After adding '-Dclassifier=shade' based on 3.3.1-release version, still got the 'java.lang.ClassNotFoundException: org.apache.htrace.core.Tracer$Builder' when start worker-server. It seems that jar file 'dolphinscheduler-storage-hdfs-3.3.1-shade.jar' dose not hive classes related to htrace. Did I miss any configurations ?
   > 
   > You haven't missed any configuration. The current workaround solution is to copy hbase-noop-htrace-4.1.1.jar to worker-server/libs.
   
   Before I saw this PR, I made a soft link (cd worker-server/libs; ln -s ../../libs/hbase-noop-htrace-4.1.1.jar hbase-noop-htrace-4.1.1.jar), it did work.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org