You are viewing a plain text version of this content. The canonical link for it is here.
Posted to gitbox@hive.apache.org by "Abyss-lord (via GitHub)" <gi...@apache.org> on 2025/07/13 05:58:56 UTC

[PR] HIVE-29086: Fix ClassNotFoundException: org.apache.tez.dag.DAG when engine is mr [hive]

Abyss-lord opened a new pull request, #5968:
URL: https://github.com/apache/hive/pull/5968

   ### What changes were proposed in this pull request?
   
   Fix ClassNotFoundException: org.apache.tez.dag.DAG when engine is mr
   
   ### Why are the changes needed?
   
   fix: https://issues.apache.org/jira/projects/HIVE/issues/HIVE-29086?filter=allissues
   
   ### Does this PR introduce _any_ user-facing change?
   
   no 
   
   ### How was this patch tested?
   
   local test.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: gitbox-unsubscribe@hive.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: gitbox-unsubscribe@hive.apache.org
For additional commands, e-mail: gitbox-help@hive.apache.org

Re: [PR] HIVE-29086: Fix ClassNotFoundException: org.apache.tez.dag.DAG when engine is mr [hive]

Posted by "Abyss-lord (via GitHub)" <gi...@apache.org>.
Abyss-lord commented on PR #5968:
URL: https://github.com/apache/hive/pull/5968#issuecomment-3066636371

   > Can you put the trace in the ticket & a sample query to reproduce this
   
   I currently don’t have access to the trace — it’s on my work laptop. I’ll retrieve it first thing Monday and share both the trace and a sample query to help reproduce the issue.
   
   Thanks for your patience!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: gitbox-unsubscribe@hive.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: gitbox-unsubscribe@hive.apache.org
For additional commands, e-mail: gitbox-help@hive.apache.org

Re: [PR] HIVE-29086: Fix ClassNotFoundException: org.apache.tez.dag.DAG when engine is mr [hive]

Posted by "zhangbutao (via GitHub)" <gi...@apache.org>.
zhangbutao commented on PR #5968:
URL: https://github.com/apache/hive/pull/5968#issuecomment-3257275468

   I think if the Hadoop cluster's classpath does not include the Tez packages and in case of MR engine, this exception will occur.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: gitbox-unsubscribe@hive.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: gitbox-unsubscribe@hive.apache.org
For additional commands, e-mail: gitbox-help@hive.apache.org

Re: [PR] HIVE-29086: Fix ClassNotFoundException: org.apache.tez.dag.DAG when engine is mr [hive]

Posted by "zhangbutao (via GitHub)" <gi...@apache.org>.
zhangbutao merged PR #5968:
URL: https://github.com/apache/hive/pull/5968


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: gitbox-unsubscribe@hive.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: gitbox-unsubscribe@hive.apache.org
For additional commands, e-mail: gitbox-help@hive.apache.org

Re: [PR] HIVE-29086: Fix ClassNotFoundException: org.apache.tez.dag.DAG when engine is mr [hive]

Posted by "deniskuzZ (via GitHub)" <gi...@apache.org>.
deniskuzZ commented on code in PR #5968:
URL: https://github.com/apache/hive/pull/5968#discussion_r2230744137


##########
cli/src/java/org/apache/hadoop/hive/cli/CliDriver.java:
##########
@@ -396,7 +396,10 @@ public void handle(Signal signal) {
 
           // First, kill any running MR jobs
           HadoopJobExecHelper.killRunningJobs();
-          TezJobExecHelper.killRunningJobs();
+          if ("tez".equalsIgnoreCase(HiveConf.getVar(conf,

Review Comment:
   please avoid hardcoded literals



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: gitbox-unsubscribe@hive.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: gitbox-unsubscribe@hive.apache.org
For additional commands, e-mail: gitbox-help@hive.apache.org

Re: [PR] HIVE-29086: Fix ClassNotFoundException: org.apache.tez.dag.DAG when engine is mr [hive]

Posted by "Abyss-lord (via GitHub)" <gi...@apache.org>.
Abyss-lord commented on code in PR #5968:
URL: https://github.com/apache/hive/pull/5968#discussion_r2203172342


##########
cli/src/java/org/apache/hadoop/hive/cli/CliDriver.java:
##########
@@ -396,7 +396,10 @@ public void handle(Signal signal) {
 
           // First, kill any running MR jobs
           HadoopJobExecHelper.killRunningJobs();
-          TezJobExecHelper.killRunningJobs();
+          //when engine is not tez,it will throw ClassNotFoundException: org.apache.tez.dag.DAG
+          if ("tez".equalsIgnoreCase(conf.get("hive.execution.engine"))) {

Review Comment:
   Fix



##########
cli/src/java/org/apache/hadoop/hive/cli/CliDriver.java:
##########
@@ -396,7 +396,10 @@ public void handle(Signal signal) {
 
           // First, kill any running MR jobs
           HadoopJobExecHelper.killRunningJobs();
-          TezJobExecHelper.killRunningJobs();
+          //when engine is not tez,it will throw ClassNotFoundException: org.apache.tez.dag.DAG

Review Comment:
   Fix



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: gitbox-unsubscribe@hive.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: gitbox-unsubscribe@hive.apache.org
For additional commands, e-mail: gitbox-help@hive.apache.org

Re: [PR] HIVE-29086: Fix ClassNotFoundException: org.apache.tez.dag.DAG when engine is mr [hive]

Posted by "ayushtkn (via GitHub)" <gi...@apache.org>.
ayushtkn commented on code in PR #5968:
URL: https://github.com/apache/hive/pull/5968#discussion_r2203171230


##########
cli/src/java/org/apache/hadoop/hive/cli/CliDriver.java:
##########
@@ -396,7 +396,10 @@ public void handle(Signal signal) {
 
           // First, kill any running MR jobs
           HadoopJobExecHelper.killRunningJobs();
-          TezJobExecHelper.killRunningJobs();
+          //when engine is not tez,it will throw ClassNotFoundException: org.apache.tez.dag.DAG

Review Comment:
   this comment isn't required



##########
cli/src/java/org/apache/hadoop/hive/cli/CliDriver.java:
##########
@@ -396,7 +396,10 @@ public void handle(Signal signal) {
 
           // First, kill any running MR jobs
           HadoopJobExecHelper.killRunningJobs();
-          TezJobExecHelper.killRunningJobs();
+          //when engine is not tez,it will throw ClassNotFoundException: org.apache.tez.dag.DAG
+          if ("tez".equalsIgnoreCase(conf.get("hive.execution.engine"))) {

Review Comment:
   Change it to
   ```
   "tez".equalsIgnoreCase(HiveConf.getVar(conf, HiveConf.ConfVars.HIVE_EXECUTION_ENGINE))
   ```



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: gitbox-unsubscribe@hive.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: gitbox-unsubscribe@hive.apache.org
For additional commands, e-mail: gitbox-help@hive.apache.org

Re: [PR] HIVE-29086: Fix ClassNotFoundException: org.apache.tez.dag.DAG when engine is mr [hive]

Posted by "sonarqubecloud[bot] (via GitHub)" <gi...@apache.org>.
sonarqubecloud[bot] commented on PR #5968:
URL: https://github.com/apache/hive/pull/5968#issuecomment-3067027905

   ## [![Quality Gate Passed](https://sonarsource.github.io/sonarcloud-github-static-resources/v2/checks/QualityGateBadge/qg-passed-20px.png 'Quality Gate Passed')](https://sonarcloud.io/dashboard?id=apache_hive&pullRequest=5968) **Quality Gate passed**  
   Issues  
   ![](https://sonarsource.github.io/sonarcloud-github-static-resources/v2/common/passed-16px.png '') [2 New issues](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=5968&issueStatuses=OPEN,CONFIRMED&sinceLeakPeriod=true)  
   ![](https://sonarsource.github.io/sonarcloud-github-static-resources/v2/common/accepted-16px.png '') [0 Accepted issues](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=5968&issueStatuses=ACCEPTED)
   
   Measures  
   ![](https://sonarsource.github.io/sonarcloud-github-static-resources/v2/common/passed-16px.png '') [0 Security Hotspots](https://sonarcloud.io/project/security_hotspots?id=apache_hive&pullRequest=5968&issueStatuses=OPEN,CONFIRMED&sinceLeakPeriod=true)  
   ![](https://sonarsource.github.io/sonarcloud-github-static-resources/v2/common/passed-16px.png '') [0.0% Coverage on New Code](https://sonarcloud.io/component_measures?id=apache_hive&pullRequest=5968&metric=new_coverage&view=list)  
   ![](https://sonarsource.github.io/sonarcloud-github-static-resources/v2/common/passed-16px.png '') [0.0% Duplication on New Code](https://sonarcloud.io/component_measures?id=apache_hive&pullRequest=5968&metric=new_duplicated_lines_density&view=list)  
     
   [See analysis details on SonarQube Cloud](https://sonarcloud.io/dashboard?id=apache_hive&pullRequest=5968)
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: gitbox-unsubscribe@hive.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: gitbox-unsubscribe@hive.apache.org
For additional commands, e-mail: gitbox-help@hive.apache.org

Re: [PR] HIVE-29086: Fix ClassNotFoundException: org.apache.tez.dag.DAG when engine is mr [hive]

Posted by "zhangbutao (via GitHub)" <gi...@apache.org>.
zhangbutao commented on code in PR #5968:
URL: https://github.com/apache/hive/pull/5968#discussion_r2324266822


##########
cli/src/java/org/apache/hadoop/hive/cli/CliDriver.java:
##########
@@ -396,7 +396,10 @@ public void handle(Signal signal) {
 
           // First, kill any running MR jobs
           HadoopJobExecHelper.killRunningJobs();
-          TezJobExecHelper.killRunningJobs();
+          if ("tez".equalsIgnoreCase(HiveConf.getVar(conf,

Review Comment:
   It seems that many places in the Hive code use hardcoded `mr `or `tez `constants. Perhaps we can create a separate PR to fix the all the `mr `& `tez `hardcoding issue. :)



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: gitbox-unsubscribe@hive.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: gitbox-unsubscribe@hive.apache.org
For additional commands, e-mail: gitbox-help@hive.apache.org