[GitHub] [hive] kgyrtkirk commented on pull request #3279: HIVE-24484: Upgrade Hadoop to 3.3.3

[GitBox <gi...@apache.org>]

kgyrtkirk commented on PR #3279:
URL: https://github.com/apache/hive/pull/3279#issuecomment-1141893046

   I've deployed
   * hadoop-3.3.3
   * tez 0.10.1
   * hive from the PR
   running a simple insert failed with:
   ```
   Caused by: java.lang.NoSuchMethodError: org.eclipse.jetty.server.session.SessionHandler.getSessionManager()Lorg/eclipse/jetty/server/SessionManager;
   	at org.apache.hadoop.http.HttpServer2.initializeWebServer(HttpServer2.java:569)
   	at org.apache.hadoop.http.HttpServer2.<init>(HttpServer2.java:550)
   	at org.apache.hadoop.http.HttpServer2.<init>(HttpServer2.java:117)
   	at org.apache.hadoop.http.HttpServer2$Builder.build(HttpServer2.java:425)
   	at org.apache.hadoop.yarn.webapp.WebApps$Builder.build(WebApps.java:341)
   	at org.apache.hadoop.yarn.webapp.WebApps$Builder.start(WebApps.java:432)
   	at org.apache.hadoop.yarn.webapp.WebApps$Builder.start(WebApps.java:428)
   	at org.apache.tez.dag.app.web.WebUIService.serviceStart(WebUIService.java:94)
   	at org.apache.hadoop.service.AbstractService.start(AbstractService.java:194)
   	at org.apache.tez.dag.app.DAGAppMaster$ServiceWithDependency.start(DAGAppMaster.java:1800)
   	at org.apache.tez.dag.app.DAGAppMaster$ServiceThread.run(DAGAppMaster.java:1821)
   2022-05-31 09:17:19,422 [INFO] [shutdown-hook-0] |app.DAGAppMaster|: DAGAppMasterShutdownHook invoked
   ```
   maybe I've missed something - but it seems like the tez dagappmaster has issues running with the jetty because of hadoop 3.3.3
   
   I've these settings:
   ```
   tez/tez-site/tez.lib.uris ${fs.defaultFS}/apps/tez/tez.tar.gz
   tez/tez-site/tez.use.cluster.hadoop-libs true
   ```
   
   @abstractdog is hadoop-3.3.3 supported with tez-0.10.1?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: gitbox-unsubscribe@hive.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: gitbox-unsubscribe@hive.apache.org
For additional commands, e-mail: gitbox-help@hive.apache.org