Hive 3 Thrift server expects Tez to be there and throws error and waits before bouncing back

[Mich Talebzadeh <mi...@gmail.com>]

The problem is by default Hive is on mr although you get a warning that is
best to use spark or tez.

That is fair enough but Hive 3 expects Tez to be there. Otherwise the
start-up script throws an error and waits a minute to retry the connection
to the metastore!

2018-06-14 14:48:16,989 INFO  [main] http.HttpServer: Started
HttpServer[hiveserver2] on port 10002
2018-06-14 14:48:16,989 INFO  [main] server.HiveServer2: Web UI has started
on port 10002
2018-06-14 14:48:16,989 INFO  [main] server.HiveServer2: HS2 interactive HA
not enabled. Starting tez sessions..
2018-06-14 14:48:16,989 INFO  [main] server.HiveServer2:
Starting/Reconnecting tez sessions..
2018-06-14 14:48:16,989 INFO  [main] server.HiveServer2: Initializing tez
session pool manager
2018-06-14 14:48:16,993 INFO  [main] server.HiveServer2: Shutting down
HiveServer2
2018-06-14 14:48:16,993 INFO  [main] thrift.ThriftCLIService: Thrift server
has stopped
2018-06-14 14:48:16,993 INFO  [main] service.AbstractService:
Service:ThriftBinaryCLIService is stopped.
2018-06-14 14:48:16,993 INFO  [main] service.AbstractService:
Service:OperationManager is stopped.
2018-06-14 14:48:16,993 INFO  [main] service.AbstractService:
Service:SessionManager is stopped.
2018-06-14 14:48:16,993 INFO  [main] service.AbstractService:
Service:CLIService is stopped.
2018-06-14 14:48:16,993 INFO  [main] metastore.HiveMetaStoreClient: Closed
a connection to metastore, current connections: 0
2018-06-14 14:48:16,993 INFO  [main] service.AbstractService:
Service:HiveServer2 is stopped.
2018-06-14 14:48:16,996 INFO  [main] server.ServerConnector: Stopped
ServerConnector@7b477141{HTTP/1.1,[http/1.1]}{0.0.0.0:10002}
2018-06-14 14:48:16,996 INFO  [main] handler.ContextHandler: Stopped
o.e.j.s.ServletContextHandler@7c0777b5
{/static,jar:file:/data6/hduser/hive-3.0.0/lib/hive-service-3.0.0.jar!/hive-webapps/static,UNAVAILABLE}
2018-06-14 14:48:16,999 INFO  [main] handler.ContextHandler: Stopped
o.e.j.w.WebAppContext@41b13f3d
{/,null,UNAVAILABLE}{jar:file:/data6/hduser/hive-3.0.0/lib/hive-service-3.0.0.jar!/hive-webapps/hiveserver2}
2018-06-14 14:48:17,000 INFO  [main] server.HiveServer2: Web UI has stopped
2018-06-14 14:48:17,000 INFO  [main] server.HiveServer2:
Stopping/Disconnecting tez sessions.
2018-06-14 14:48:17,000 INFO  [main] server.HiveServer2: Stopped tez
session pool manager.
2018-06-14 14:48:17,000 WARN  [main] server.HiveServer2: Error starting
HiveServer2 on attempt 1, will retry in 60000ms
java.lang.NoClassDefFoundError: org/apache/tez/dag/api/TezConfiguration
        at
org.apache.hadoop.hive.ql.exec.tez.TezSessionPoolSession$AbstractTriggerValidator.startTriggerValidator(TezSessionPoolSession.java:74)
        at
org.apache.hadoop.hive.ql.exec.tez.TezSessionPoolManager.initTriggers(TezSessionPoolManager.java:207)
        at
org.apache.hadoop.hive.ql.exec.tez.TezSessionPoolManager.startPool(TezSessionPoolManager.java:114)
        at
org.apache.hive.service.server.HiveServer2.initAndStartTezSessionPoolManager(HiveServer2.java:831)
        at
org.apache.hive.service.server.HiveServer2.startOrReconnectTezSessions(HiveServer2.java:815)
        at
org.apache.hive.service.server.HiveServer2.start(HiveServer2.java:739)
        at
org.apache.hive.service.server.HiveServer2.startHiveServer2(HiveServer2.java:1014)
        at
org.apache.hive.service.server.HiveServer2.access$1800(HiveServer2.java:134)
        at
org.apache.hive.service.server.HiveServer2$StartOptionExecutor.execute(HiveServer2.java:1282)
        at
org.apache.hive.service.server.HiveServer2.main(HiveServer2.java:1126)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
        at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
Caused by: java.lang.ClassNotFoundException:
org.apache.tez.dag.api.TezConfiguration

I gather this is a bug as Hive install has to have both spark or tez as
plugins.

Thanks

Dr Mich Talebzadeh



LinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
<https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>*



http://talebzadehmich.wordpress.com


*Disclaimer:* Use it at your own risk. Any and all responsibility for any
loss, damage or destruction of data or any other property which may arise
from relying on this email's technical content is explicitly disclaimed.
The author will in no case be liable for any monetary damages arising from
such loss, damage or destruction.