You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@tez.apache.org by "Ashish Kumar (JIRA)" <ji...@apache.org> on 2016/08/11 09:02:20 UTC
[jira] [Updated] (TEZ-3407) Tenz with Alluxio not working
[ https://issues.apache.org/jira/browse/TEZ-3407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ashish Kumar updated TEZ-3407:
------------------------------
Summary: Tenz with Alluxio not working (was: Ten with Alluxio error)
> Tenz with Alluxio not working
> -----------------------------
>
> Key: TEZ-3407
> URL: https://issues.apache.org/jira/browse/TEZ-3407
> Project: Apache Tez
> Issue Type: Bug
> Reporter: Ashish Kumar
>
> I started using Hive with Alluxio. And after few initial hurdles I'm able to make it work. Now, Hive with MR is working fine but the same query failing with Hive on TEZ engine.
> Hive Version 1.2
> Alluxio Version 1.0.1
> TEZ version 0.7
> Below is the error log:
> Error:
> org.apache.tez.dag.api.TezUncheckedException: Unable to instantiate class with 1 arguments: org.apache.hadoop.hive.ql.exec.tez.HiveSplitGenerator
> at org.apache.tez.common.ReflectionUtils.getNewInstance(ReflectionUtils.java:80)
> at org.apache.tez.common.ReflectionUtils.createClazzInstance(ReflectionUtils.java:98)
> at org.apache.tez.dag.app.dag.RootInputInitializerManager.createInitializer(RootInputInitializerManager.java:137)
> at org.apache.tez.dag.app.dag.RootInputInitializerManager.runInputInitializers(RootInputInitializerManager.java:114)
> at org.apache.tez.dag.app.dag.impl.VertexImpl.setupInputInitializerManager(VertexImpl.java:4392)
> at org.apache.tez.dag.app.dag.impl.VertexImpl.access$4300(VertexImpl.java:199)
> at org.apache.tez.dag.app.dag.impl.VertexImpl$InitTransition.handleInitEvent(VertexImpl.java:3233)
> at org.apache.tez.dag.app.dag.impl.VertexImpl$InitTransition.transition(VertexImpl.java:3183)
> at org.apache.tez.dag.app.dag.impl.VertexImpl$InitTransition.transition(VertexImpl.java:3164)
> at org.apache.hadoop.yarn.state.StateMachineFactory$MultipleInternalArc.doTransition(StateMachineFactory.java:385)
> at org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:302)
> at org.apache.hadoop.yarn.state.StateMachineFactory.access$300(StateMachineFactory.java:46)
> at org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:448)
> at org.apache.tez.state.StateMachineTez.doTransition(StateMachineTez.java:57)
> at org.apache.tez.dag.app.dag.impl.VertexImpl.handle(VertexImpl.java:1812)
> at org.apache.tez.dag.app.dag.impl.VertexImpl.handle(VertexImpl.java:198)
> at org.apache.tez.dag.app.DAGAppMaster$VertexEventDispatcher.handle(DAGAppMaster.java:1943)
> at org.apache.tez.dag.app.DAGAppMaster$VertexEventDispatcher.handle(DAGAppMaster.java:1929)
> at org.apache.tez.common.AsyncDispatcher.dispatch(AsyncDispatcher.java:183)
> at org.apache.tez.common.AsyncDispatcher$1.run(AsyncDispatcher.java:114)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
> at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:408)
> at org.apache.tez.common.ReflectionUtils.getNewInstance(ReflectionUtils.java:69)
> ... 20 more
> Caused by: java.lang.NoSuchMethodError: org.apache.commons.codec.binary.Base64.decodeBase64(Ljava/lang/String;)[B
> at org.apache.hadoop.hive.ql.exec.Utilities.getBaseWork(Utilities.java:419)
> at org.apache.hadoop.hive.ql.exec.Utilities.getMapWork(Utilities.java:308)
> at org.apache.hadoop.hive.ql.exec.tez.HiveSplitGenerator.<init>(HiveSplitGenerator.java:92)
> ... 25 more
> 2016-08-11 08:37:57,399 ERROR [Dispatcher thread: Central] impl.VertexImpl: Can't handle Invalid event V_START on vertex Map 1 with vertexId vertex_1470806535809_0006_1_00 at current state NEW
> org.apache.hadoop.yarn.state.InvalidStateTransitonException: Invalid event: V_START at NEW
> at org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:305)
> at org.apache.hadoop.yarn.state.StateMachineFactory.access$300(StateMachineFactory.java:46)
> at org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:448)
> at org.apache.tez.state.StateMachineTez.doTransition(StateMachineTez.java:57)
> at org.apache.tez.dag.app.dag.impl.VertexImpl.handle(VertexImpl.java:1812)
> at org.apache.tez.dag.app.dag.impl.VertexImpl.handle(VertexImpl.java:198)
> at org.apache.tez.dag.app.DAGAppMaster$VertexEventDispatcher.handle(DAGAppMaster.java:1943)
> at org.apache.tez.dag.app.DAGAppMaster$VertexEventDispatcher.handle(DAGAppMaster.java:1929)
> at org.apache.tez.common.AsyncDispatcher.dispatch(AsyncDispatcher.java:183)
> at org.apache.tez.common.AsyncDispatcher$1.run(AsyncDispatcher.java:114)
> at java.lang.Thread.run(Thread.java:745)
> Anybody have any idea?
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)