[jira] [Created] (HIVE-18369) NullPointerException when void convert to varchar using Tez

["ZhongyuWang (JIRA)" <ji...@apache.org>]

ZhongyuWang created HIVE-18369:
----------------------------------

             Summary: NullPointerException when void convert to varchar using Tez
                 Key: HIVE-18369
                 URL: https://issues.apache.org/jira/browse/HIVE-18369
             Project: Hive
          Issue Type: Bug
          Components: Logical Optimizer, Query Planning, Serializers/Deserializers, UDF
    Affects Versions: 1.1.0
         Environment: hadoop-2.6.0-cdh5.5.0
hive-1.1.0-cdh5.5.0
            Reporter: ZhongyuWang
         Attachments: hive.log, testSql.sql

NullPointerException when void convert to varchar using Tez
Just like follow testSQL. we can run it using MR ，but we get a NullPointerException when using Tez. we found it failed in SQL compiling when doing constant propagation optimizer.

testSQL：
create table testTezVarchar(a varchar(10),b varchar(10));
create table testTezVoid as select null as a1,null as b1 from events5;
set hive.execution.engine=mr;
insert into testTezVarchar select a1 as a,b1 as b from testTezVoid;
set hive.execution.engine=tez;
insert into testTezVarchar select a1 as a,b1 as b from testTezVoid;

Exception:
Caused by: java.lang.NullPointerException
	at org.apache.hadoop.hive.common.type.HiveBaseChar.enforceMaxLength(HiveBaseChar.java:44)
	at org.apache.hadoop.hive.serde2.io.HiveVarcharWritable.set(HiveVarcharWritable.java:65)
	at org.apache.hadoop.hive.serde2.io.HiveVarcharWritable.set(HiveVarcharWritable.java:61)
	at org.apache.hadoop.hive.serde2.objectinspector.primitive.WritableHiveVarcharObjectInspector.set(WritableHiveVarcharObjectInspector.java:130)
	at org.apache.hadoop.hive.serde2.objectinspector.primitive.PrimitiveObjectInspectorConverter$HiveVarcharConverter.convert(PrimitiveObjectInspectorConverter.java:490)
	at org.apache.hadoop.hive.ql.udf.generic.GenericUDFToVarchar.evaluate(GenericUDFToVarchar.java:84)
	at org.apache.hadoop.hive.ql.optimizer.ConstantPropagateProcFactory.evaluateFunction(ConstantPropagateProcFactory.java:516)
	at org.apache.hadoop.hive.ql.optimizer.ConstantPropagateProcFactory.foldExpr(ConstantPropagateProcFactory.java:228)
	at org.apache.hadoop.hive.ql.optimizer.ConstantPropagateProcFactory.access$000(ConstantPropagateProcFactory.java:91)
	at org.apache.hadoop.hive.ql.optimizer.ConstantPropagateProcFactory$ConstantPropagateSelectProc.process(ConstantPropagateProcFactory.java:718)
	at org.apache.hadoop.hive.ql.lib.DefaultRuleDispatcher.dispatch(DefaultRuleDispatcher.java:90)
	at org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.dispatchAndReturn(DefaultGraphWalker.java:94)
	at org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.dispatch(DefaultGraphWalker.java:78)
	at org.apache.hadoop.hive.ql.optimizer.ConstantPropagate$ConstantPropagateWalker.walk(ConstantPropagate.java:142)
	at org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.startWalking(DefaultGraphWalker.java:109)
	at org.apache.hadoop.hive.ql.optimizer.ConstantPropagate.transform(ConstantPropagate.java:112)
	at org.apache.hadoop.hive.ql.parse.TezCompiler.runDynamicPartitionPruning(TezCompiler.java:311)
	at org.apache.hadoop.hive.ql.parse.TezCompiler.optimizeOperatorPlan(TezCompiler.java:117)
	at org.apache.hadoop.hive.ql.parse.TaskCompiler.compile(TaskCompiler.java:101)




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)