You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Daisy.Yuan (JIRA)" <ji...@apache.org> on 2013/03/21 11:57:15 UTC

[jira] [Created] (HIVE-4211) Common column and partition column are defined the same type and union them, it will hints Schema of both sides of union should match.

Daisy.Yuan created HIVE-4211:
--------------------------------

             Summary: Common column and partition column are defined the same type and union them, it will hints Schema of both sides of union should match. 
                 Key: HIVE-4211
                 URL: https://issues.apache.org/jira/browse/HIVE-4211
             Project: Hive
          Issue Type: Bug
          Components: SQL
    Affects Versions: 0.9.0, 0.11.0
            Reporter: Daisy.Yuan


create table UnionBoolA (id boolean, no boolean) row format delimited fields terminated by ' ';
load data local inpath '/opt/files/unionboola.txt' into table UnionBoolA;
create table UnionPartionBool (id int) partitioned by (no boolean) row format delimited fields terminated by ' ';
load data local inpath '/opt/files/unionpartint.txt' into table UnionPartionBool partition(no=true);

unionboola.txt:
true true
false true
true true
false true

unionpartint.txt:
111
444
1122
44

when I execute
"select * from( select no from UnionBoolA union all select no from UnionPartionBool) unionResult", it is failed. The exception info is as follows:
FAILED: Error in semantic analysis: 1:66 Schema of both sides of union should match: Column no is of type boolean on first table and type string on second table. Error encountered near token 'UnionPartionBool'
org.apache.hadoop.hive.ql.parse.SemanticException: 1:66 Schema of both sides of union should match: Column no is of type boolean on first table and type string on second table. Error encountered near token 'UnionPartionBool'
        at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genUnionPlan(SemanticAnalyzer.java:6295)
        at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genPlan(SemanticAnalyzer.java:6733)
        at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genPlan(SemanticAnalyzer.java:6748)
        at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.analyzeInternal(SemanticAnalyzer.java:7556)
        at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:244)
        at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:621)
        at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:525)
        at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1153)
        at org.apache.hadoop.hive.service.HiveServer$HiveServerHandler.execute(HiveServer.java:226)
        at org.apache.hadoop.hive.service.ThriftHive$Processor$execute.getResult(ThriftHive.java:630)
        at org.apache.hadoop.hive.service.ThriftHive$Processor$execute.getResult(ThriftHive.java:618)
        at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:32)
        at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:34)
        at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge20S$Server$TUGIAssumingProcessor$1.run(HadoopThriftAuthBridge20S.java:535)
        at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge20S$Server$TUGIAssumingProcessor$1.run(HadoopThriftAuthBridge20S.java:532)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:396)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1232)
        at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge20S$Server$TUGIAssumingProcessor.process(HadoopThriftAuthBridge20S.java:532)
        at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:176)
        at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
        at java.lang.Thread.run(Thread.java:662)


So I execute "explain select no from  UnionPartionBool" to see the partition column, and find the partition column type is string.
And all the partition column type is changed to be TypeInfoFactory.stringTypeInfo. It is in org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genTablePlan(). And it is todo task. Now I modify it to be TypeInfoFactory.getPrimitiveTypeInfo(part_col.getType()).It can fix this bug. 
And you can see what I modified in the patch.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira