[jira] [Created] (HIVE-14015) SMB MapJoin failed for Hive on Spark when kerberized

["Yongzhi Chen (JIRA)" <ji...@apache.org>]

Yongzhi Chen created HIVE-14015:
-----------------------------------

             Summary: SMB MapJoin failed for Hive on Spark when kerberized
                 Key: HIVE-14015
                 URL: https://issues.apache.org/jira/browse/HIVE-14015
             Project: Hive
          Issue Type: Bug
          Components: Logical Optimizer
    Affects Versions: 2.0.0, 1.1.0
            Reporter: Yongzhi Chen
            Assignee: Yongzhi Chen


java.io.IOException: org.apache.hadoop.ipc.RemoteException(java.io.IOException): Delegation Token can be issued only with kerberos or web authentication

It could be reproduced:
1) prepare sample data:
a=1
while [[ $a -lt 100 ]]; do echo $a ; let a=$a+1; done > data

2) prepare source hive table:
CREATE TABLE `s`(`c` string);
load data local inpath 'data' into table s;

3) prepare the bucketed table:
set hive.enforce.bucketing=true;
set hive.enforce.sorting=true;
CREATE TABLE `t`(`c` string) CLUSTERED BY (c) SORTED BY (c) INTO 5 BUCKETS;
insert into t select * from s;

4) reproduce this issue:
SET hive.execution.engine=spark;
SET hive.auto.convert.sortmerge.join = true;
SET hive.auto.convert.sortmerge.join.bigtable.selection.policy = org.apache.hadoop.hive.ql.optimizer.LeftmostBigTableSelectorForAutoSMJ;
SET hive.auto.convert.sortmerge.join.noconditionaltask = true;
SET hive.optimize.bucketmapjoin = true;
SET hive.optimize.bucketmapjoin.sortedmerge = true;
select * from t join t t1 on t.c=t1.c;



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)