[jira] [Created] (TRAFODION-1466) Bulk load with index on serialized table with syskey causes inconsistency

["Suresh Subbiah (JIRA)" <ji...@apache.org>]

Suresh Subbiah created TRAFODION-1466:
-----------------------------------------

             Summary: Bulk load with index on serialized table with syskey causes inconsistency
                 Key: TRAFODION-1466
                 URL: https://issues.apache.org/jira/browse/TRAFODION-1466
             Project: Apache Trafodion
          Issue Type: Bug
          Components: sql-exe
    Affects Versions: 1.1 (pre-incubation)
            Reporter: Suresh Subbiah
            Assignee: Suresh Subbiah
             Fix For: 2.0-incubating


To see the problem 
cqd hbase_serialization 'on' ;

create table customer_demographics
(
 cd_demo_sk int not null,
 cd_gender char(1),
 cd_marital_status char(1),
 cd_education_status char(20),
 cd_purchase_estimate int,
 cd_credit_rating char(10),
 cd_dep_count int,
 cd_dep_employed_count int,
 cd_dep_college_count int
) store by (cd_demo_sk);


create index cd_dep_count_IDX on customer_demographics(cd_dep_count);

create index cd_dep_college_count_IDX on customer_demographics(cd_dep_college_count);

load into customer_demographics
select * from hive.hive.customer_demographics where cd_demo_sk <= 5000;

-- the hive table is created by install_local_hadoop

The load statement will raise a false duplicate rows error or cause an inconsistency in the index.


The fix is is to deserialize the row that is returned from base table's load_prep tcb. In addition we now return only the columns that are needed by various indexes. Previously all columns were being returned.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)