[jira] [Resolved] (CARBONDATA-4066) data mismatch observed with SI and without SI when SI global sort and SI segment merge is true

["Ajantha Bhat (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/CARBONDATA-4066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ajantha Bhat resolved CARBONDATA-4066.
--------------------------------------
    Fix Version/s: 2.2.0
       Resolution: Fixed

> data mismatch observed with SI and without SI when SI global sort and SI segment merge is true
> ----------------------------------------------------------------------------------------------
>
>                 Key: CARBONDATA-4066
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-4066
>             Project: CarbonData
>          Issue Type: Bug
>            Reporter: Mahesh Raju Somalaraju
>            Priority: Major
>             Fix For: 2.2.0
>
>          Time Spent: 50m
>  Remaining Estimate: 0h
>
> data mismatch observed with SI and without SI when SI global sort and SI segment merge is true
>  
> test case for reproduce the issue:
> CarbonProperties.getInstance()
>  .addProperty(CarbonCommonConstants.CARBON_SI_SEGMENT_MERGE, "true")
> sql("create table complextable2 (id int, name string, country array<string>) stored as " +
>  "carbondata tblproperties('sort_scope'='global_sort','sort_columns'='name')")
> sql(
>  s"load data inpath '$resourcesPath/secindex/array.csv' into table complextable2 options('delimiter'=','," +
>  "'quotechar'='\"','fileheader'='id,name,country','complex_delimiter_level_1'='$'," +
>  "'global_sort_partitions'='10')")
> val result = sql(" select * from complextable2 where array_contains(country,'china')")
> sql("create index index_2 on table complextable2(country) as 'carbondata' properties" +
>  "('sort_scope'='global_sort')")
> checkAnswer(sql("select count(*) from complextable2 where array_contains(country,'china')"),
>  sql("select count(*) from complextable2 where ni(array_contains(country,'china'))"))



--
This message was sent by Atlassian Jira
(v8.3.4#803005)