You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@carbondata.apache.org by "Jacky Li (JIRA)" <ji...@apache.org> on 2018/07/23 14:48:00 UTC
[jira] [Resolved] (CARBONDATA-2530) [MV] Wrong data displayed when
parent table data are loaded
[ https://issues.apache.org/jira/browse/CARBONDATA-2530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jacky Li resolved CARBONDATA-2530.
----------------------------------
Resolution: Fixed
Fix Version/s: 1.4.1
1.5.0
> [MV] Wrong data displayed when parent table data are loaded
> ------------------------------------------------------------
>
> Key: CARBONDATA-2530
> URL: https://issues.apache.org/jira/browse/CARBONDATA-2530
> Project: CarbonData
> Issue Type: Bug
> Reporter: Babulal
> Assignee: xubo245
> Priority: Critical
> Fix For: 1.5.0, 1.4.1
>
> Time Spent: 4h 50m
> Remaining Estimate: 0h
>
> Spark Release:- Spark2.2.1
> Create table and load data to it
> create MV
> rebuild datamap
> run query (used during mv creation) which hits MV and get data
> Now load data to main table
> again run query (used during mv creation) which hits MV and get data
> Result:- data shown is from MV which is wrong if increament load happens then data should get from Main table(parent table)
> Commands
> 0: jdbc:hive2://10.18.222.231:23040> create table tt13 ( name string, age int) stored by 'carbondata';
> 0: jdbc:hive2://10.18.222.231:23040> insert into tt13 select 'babu',12;
> +---------+--+
> | Result |
> +---------+--+
> +---------+–+
> 0: jdbc:hive2://10.18.222.231:23040> create datamap datamap43 using 'mv' as select name from tt13 ;
> +---------+--+
> | Result |
> +---------+--+
> +---------+--+
> No rows selected (0.51 seconds)
> 0: jdbc:hive2://10.18.222.231:23040> rebuild datamap datamap43;
> +---------+--+
> | Result |
> +---------+--+
> +---------+--+
> No rows selected (8.747 seconds)
> 0: jdbc:hive2://10.18.222.231:23040> explain select name from tt13;
> +------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+--+
> | plan |
> +------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+--+
> | == CarbonData Profiler ==
> Table Scan on datamap43_table
> - total blocklets: 1
> - filter: none
> - pruned by Main DataMap
> - skipped blocklets: 0
> |
> | == Physical Plan ==
> *BatchedScan CarbonDatasourceHadoopRelation [ Database name :default, Table name :datamap43_table, Schema :Some(StructType(StructField(tt13_name,StringType,true))) ] default.datamap43_table[tt13_name#1311] |
> +------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+--+
> 2 rows selected (0.525 seconds)
> 0: jdbc:hive2://10.18.222.231:23040> select name from tt13;
> +------------+--+
> | tt13_name |
> +------------+--+
> | babu |
> +------------+--+
> 1 row selected (0.483 seconds)
> 0: jdbc:hive2://10.18.222.231:23040> insert into tt13 select 'lal',13;
> +---------+--+
> | Result |
> +---------+--+
> +---------+--+
> No rows selected (11.819 seconds)
> 0: jdbc:hive2://10.18.222.231:23040> select name from tt13;
> +------------+--+
> | tt13_name |
> +------------+--+
> | babu |
> +------------+--+
> 1 row selected (0.349 seconds)
> 0: jdbc:hive2://10.18.222.231:23040> explain select name from tt13;
> +------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+--+
> | plan |
> +------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+--+
> | == CarbonData Profiler ==
> Table Scan on datamap43_table
> - total blocklets: 1
> - filter: none
> - pruned by Main DataMap
> - skipped blocklets: 0
> |
> | == Physical Plan ==
> *BatchedScan CarbonDatasourceHadoopRelation [ Database name :default, Table name :datamap43_table, Schema :Some(StructType(StructField(tt13_name,StringType,true))) ] default.datamap43_table[tt13_name#1311] |
> +------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+--+
> 2 rows selected (0.391 seconds)
>
>
> Expected
> output should display 2 records . (check insert into command)
>
>
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)