You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@carbondata.apache.org by "Babulal (JIRA)" <ji...@apache.org> on 2017/12/29 11:49:00 UTC
[jira] [Created] (CARBONDATA-1953) Pre-aggregate Should inherit
sort column,sort_scope,dictionary encoding from main table
Babulal created CARBONDATA-1953:
-----------------------------------
Summary: Pre-aggregate Should inherit sort column,sort_scope,dictionary encoding from main table
Key: CARBONDATA-1953
URL: https://issues.apache.org/jira/browse/CARBONDATA-1953
Project: CarbonData
Issue Type: Bug
Reporter: Babulal
Pre-aggregate Should inherit sort column,sort_scope,dictionary encoding from main table
spark.sql("drop table if exists y ")
spark.sql("create table y(year int,month int,name string,salary int) stored by 'carbondata' tblproperties('NO_INVERTED_INDEX'='name','sort_scope'='Global_sort','table_blocksize'='23','Dictionary_include'='month','Dictionary_exclude'='year,name','sort_columns'='month,year,name')")
spark.sql("insert into y select 10,11,'babu',12")
spark.sql("create datamap y1_sum1 on table y using 'preaggregate' as select year,month,name,sum(salary) from y group by year,month,name")
spark.sql("desc formatted y").show(100,false)
spark.sql("desc formatted y_y1_sum1").show(100,false)
------
|col_name |data_type |comment |
+------------------------------------+--------------------------------------------------------------------------------+------------------------------------------------------------------------+
|y_year |int |KEY COLUMN,NOINVERTEDINDEX,null |
|y_month |int |DICTIONARY, KEY COLUMN,NOINVERTEDINDEX,null |
|y_name |string |KEY COLUMN,null |
|y_salary_sum |bigint |MEASURE,null |
| | | |
|##Detailed Table Information | | |
|Database Name |default | |
|Table Name |y_y1_sum1 | |
|CARBON Store Path |D:\code\carbondata\myfork\incubator-carbondata/examples/spark2/target/store | |
|Comment | | |
|Table Block Size |1024 MB | |
|Table Data Size |1297 | |
|Table Index Size |1076 | |
|Last Update Time |1514546841061 | |
|SORT_SCOPE |LOCAL_SORT |LOCAL_SORT |
|Streaming |false | |
|SORT_SCOPE |LOCAL_SORT
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)