You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@carbondata.apache.org by "kumar vishal (JIRA)" <ji...@apache.org> on 2018/01/03 10:17:01 UTC

[jira] [Resolved] (CARBONDATA-1953) Pre-aggregate Should inherit sort column,sort_scope,dictionary encoding from main table

     [ https://issues.apache.org/jira/browse/CARBONDATA-1953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

kumar vishal resolved CARBONDATA-1953.
--------------------------------------
       Resolution: Fixed
    Fix Version/s: 1.3.0

> Pre-aggregate Should inherit sort column,sort_scope,dictionary encoding from main table
> ---------------------------------------------------------------------------------------
>
>                 Key: CARBONDATA-1953
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-1953
>             Project: CarbonData
>          Issue Type: Bug
>            Reporter: Babulal
>            Assignee: Babulal
>             Fix For: 1.3.0
>
>          Time Spent: 2h 20m
>  Remaining Estimate: 0h
>
> Pre-aggregate Should inherit sort column,sort_scope,dictionary encoding from main table
>  spark.sql("drop table if exists y ")
>     spark.sql("create table y(year int,month int,name string,salary int) stored by 'carbondata' tblproperties('NO_INVERTED_INDEX'='name','sort_scope'='Global_sort','table_blocksize'='23','Dictionary_include'='month','Dictionary_exclude'='year,name','sort_columns'='month,year,name')")
>     spark.sql("insert into y select 10,11,'babu',12")
> spark.sql("create datamap y1_sum1 on table y using 'preaggregate' as select year,month,name,sum(salary) from y group by year,month,name")
>     spark.sql("desc formatted y").show(100,false)
>     spark.sql("desc formatted y_y1_sum1").show(100,false)
> ------
> |col_name                            |data_type                                                                       |comment                                                                 |
> +------------------------------------+--------------------------------------------------------------------------------+------------------------------------------------------------------------+
> |y_year                              |int                                                                             |KEY COLUMN,NOINVERTEDINDEX,null                                         |
> |y_month                             |int                                                                             |DICTIONARY, KEY COLUMN,NOINVERTEDINDEX,null                             |
> |y_name                              |string                                                                          |KEY COLUMN,null                                                         |
> |y_salary_sum                        |bigint                                                                          |MEASURE,null                                                            |
> |                                    |                                                                                |                                                                        |
> |##Detailed Table Information        |                                                                                |                                                                        |
> |Database Name                       |default                                                                         |                                                                        |
> |Table Name                          |y_y1_sum1                                                                       |                                                                        |
> |CARBON Store Path                   |D:\code\carbondata\myfork\incubator-carbondata/examples/spark2/target/store     |                                                                        |
> |Comment                             |                                                                                |                                                                        |
> |Table Block Size                    |1024 MB                                                                         |                                                                        |
> |Table Data Size                     |1297                                                                            |                                                                        |
> |Table Index Size                    |1076                                                                            |                                                                        |
> |Last Update Time                    |1514546841061                                                                   |                                                                        |
> |SORT_SCOPE                          |LOCAL_SORT                                                                      |LOCAL_SORT                                                              |
> |Streaming                           |false                                                                           |                                                                        |
> |SORT_SCOPE                          |LOCAL_SORT                                                                      



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)