You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@carbondata.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2016/07/26 02:32:22 UTC
[jira] [Commented] (CARBONDATA-108) Remove unnecessary Project for
CarbonScan
[ https://issues.apache.org/jira/browse/CARBONDATA-108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15393083#comment-15393083 ]
ASF GitHub Bot commented on CARBONDATA-108:
-------------------------------------------
GitHub user jackylk opened a pull request:
https://github.com/apache/incubator-carbondata/pull/55
[CARBONDATA-108] Remove project in strategy
Modify CarbonStrategy, when project equals scan column, do scan without project
Modify some test cases to drop table
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/jackylk/incubator-carbondata project
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/incubator-carbondata/pull/55.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #55
----
commit bd9fe7c9b8bb8bd6030a0f137e348888a6ba268c
Author: jackylk <ja...@huawei.com>
Date: 2016-07-26T02:28:18Z
remove project in strategy
----
> Remove unnecessary Project for CarbonScan
> -----------------------------------------
>
> Key: CARBONDATA-108
> URL: https://issues.apache.org/jira/browse/CARBONDATA-108
> Project: CarbonData
> Issue Type: Improvement
> Components: carbon-spark
> Reporter: Jacky Li
> Fix For: Apache CarbonData 0.1.0-incubating
>
>
> For this SQL:
> select ch, sum(c) from (select ch,count(1) as c from t1 group by ch) temp where c > 1 group by ch
> Physical plan is:
> == Physical Plan ==
> Limit 21
> ConvertToSafe
> CarbonDictionaryDecoder [CarbonDecoderRelation(Map(word#22 -> word#22, ch#23 -> ch#23, value#24L -> value#24L),CarbonDatasourceRelation(`default`.`t1`,None))], ExcludeProfile(ArrayBuffer()), CarbonAliasDecoderRelation()
> TungstenAggregate(key=[ch#23], functions=[(sum(c#18L),mode=Final,isDistinct=false)], output=[ch#23,_c1#25L])
> TungstenAggregate(key=[ch#23], functions=[(sum(c#18L),mode=Partial,isDistinct=false)], output=[ch#23,currentSum#48L])
> Filter (c#18L > 1)
> TungstenAggregate(key=[ch#23], functions=[(count(1),mode=Final,isDistinct=false)], output=[ch#23,c#18L])
> TungstenExchange hashpartitioning(ch#23)
> TungstenAggregate(key=[ch#23], functions=[(count(1),mode=Partial,isDistinct=false)], output=[ch#23,currentCount#52L])
> Project [ch#23]
> ConvertToSafe
> CarbonScan [ch#23], (CarbonRelation default, t1, CarbonMetaData(ArrayBuffer(word, ch),ArrayBuffer(value),org.carbondata.core.carbon.metadata.schema.table.CarbonTable@6034ef16,DictionaryMap(Map(word -> true, ch -> true))), TableMeta(default_t1,/Users/jackylk/code/incubator-carbondata/target/store,org.carbondata.core.carbon.metadata.schema.table.CarbonTable@6034ef16,Partitioner(org.carbondata.spark.partition.api.impl.SampleDataPartitionerImpl,[Ljava.lang.String;@450458d7,1,[Ljava.lang.String;@f8a969d)), None), true
> The Project is unnecessary since CarbonScan only scan the requested column
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)