You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@carbondata.apache.org by Jacky Li <ja...@qq.com> on 2020/02/06 03:12:48 UTC
回复: [Discussion] Support Secondary Index on Carbon Table
+1
Thanks for proposing this :)
Regards,
Jacky
------------------ 原始邮件 ------------------
发件人: "Kunal Kapoor"<kunalkapoor642@gmail.com>;
发送时间: 2020年2月6日(星期四) 凌晨2:13
收件人: "dev"<dev@carbondata.apache.org>;
主题: Re: [Discussion] Support Secondary Index on Carbon Table
+1
Thanks
Kunal Kapoor
On Wed, Feb 5, 2020, 5:33 PM Indhumathi M <indhumathim27@gmail.com> wrote:
> Hi Community,
>
> Currently we have datamaps like,* default datamaps* which are block and
> blocklet and *coarse grained datamaps* like bloom, and *fine grained
> datamaps* like lucene
> which helps in better pruning during query. What if we introduce another
> kind of datamap which can hold blockletId as index? Initial level, we call
> it as index which
> will work as a child table to the main table like we have MV in our current
> code.
>
> Yes, lets introduce the secondary index to carbon table which will be the
> child table to main table and it can be created on column like we create
> lucene datamap,
> where we give index columns to create index. In a similar way, we create
> secondary index on column, so indexes on these column will be blocklet IDs
> which will
> help in better pruning and faster query when we have a filter query on the
> index column.
>
> Currenlty we will take it as index table and then later part we will make
> it inline to datamap interface.
>
> So design document is attached in JIRA, please give your suggestion/inputs.
>
> JIRA Link: CARBONDATA-3680
> <https://issues.apache.org/jira/browse/CARBONDATA-3680>
>
> Thanks & Regards,
> Indhumathi M
>