You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@carbondata.apache.org by VenuReddy <k....@gmail.com> on 2021/03/23 05:07:00 UTC
Re: [Discussion]Presto Queries leveraging Secondary Index
Hi all.!
As discussed in the community meeting held on last week of Feb 2021, we
already have plan to make Secondary Index as a Coarse Grain Datamap in the
future. And It would be more appropriate for this requirement to implement
Secondary Index as the CG Datamap. Presto query can leverage secondary index
in the pruning through the datamap interface. Spark queries can still
continue to make use of secondary indexes with existing approach of query
plan modification.
Have added the detailed design in the below doc.
https://docs.google.com/document/d/1VZlRYqydjzBXmZcFLQ4Ty-lK8RQlYVDoEfIId7vOaxk/edit?usp=sharing
Please review it and let me know your suggestions/inputs.
Thanks,
Venu Reddy
--
Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/
Re: [Discussion]Presto Queries leveraging Secondary Index
Posted by akashrn5 <ak...@gmail.com>.
Hi,
+1 for the feature and the design.
I have give some comments on the design doc for handling some missing
scenarios and small changes.
Can you please update the design doc. As not so major comments except one or
two, can go ahead with feature and parallelly can update comments.
Thanks
Regards,
Akash R
--
Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/
Re: [Discussion]Presto Queries leveraging Secondary Index
Posted by Ajantha Bhat <aj...@gmail.com>.
+1
Thanks,
Ajantha
On Mon, Mar 29, 2021 at 5:58 PM Indhumathi <in...@gmail.com> wrote:
> +1 for design.
>
> Please find my comments.
>
> 1. About updating IndexStatus.ENABLED property, Need to consider
> compatibility scenarios as well.
> 2. Can update the query behavior when carbon.enable.distributed.index
> and carbon.disable.index.server.fallback is enabled.
>
>
> Regards,
> Indhumathi M
>
>
>
>
> --
> Sent from:
> http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/
>
Re: [Discussion]Presto Queries leveraging Secondary Index
Posted by Indhumathi <in...@gmail.com>.
+1 for design.
Please find my comments.
1. About updating IndexStatus.ENABLED property, Need to consider
compatibility scenarios as well.
2. Can update the query behavior when carbon.enable.distributed.index
and carbon.disable.index.server.fallback is enabled.
Regards,
Indhumathi M
--
Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/
Re: [Discussion]Presto Queries leveraging Secondary Index
Posted by Kunal Kapoor <ku...@gmail.com>.
+1 for the design
On Tue, Mar 23, 2021 at 10:37 AM VenuReddy <k....@gmail.com>
wrote:
> Hi all.!
>
> As discussed in the community meeting held on last week of Feb 2021, we
> already have plan to make Secondary Index as a Coarse Grain Datamap in the
> future. And It would be more appropriate for this requirement to implement
> Secondary Index as the CG Datamap. Presto query can leverage secondary
> index
> in the pruning through the datamap interface. Spark queries can still
> continue to make use of secondary indexes with existing approach of query
> plan modification.
>
> Have added the detailed design in the below doc.
>
>
> https://docs.google.com/document/d/1VZlRYqydjzBXmZcFLQ4Ty-lK8RQlYVDoEfIId7vOaxk/edit?usp=sharing
>
> Please review it and let me know your suggestions/inputs.
>
> Thanks,
> Venu Reddy
>
>
>
> --
> Sent from:
> http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/
>