Re: Proposal to integrate QATCodec into Carbondata

[Raghunandan S <ca...@gmail.com>]

+1
This would further enhance the performance of queries where io is the
bottleneck

Regards
Raghu

On Fri, 12 Oct 2018, 12:18 pm Xu, Cheng A, <ch...@intel.com> wrote:

> Thanks Chuanyin. This PR looks cool. Allowing customized codec is a good
> option. Comparing with the existing built-in Snappy codec in CarbonData, I
> think QATCodec with better performance and better compression ratio is also
> a good candidate for built-in support. Any thoughts?
>
> Thanks
> Ferdinand Xu
>
> -----Original Message-----
> From: xuchuanyin [mailto:xuchuanyin@hust.edu.cn]
> Sent: Friday, October 12, 2018 11:07 AM
> To: dev@carbondata.apache.org
> Subject: Re: Proposal to integrate QATCodec into Carbondata
>
> emm, if it only needs to extend another compressor for software
> implementation, I think it will be quite easy to integrate.
>
> Actually a PR has already been raised weeks ago to support customize
> compressor in carbondata, you can refer to this link:
> https://github.com/apache/carbondata/pull/2715. You can refer to the
> `CustomizeCompressor` in `TestLoadDataWithCompression.scala` for more
> information.
>
>
>
> --
> Sent from:
> http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/
>

RE: Proposal to integrate QATCodec into Carbondata

["Xu, Cheng A" <ch...@intel.com>]

Thanks Raghu. Will prepare for the pull request.

Thanks
Ferdinand Xu


-----Original Message-----
From: Raghunandan S [mailto:carbondatacontributions@gmail.com] 
Sent: Thursday, November 1, 2018 7:09 PM
To: dev@carbondata.apache.org
Subject: Re: Proposal to integrate QATCodec into Carbondata

+1
This would further enhance the performance of queries where io is the bottleneck

Regards
Raghu

On Fri, 12 Oct 2018, 12:18 pm Xu, Cheng A, <ch...@intel.com> wrote:

> Thanks Chuanyin. This PR looks cool. Allowing customized codec is a 
> good option. Comparing with the existing built-in Snappy codec in 
> CarbonData, I think QATCodec with better performance and better 
> compression ratio is also a good candidate for built-in support. Any thoughts?
>
> Thanks
> Ferdinand Xu
>
> -----Original Message-----
> From: xuchuanyin [mailto:xuchuanyin@hust.edu.cn]
> Sent: Friday, October 12, 2018 11:07 AM
> To: dev@carbondata.apache.org
> Subject: Re: Proposal to integrate QATCodec into Carbondata
>
> emm, if it only needs to extend another compressor for software 
> implementation, I think it will be quite easy to integrate.
>
> Actually a PR has already been raised weeks ago to support customize 
> compressor in carbondata, you can refer to this link:
> https://github.com/apache/carbondata/pull/2715. You can refer to the 
> `CustomizeCompressor` in `TestLoadDataWithCompression.scala` for more 
> information.
>
>
>
> --
> Sent from:
> http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.co
> m/
>