You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@orc.apache.org by Xiening Dai <xn...@live.com> on 2018/02/01 04:27:31 UTC

RLEv1 versus RLEv2

Hi,

I am evaluating if we should work as a high priority to add RLEv2 support in Orc C++ writer. I wonder if anyone has any performance data to share regarding RLEv2. I believe some related tests and evaluation must have been done when RLEv2 was introduced. Would appreciate if someone can share a pointer.

Thanks.

Re: RLEv1 versus RLEv2

Posted by Xiening Dai <xn...@live.com>.

Thanks. We might start by a straight port from Java to C++ and do some benchmarking. I will report back if I have more to share.


> On Feb 1, 2018, at 12:44 AM, Prasanth Jayachandran <j....@gmail.com> wrote:
> 
> Hi
> 
> You can find more information about performance here
> https://speakerdeck.com/prasanthj/orc-2015-faster-better-smaller?slide=10
> 
> Original JIRA has more initial performance numbers
> https://issues-test.apache.org/jira/browse/HIVE-4123
> 
> As you can see from the slides, several performance improvements went it
> later on. Also the slides were prepared in 2015 after which more perf
> improvements went in. I don't think anyone benchmarked RLEv1 vs RLEv2 after
> the initial perf tests.
> 
> 
> Thanks and Regards,
> Prasanth Jayachandran
> 
> 
> On Wed, Jan 31, 2018 at 8:27 PM, Xiening Dai <xn...@live.com> wrote:
> 
>> Hi,
>> 
>> I am evaluating if we should work as a high priority to add RLEv2 support
>> in Orc C++ writer. I wonder if anyone has any performance data to share
>> regarding RLEv2. I believe some related tests and evaluation must have been
>> done when RLEv2 was introduced. Would appreciate if someone can share a
>> pointer.
>> 
>> Thanks.

Re: RLEv1 versus RLEv2

Posted by Prasanth Jayachandran <j....@gmail.com>.

Hi

You can find more information about performance here
https://speakerdeck.com/prasanthj/orc-2015-faster-better-smaller?slide=10

Original JIRA has more initial performance numbers
https://issues-test.apache.org/jira/browse/HIVE-4123

As you can see from the slides, several performance improvements went it
later on. Also the slides were prepared in 2015 after which more perf
improvements went in. I don't think anyone benchmarked RLEv1 vs RLEv2 after
the initial perf tests.

Thanks and Regards,
Prasanth Jayachandran

On Wed, Jan 31, 2018 at 8:27 PM, Xiening Dai <xn...@live.com> wrote:

> Hi,
>
> I am evaluating if we should work as a high priority to add RLEv2 support
> in Orc C++ writer. I wonder if anyone has any performance data to share
> regarding RLEv2. I believe some related tests and evaluation must have been
> done when RLEv2 was introduced. Would appreciate if someone can share a
> pointer.
>
> Thanks.