Gandiva Java benchmarks

[Rui Wang <ru...@google.com.INVALID>]

Hello Arrow community,

I am studying Gandiva and especially interested in its performance.

I am wondering if there is prior benchmarking work happened somewhere on
Gandiva Java? Also, is it worth building some benchmarking code for Gandiva
Java (something like SparkSQL's benchmarks
<https://github.com/apache/spark/tree/master/sql/core/src/test/scala/org/apache/spark/sql/execution/benchmark>
)?



-Rui

Re: Gandiva Java benchmarks

[Micah Kornfield <em...@gmail.com>]

Hi Rui,
In addition to this Dremio provided some benchmarks in their initial
announcement of Gandiva [1].

In general, I think we'd like to add more benchmarks to the Java
implementation.  For now, we have been building mostly very targeted
microbenchmarks, as there has been some disagreement on what larger
benchmarks might look like.  Additionally, I'd like to see our Java JMH
benchmarks integrated with Archery (Arrow's benchmarking system).

Thanks,
-Micah

[1]
https://www.dremio.com/gandiva-performance-improvements-production-query/

On Fri, Aug 16, 2019 at 4:39 PM Rui Wang <ru...@google.com.invalid> wrote:

> I got help for a pointer to Gandiva cpp's micro benchmark
> <
> https://github.com/apache/arrow/blob/master/cpp/src/gandiva/tests/micro_benchmarks.cc
> >.
> I will start from there.
>
>
> -Rui
>
> On Fri, Aug 16, 2019 at 2:49 PM Rui Wang <ru...@google.com> wrote:
>
> > Hello Arrow community,
> >
> > I am studying Gandiva and especially interested in its performance.
> >
> > I am wondering if there is prior benchmarking work happened somewhere on
> > Gandiva Java? Also, is it worth building some benchmarking code for
> Gandiva
> > Java (something like SparkSQL's benchmarks
> > <
> https://github.com/apache/spark/tree/master/sql/core/src/test/scala/org/apache/spark/sql/execution/benchmark
> >
> > )?
> >
> >
> >
> > -Rui
> >
>

Re: Gandiva Java benchmarks

[Ravindra Pindikura <ra...@dremio.com>]

On Sat, Aug 17, 2019 at 5:09 AM Rui Wang <ru...@google.com.invalid> wrote:

> I got help for a pointer to Gandiva cpp's micro benchmark
> <
> https://github.com/apache/arrow/blob/master/cpp/src/gandiva/tests/micro_benchmarks.cc
> >.
> I will start from there.
>

There is also a primitive java variant here :

https://github.com/apache/arrow/blob/master/java/gandiva/src/test/java/org/apache/arrow/gandiva/evaluator/MicroBenchmarkTest.java


>
>
> -Rui
>
> On Fri, Aug 16, 2019 at 2:49 PM Rui Wang <ru...@google.com> wrote:
>
> > Hello Arrow community,
> >
> > I am studying Gandiva and especially interested in its performance.
> >
> > I am wondering if there is prior benchmarking work happened somewhere on
> > Gandiva Java? Also, is it worth building some benchmarking code for
> Gandiva
> > Java (something like SparkSQL's benchmarks
> > <
> https://github.com/apache/spark/tree/master/sql/core/src/test/scala/org/apache/spark/sql/execution/benchmark
> >
> > )?
> >
> >
> >
> > -Rui
> >
>


-- 
Thanks and regards,
Ravindra.

Re: Gandiva Java benchmarks

[Rui Wang <ru...@google.com.INVALID>]

I got help for a pointer to Gandiva cpp's micro benchmark
<https://github.com/apache/arrow/blob/master/cpp/src/gandiva/tests/micro_benchmarks.cc>.
I will start from there.


-Rui

On Fri, Aug 16, 2019 at 2:49 PM Rui Wang <ru...@google.com> wrote:

> Hello Arrow community,
>
> I am studying Gandiva and especially interested in its performance.
>
> I am wondering if there is prior benchmarking work happened somewhere on
> Gandiva Java? Also, is it worth building some benchmarking code for Gandiva
> Java (something like SparkSQL's benchmarks
> <https://github.com/apache/spark/tree/master/sql/core/src/test/scala/org/apache/spark/sql/execution/benchmark>
> )?
>
>
>
> -Rui
>