avrò benchmarks

[Zoltan Farkas <zo...@yahoo.com.INVALID>]

Sean, suggested I bring this up on the dev mailing list:

Hi gentlemen, Can we create a subproject for avro with standard benchmarks with JMH?
Jmh, is a good benchmarking framework that mitigates some of the common benchmarking pitfalls (http://openjdk.java.net/projects/code-tools/jmh/ <http://openjdk.java.net/projects/code-tools/jmh/>)
these benchmarks results, can then be reported on (trends, detail..) jenkins with https://github.com/blackboard/jmh-jenkins <https://github.com/blackboard/jmh-jenkins>
Here is how I do it in a project that I maintain: 
https://code.google.com/p/spf4j/source/browse/#svn%2Ftrunk%2Fspf4j-benchmarks <https://code.google.com/p/spf4j/source/browse/#svn%2Ftrunk%2Fspf4j-benchmarks>
I also publish the results to the project site: http://zolyfarkas.github.io/spf4j/spf4j-benchmarks/index.html <http://zolyfarkas.github.io/spf4j/spf4j-benchmarks/index.html>
In my case I also collect profiling information during benchmarking, which allows be to have the data ready when I see a performance degradation. (I also publish them to the project site, both spf4j stack sample data and java flight recorder data)
I use this approach and it is really really useful.
let me know what you think, cheers

—Z

Re: avrò benchmarks

[Doug Cutting <cu...@apache.org>]

Existing benchmarks are in the Perf.java file:

https://svn.apache.org/viewvc/avro/trunk/lang/java/ipc/src/test/java/org/apache/avro/io/Perf.java?view=markup

These are run with the incantation:

( cd lang/java/ipc/ ; mvn exec:java
-Dexec.mainClass=org.apache.avro.io.Perf -Dexec.classpathScope="test"
)

Converting these to JMH would be great.

Doug

On Mon, Nov 3, 2014 at 1:47 PM, Sean Busbey <bu...@cloudera.com> wrote:
> I don't think a subproject is needed; we should be able to do this as an
> additional module in the Avro Java implementation.
>
> On Mon, Nov 3, 2014 at 3:17 PM, Zoltan Farkas <zo...@yahoo.com.invalid>
> wrote:
>
>> Sean, suggested I bring this up on the dev mailing list:
>>
>> Hi gentlemen, Can we create a subproject for avro with standard benchmarks
>> with JMH?
>> Jmh, is a good benchmarking framework that mitigates some of the common
>> benchmarking pitfalls (http://openjdk.java.net/projects/code-tools/jmh/ <
>> http://openjdk.java.net/projects/code-tools/jmh/>)
>> these benchmarks results, can then be reported on (trends, detail..)
>> jenkins with https://github.com/blackboard/jmh-jenkins <
>> https://github.com/blackboard/jmh-jenkins>
>> Here is how I do it in a project that I maintain:
>>
>> https://code.google.com/p/spf4j/source/browse/#svn%2Ftrunk%2Fspf4j-benchmarks
>> <
>> https://code.google.com/p/spf4j/source/browse/#svn%2Ftrunk%2Fspf4j-benchmarks
>> >
>> I also publish the results to the project site:
>> http://zolyfarkas.github.io/spf4j/spf4j-benchmarks/index.html <
>> http://zolyfarkas.github.io/spf4j/spf4j-benchmarks/index.html>
>> In my case I also collect profiling information during benchmarking, which
>> allows be to have the data ready when I see a performance degradation. (I
>> also publish them to the project site, both spf4j stack sample data and
>> java flight recorder data)
>> I use this approach and it is really really useful.
>> let me know what you think, cheers
>>
>> —Z
>
>
>
>
> --
> Sean

Re: avrò benchmarks

[Sean Busbey <bu...@cloudera.com>]

I don't think a subproject is needed; we should be able to do this as an
additional module in the Avro Java implementation.

On Mon, Nov 3, 2014 at 3:17 PM, Zoltan Farkas <zo...@yahoo.com.invalid>
wrote:

> Sean, suggested I bring this up on the dev mailing list:
>
> Hi gentlemen, Can we create a subproject for avro with standard benchmarks
> with JMH?
> Jmh, is a good benchmarking framework that mitigates some of the common
> benchmarking pitfalls (http://openjdk.java.net/projects/code-tools/jmh/ <
> http://openjdk.java.net/projects/code-tools/jmh/>)
> these benchmarks results, can then be reported on (trends, detail..)
> jenkins with https://github.com/blackboard/jmh-jenkins <
> https://github.com/blackboard/jmh-jenkins>
> Here is how I do it in a project that I maintain:
>
> https://code.google.com/p/spf4j/source/browse/#svn%2Ftrunk%2Fspf4j-benchmarks
> <
> https://code.google.com/p/spf4j/source/browse/#svn%2Ftrunk%2Fspf4j-benchmarks
> >
> I also publish the results to the project site:
> http://zolyfarkas.github.io/spf4j/spf4j-benchmarks/index.html <
> http://zolyfarkas.github.io/spf4j/spf4j-benchmarks/index.html>
> In my case I also collect profiling information during benchmarking, which
> allows be to have the data ready when I see a performance degradation. (I
> also publish them to the project site, both spf4j stack sample data and
> java flight recorder data)
> I use this approach and it is really really useful.
> let me know what you think, cheers
>
> —Z




-- 
Sean