You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@harmony.apache.org by Robin Garner <ro...@anu.edu.au> on 2006/11/09 08:02:19 UTC
[drlvm][classlib] DaCapo benchmark regressions
I've just finished adding drlvm to the nightly DaCapo benchmark
regression tests. The results are available here:
http://cs/people/Robin.Garner/dacapo/regression/
JikesRVM and DRLVM/Harmony classlib are built from svn checkouts taken
when the nightly run kicks off (00:35 Australian Eastern time).
I'm currently working on adding performance stats for DRLVM and
JikesRVM, so some suggestions about the best command line parameters to
use would be appreciated.
cheers
--
Robin Garner
Dept. of Computer Science
Australian National University
Re: [drlvm][classlib] DaCapo benchmark regressions
Posted by Robin Garner <ro...@anu.edu.au>.
Alexey Petrenko wrote:
> Robin,
>
> I was frightened of your message subject... It looks like you've
> found some serious regressions in classlib and drlvm :)
:) Well, actually only 7 of the 11 benchmarks run - I guess it's only a
regression if they *ever* ran :)
>> The results are available here:
>> http://cs/people/Robin.Garner/dacapo/regression/
> It looks like my notebook does not know where to find host named cs :(
>
See other e-mail :-/
--
Robin Garner
Dept. of Computer Science
Australian National University
Re: [drlvm][classlib] DaCapo benchmark regressions
Posted by Alexey Petrenko <al...@gmail.com>.
Robin,
I was frightened of your message subject... It looks like you've
found some serious regressions in classlib and drlvm :)
2006/11/9, Robin Garner <ro...@anu.edu.au>:
> I've just finished adding drlvm to the nightly DaCapo benchmark
> regression tests.
Great.
> The results are available here:
> http://cs/people/Robin.Garner/dacapo/regression/
It looks like my notebook does not know where to find host named cs :(
SY, Alexey
Re: [drlvm][classlib] DaCapo benchmark regressions
Posted by Robin Garner <ro...@anu.edu.au>.
Alexey Varlamov wrote:
> Robin,
>
> 1) it must be debug build of drlvm;
> 2) syntax is -Xstats:[1|2|3] , the number denotes detalization level.
>
> Actually this options gives various *statistics* for run, rather than
> performance data or profile. E.g. number of particular byte ops
> performed, exceptions thrown/caugth, most frequently allocated
> classes, usage of internal memory pools, etc.
>
> I'm not sure this is what you requested - do you need to tune the VM
> for best performance or collect additional info during run or smth
> else?
Actually I'm just interested in wall clock time for the purpose of
direct performance comparisons, but I always have a use for performance
statistics from JVMs. Some of the numbers you list are tricky to get
from my measurement infrastructure :)
thanks!
>
> 2006/11/9, Robin Garner <ro...@anu.edu.au>:
>> Hmmm ...
>>
>> $ $DRLVM_HOME/jre/bin/java -Xbootclasspath/p:antlr.jar -XcleanupOnExit
>> -Xstats -jar $HOME/dacapo-2006-10.jar antlr
>> Unknown option -Xstats
>> Use java -help to get help on command line options
>>
>> $ $DRLVM_HOME/jre/bin/java -version
>> Apache Harmony Launcher : (c) Copyright 1991, 2006 The Apache Software
>> Foundation or its licensors, as applicable.
>> java version "1.5.0"
>> pre-alpha : not complete or compatible
>> svn = r472802, (Nov 9 2006), Linux/ia32/gcc 4.0.3, release build
>> http://incubator.apache.org/harmony
>>
>> Anything else I need to add ? :-)
>>
>> Evgueni Brevnov wrote:
>> > Unfortunately, YES. It's a known problem. You need to specify
>> > -XcleanupOnExit as well :-) I'm working in it currently.... will
>> > provide a fix soon...
>> >
>> > Thanks
>> > Evgueni
>> >
>> > On 11/9/06, Robin Garner <ro...@anu.edu.au> wrote:
>> >> Evgueni Brevnov wrote:
>> >> > On 11/9/06, Alexey Petrenko <al...@gmail.com> wrote:
>> >> >> The logs for some benchmarks does not have error messages.
>> >> >> Is this possible to fix?
>> >> >>
>> >> >> SY, Alexey
>> >> >>
>> >> >> 2006/11/9, Robin Garner <ro...@anu.edu.au>:
>> >> >> > I've just finished adding drlvm to the nightly DaCapo benchmark
>> >> >> > regression tests. The results are available here:
>> >> >> >
>> >> >> > http://cs/people/Robin.Garner/dacapo/regression/
>> >> >> >
>> >> >> > JikesRVM and DRLVM/Harmony classlib are built from svn checkouts
>> >> taken
>> >> >> > when the nightly run kicks off (00:35 Australian Eastern time).
>> >> >> >
>> >> >> > I'm currently working on adding performance stats for DRLVM and
>> >> >> > JikesRVM, so some suggestions about the best command line
>> >> parameters to
>> >> >> > use would be appreciated.
>> >> >
>> >> > DRLVM accepts -Xstats parameter for that purpose.
>> >>
>> >> -Xstats doesn't work for me - is there something I need to do
>> >> specifically to make it work ?
>> >>
>> >> > Thanks
>> >> >
>> >> >> >
>> >> >> > cheers
>> >> >> >
>> >> >> > --
>> >> >> > Robin Garner
>> >> >> > Dept. of Computer Science
>> >> >> > Australian National University
>> >> >> >
>> >> >>
>> >>
>> >>
>> >> --
>> >> Robin Garner
>> >> Dept. of Computer Science
>> >> Australian National University
>> >>
>>
>>
>> --
>> Robin Garner
>> Dept. of Computer Science
>> Australian National University
>>
--
Robin Garner
Dept. of Computer Science
Australian National University
http://cs.anu.edu.au/people/Robin.Garner/
Re: [drlvm][classlib] DaCapo benchmark regressions
Posted by Alexey Varlamov <al...@gmail.com>.
Robin,
1) it must be debug build of drlvm;
2) syntax is -Xstats:[1|2|3] , the number denotes detalization level.
Actually this options gives various *statistics* for run, rather than
performance data or profile. E.g. number of particular byte ops
performed, exceptions thrown/caugth, most frequently allocated
classes, usage of internal memory pools, etc.
I'm not sure this is what you requested - do you need to tune the VM
for best performance or collect additional info during run or smth
else?
2006/11/9, Robin Garner <ro...@anu.edu.au>:
> Hmmm ...
>
> $ $DRLVM_HOME/jre/bin/java -Xbootclasspath/p:antlr.jar -XcleanupOnExit
> -Xstats -jar $HOME/dacapo-2006-10.jar antlr
> Unknown option -Xstats
> Use java -help to get help on command line options
>
> $ $DRLVM_HOME/jre/bin/java -version
> Apache Harmony Launcher : (c) Copyright 1991, 2006 The Apache Software
> Foundation or its licensors, as applicable.
> java version "1.5.0"
> pre-alpha : not complete or compatible
> svn = r472802, (Nov 9 2006), Linux/ia32/gcc 4.0.3, release build
> http://incubator.apache.org/harmony
>
> Anything else I need to add ? :-)
>
> Evgueni Brevnov wrote:
> > Unfortunately, YES. It's a known problem. You need to specify
> > -XcleanupOnExit as well :-) I'm working in it currently.... will
> > provide a fix soon...
> >
> > Thanks
> > Evgueni
> >
> > On 11/9/06, Robin Garner <ro...@anu.edu.au> wrote:
> >> Evgueni Brevnov wrote:
> >> > On 11/9/06, Alexey Petrenko <al...@gmail.com> wrote:
> >> >> The logs for some benchmarks does not have error messages.
> >> >> Is this possible to fix?
> >> >>
> >> >> SY, Alexey
> >> >>
> >> >> 2006/11/9, Robin Garner <ro...@anu.edu.au>:
> >> >> > I've just finished adding drlvm to the nightly DaCapo benchmark
> >> >> > regression tests. The results are available here:
> >> >> >
> >> >> > http://cs/people/Robin.Garner/dacapo/regression/
> >> >> >
> >> >> > JikesRVM and DRLVM/Harmony classlib are built from svn checkouts
> >> taken
> >> >> > when the nightly run kicks off (00:35 Australian Eastern time).
> >> >> >
> >> >> > I'm currently working on adding performance stats for DRLVM and
> >> >> > JikesRVM, so some suggestions about the best command line
> >> parameters to
> >> >> > use would be appreciated.
> >> >
> >> > DRLVM accepts -Xstats parameter for that purpose.
> >>
> >> -Xstats doesn't work for me - is there something I need to do
> >> specifically to make it work ?
> >>
> >> > Thanks
> >> >
> >> >> >
> >> >> > cheers
> >> >> >
> >> >> > --
> >> >> > Robin Garner
> >> >> > Dept. of Computer Science
> >> >> > Australian National University
> >> >> >
> >> >>
> >>
> >>
> >> --
> >> Robin Garner
> >> Dept. of Computer Science
> >> Australian National University
> >>
>
>
> --
> Robin Garner
> Dept. of Computer Science
> Australian National University
>
Re: [drlvm][classlib] DaCapo benchmark regressions
Posted by Robin Garner <ro...@anu.edu.au>.
Hmmm ...
$ $DRLVM_HOME/jre/bin/java -Xbootclasspath/p:antlr.jar -XcleanupOnExit
-Xstats -jar $HOME/dacapo-2006-10.jar antlr
Unknown option -Xstats
Use java -help to get help on command line options
$ $DRLVM_HOME/jre/bin/java -version
Apache Harmony Launcher : (c) Copyright 1991, 2006 The Apache Software
Foundation or its licensors, as applicable.
java version "1.5.0"
pre-alpha : not complete or compatible
svn = r472802, (Nov 9 2006), Linux/ia32/gcc 4.0.3, release build
http://incubator.apache.org/harmony
Anything else I need to add ? :-)
Evgueni Brevnov wrote:
> Unfortunately, YES. It's a known problem. You need to specify
> -XcleanupOnExit as well :-) I'm working in it currently.... will
> provide a fix soon...
>
> Thanks
> Evgueni
>
> On 11/9/06, Robin Garner <ro...@anu.edu.au> wrote:
>> Evgueni Brevnov wrote:
>> > On 11/9/06, Alexey Petrenko <al...@gmail.com> wrote:
>> >> The logs for some benchmarks does not have error messages.
>> >> Is this possible to fix?
>> >>
>> >> SY, Alexey
>> >>
>> >> 2006/11/9, Robin Garner <ro...@anu.edu.au>:
>> >> > I've just finished adding drlvm to the nightly DaCapo benchmark
>> >> > regression tests. The results are available here:
>> >> >
>> >> > http://cs/people/Robin.Garner/dacapo/regression/
>> >> >
>> >> > JikesRVM and DRLVM/Harmony classlib are built from svn checkouts
>> taken
>> >> > when the nightly run kicks off (00:35 Australian Eastern time).
>> >> >
>> >> > I'm currently working on adding performance stats for DRLVM and
>> >> > JikesRVM, so some suggestions about the best command line
>> parameters to
>> >> > use would be appreciated.
>> >
>> > DRLVM accepts -Xstats parameter for that purpose.
>>
>> -Xstats doesn't work for me - is there something I need to do
>> specifically to make it work ?
>>
>> > Thanks
>> >
>> >> >
>> >> > cheers
>> >> >
>> >> > --
>> >> > Robin Garner
>> >> > Dept. of Computer Science
>> >> > Australian National University
>> >> >
>> >>
>>
>>
>> --
>> Robin Garner
>> Dept. of Computer Science
>> Australian National University
>>
--
Robin Garner
Dept. of Computer Science
Australian National University
Re: [drlvm][classlib] DaCapo benchmark regressions
Posted by Evgueni Brevnov <ev...@gmail.com>.
Unfortunately, YES. It's a known problem. You need to specify
-XcleanupOnExit as well :-) I'm working in it currently.... will
provide a fix soon...
Thanks
Evgueni
On 11/9/06, Robin Garner <ro...@anu.edu.au> wrote:
> Evgueni Brevnov wrote:
> > On 11/9/06, Alexey Petrenko <al...@gmail.com> wrote:
> >> The logs for some benchmarks does not have error messages.
> >> Is this possible to fix?
> >>
> >> SY, Alexey
> >>
> >> 2006/11/9, Robin Garner <ro...@anu.edu.au>:
> >> > I've just finished adding drlvm to the nightly DaCapo benchmark
> >> > regression tests. The results are available here:
> >> >
> >> > http://cs/people/Robin.Garner/dacapo/regression/
> >> >
> >> > JikesRVM and DRLVM/Harmony classlib are built from svn checkouts taken
> >> > when the nightly run kicks off (00:35 Australian Eastern time).
> >> >
> >> > I'm currently working on adding performance stats for DRLVM and
> >> > JikesRVM, so some suggestions about the best command line parameters to
> >> > use would be appreciated.
> >
> > DRLVM accepts -Xstats parameter for that purpose.
>
> -Xstats doesn't work for me - is there something I need to do
> specifically to make it work ?
>
> > Thanks
> >
> >> >
> >> > cheers
> >> >
> >> > --
> >> > Robin Garner
> >> > Dept. of Computer Science
> >> > Australian National University
> >> >
> >>
>
>
> --
> Robin Garner
> Dept. of Computer Science
> Australian National University
>
Re: [drlvm][classlib] DaCapo benchmark regressions
Posted by Robin Garner <ro...@anu.edu.au>.
Evgueni Brevnov wrote:
> On 11/9/06, Alexey Petrenko <al...@gmail.com> wrote:
>> The logs for some benchmarks does not have error messages.
>> Is this possible to fix?
>>
>> SY, Alexey
>>
>> 2006/11/9, Robin Garner <ro...@anu.edu.au>:
>> > I've just finished adding drlvm to the nightly DaCapo benchmark
>> > regression tests. The results are available here:
>> >
>> > http://cs/people/Robin.Garner/dacapo/regression/
>> >
>> > JikesRVM and DRLVM/Harmony classlib are built from svn checkouts taken
>> > when the nightly run kicks off (00:35 Australian Eastern time).
>> >
>> > I'm currently working on adding performance stats for DRLVM and
>> > JikesRVM, so some suggestions about the best command line parameters to
>> > use would be appreciated.
>
> DRLVM accepts -Xstats parameter for that purpose.
-Xstats doesn't work for me - is there something I need to do
specifically to make it work ?
> Thanks
>
>> >
>> > cheers
>> >
>> > --
>> > Robin Garner
>> > Dept. of Computer Science
>> > Australian National University
>> >
>>
--
Robin Garner
Dept. of Computer Science
Australian National University
Re: [drlvm][classlib] DaCapo benchmark regressions
Posted by Robin Garner <ro...@anu.edu.au>.
Evgueni Brevnov wrote:
> On 11/9/06, Alexey Petrenko <al...@gmail.com> wrote:
>> The logs for some benchmarks does not have error messages.
>> Is this possible to fix?
>>
>> SY, Alexey
>>
>> 2006/11/9, Robin Garner <ro...@anu.edu.au>:
>> > I've just finished adding drlvm to the nightly DaCapo benchmark
>> > regression tests. The results are available here:
>> >
>> > http://cs/people/Robin.Garner/dacapo/regression/
>> >
>> > JikesRVM and DRLVM/Harmony classlib are built from svn checkouts taken
>> > when the nightly run kicks off (00:35 Australian Eastern time).
>> >
>> > I'm currently working on adding performance stats for DRLVM and
>> > JikesRVM, so some suggestions about the best command line parameters to
>> > use would be appreciated.
>
> DRLVM accepts -Xstats parameter for that purpose.
OK, thanks for that.
I was more thinking about making it go fast :) Or is the default
designed to be as fast as possible ?
cheers
--
Robin Garner
Dept. of Computer Science
Australian National University
Re: [drlvm][classlib] DaCapo benchmark regressions
Posted by Evgueni Brevnov <ev...@gmail.com>.
On 11/9/06, Alexey Petrenko <al...@gmail.com> wrote:
> The logs for some benchmarks does not have error messages.
> Is this possible to fix?
>
> SY, Alexey
>
> 2006/11/9, Robin Garner <ro...@anu.edu.au>:
> > I've just finished adding drlvm to the nightly DaCapo benchmark
> > regression tests. The results are available here:
> >
> > http://cs/people/Robin.Garner/dacapo/regression/
> >
> > JikesRVM and DRLVM/Harmony classlib are built from svn checkouts taken
> > when the nightly run kicks off (00:35 Australian Eastern time).
> >
> > I'm currently working on adding performance stats for DRLVM and
> > JikesRVM, so some suggestions about the best command line parameters to
> > use would be appreciated.
DRLVM accepts -Xstats parameter for that purpose.
Thanks
> >
> > cheers
> >
> > --
> > Robin Garner
> > Dept. of Computer Science
> > Australian National University
> >
>
Re: [drlvm][classlib] DaCapo benchmark regressions
Posted by Alexey Petrenko <al...@gmail.com>.
The logs for some benchmarks does not have error messages.
Is this possible to fix?
SY, Alexey
2006/11/9, Robin Garner <ro...@anu.edu.au>:
> I've just finished adding drlvm to the nightly DaCapo benchmark
> regression tests. The results are available here:
>
> http://cs/people/Robin.Garner/dacapo/regression/
>
> JikesRVM and DRLVM/Harmony classlib are built from svn checkouts taken
> when the nightly run kicks off (00:35 Australian Eastern time).
>
> I'm currently working on adding performance stats for DRLVM and
> JikesRVM, so some suggestions about the best command line parameters to
> use would be appreciated.
>
> cheers
>
> --
> Robin Garner
> Dept. of Computer Science
> Australian National University
>
Re: [drlvm][classlib] DaCapo benchmark regressions
Posted by "Geir Magnusson Jr." <ge...@pobox.com>.
Robin Garner wrote:
> Geir Magnusson Jr. wrote:
>>
>>
>> Robin Garner wrote:
>>> Geir Magnusson Jr. wrote:
>>>> Nice - we should put this on the website (maybe same place where we
>>>> point to JAPI results).
>>>>
>>>> Are you tracking performance #'s over time? You are just tracking
>>>> regression in terms of how much runs, rather than how fast?
>>>>
>>>> geir
>>>
>>> Right now it's just regression failures, but I'm working on graphs of
>>> performance over time, for the non-commercial VMs at least.
>>
>> Do 'em all! We need to track ourselves to Sun et al, because that's
>> what we're trying to achieve :)
>
> Well ... I thought there were legal issues wrt releasing performance
> numbers of some of these VMs.
That's a good point. I didn't think there were, but I'll admit I
havent' read the license for hte Sun binary closely on that issue. We
should figure that out...
>>>
>>> This is a temporary home, so don't link to it too permanently :)
>>
>> ok. We'll use the <a href="....." linktype="NotTooPermanant">...</a>
>
> :-P
>
>> geir
>>
>>>
>>> cheers
>>>
>>>>
>>>> Robin Garner wrote:
>>>>>
>>>>>
>>>>> Weldon Washburn wrote:
>>>>>> Fantastic!
>>>>>>
>>>>>> By the way, the http:// link below did not work for me.
>>>>>
>>>>> Doh!
>>>>>
>>>>> http://cs.anu.edu.au/people/Robin.Garner/dacapo/regression/
>>>>>
>>>>>>
>>>>>> On 11/8/06, Robin Garner <ro...@anu.edu.au> wrote:
>>>>>>>
>>>>>>> I've just finished adding drlvm to the nightly DaCapo benchmark
>>>>>>> regression tests. The results are available here:
>>>>>>>
>>>>>>> http://cs/people/Robin.Garner/dacapo/regression/
>>>>>>>
>>>>>>> JikesRVM and DRLVM/Harmony classlib are built from svn checkouts
>>>>>>> taken
>>>>>>> when the nightly run kicks off (00:35 Australian Eastern time).
>>>>>>>
>>>>>>> I'm currently working on adding performance stats for DRLVM and
>>>>>>> JikesRVM, so some suggestions about the best command line
>>>>>>> parameters to
>>>>>>> use would be appreciated.
>>>>>>>
>>>>>>> cheers
>>>>>>>
>>>>>>> --
>>>>>>> Robin Garner
>>>>>>> Dept. of Computer Science
>>>>>>> Australian National University
>>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>
>>>
>
>
Re: [drlvm][classlib] DaCapo benchmark regressions
Posted by Robin Garner <ro...@anu.edu.au>.
Geir Magnusson Jr. wrote:
>
>
> Robin Garner wrote:
>> Geir Magnusson Jr. wrote:
>>> Nice - we should put this on the website (maybe same place where we
>>> point to JAPI results).
>>>
>>> Are you tracking performance #'s over time? You are just tracking
>>> regression in terms of how much runs, rather than how fast?
>>>
>>> geir
>>
>> Right now it's just regression failures, but I'm working on graphs of
>> performance over time, for the non-commercial VMs at least.
>
> Do 'em all! We need to track ourselves to Sun et al, because that's
> what we're trying to achieve :)
Well ... I thought there were legal issues wrt releasing performance
numbers of some of these VMs.
>>
>> This is a temporary home, so don't link to it too permanently :)
>
> ok. We'll use the <a href="....." linktype="NotTooPermanant">...</a>
:-P
> geir
>
>>
>> cheers
>>
>>>
>>> Robin Garner wrote:
>>>>
>>>>
>>>> Weldon Washburn wrote:
>>>>> Fantastic!
>>>>>
>>>>> By the way, the http:// link below did not work for me.
>>>>
>>>> Doh!
>>>>
>>>> http://cs.anu.edu.au/people/Robin.Garner/dacapo/regression/
>>>>
>>>>>
>>>>> On 11/8/06, Robin Garner <ro...@anu.edu.au> wrote:
>>>>>>
>>>>>> I've just finished adding drlvm to the nightly DaCapo benchmark
>>>>>> regression tests. The results are available here:
>>>>>>
>>>>>> http://cs/people/Robin.Garner/dacapo/regression/
>>>>>>
>>>>>> JikesRVM and DRLVM/Harmony classlib are built from svn checkouts
>>>>>> taken
>>>>>> when the nightly run kicks off (00:35 Australian Eastern time).
>>>>>>
>>>>>> I'm currently working on adding performance stats for DRLVM and
>>>>>> JikesRVM, so some suggestions about the best command line
>>>>>> parameters to
>>>>>> use would be appreciated.
>>>>>>
>>>>>> cheers
>>>>>>
>>>>>> --
>>>>>> Robin Garner
>>>>>> Dept. of Computer Science
>>>>>> Australian National University
>>>>>>
>>>>>
>>>>>
>>>>>
>>>>
>>>>
>>
>>
--
Robin Garner
Dept. of Computer Science
Australian National University
Re: [drlvm][classlib] DaCapo benchmark regressions
Posted by "Geir Magnusson Jr." <ge...@pobox.com>.
Robin Garner wrote:
> Geir Magnusson Jr. wrote:
>> Nice - we should put this on the website (maybe same place where we
>> point to JAPI results).
>>
>> Are you tracking performance #'s over time? You are just tracking
>> regression in terms of how much runs, rather than how fast?
>>
>> geir
>
> Right now it's just regression failures, but I'm working on graphs of
> performance over time, for the non-commercial VMs at least.
Do 'em all! We need to track ourselves to Sun et al, because that's
what we're trying to achieve :)
>
> This is a temporary home, so don't link to it too permanently :)
ok. We'll use the <a href="....." linktype="NotTooPermanant">...</a>
geir
>
> cheers
>
>>
>> Robin Garner wrote:
>>>
>>>
>>> Weldon Washburn wrote:
>>>> Fantastic!
>>>>
>>>> By the way, the http:// link below did not work for me.
>>>
>>> Doh!
>>>
>>> http://cs.anu.edu.au/people/Robin.Garner/dacapo/regression/
>>>
>>>>
>>>> On 11/8/06, Robin Garner <ro...@anu.edu.au> wrote:
>>>>>
>>>>> I've just finished adding drlvm to the nightly DaCapo benchmark
>>>>> regression tests. The results are available here:
>>>>>
>>>>> http://cs/people/Robin.Garner/dacapo/regression/
>>>>>
>>>>> JikesRVM and DRLVM/Harmony classlib are built from svn checkouts taken
>>>>> when the nightly run kicks off (00:35 Australian Eastern time).
>>>>>
>>>>> I'm currently working on adding performance stats for DRLVM and
>>>>> JikesRVM, so some suggestions about the best command line
>>>>> parameters to
>>>>> use would be appreciated.
>>>>>
>>>>> cheers
>>>>>
>>>>> --
>>>>> Robin Garner
>>>>> Dept. of Computer Science
>>>>> Australian National University
>>>>>
>>>>
>>>>
>>>>
>>>
>>>
>
>
Re: [drlvm][classlib] DaCapo benchmark regressions
Posted by Robin Garner <ro...@anu.edu.au>.
Geir Magnusson Jr. wrote:
> Nice - we should put this on the website (maybe same place where we
> point to JAPI results).
>
> Are you tracking performance #'s over time? You are just tracking
> regression in terms of how much runs, rather than how fast?
>
> geir
Right now it's just regression failures, but I'm working on graphs of
performance over time, for the non-commercial VMs at least.
This is a temporary home, so don't link to it too permanently :)
cheers
>
> Robin Garner wrote:
>>
>>
>> Weldon Washburn wrote:
>>> Fantastic!
>>>
>>> By the way, the http:// link below did not work for me.
>>
>> Doh!
>>
>> http://cs.anu.edu.au/people/Robin.Garner/dacapo/regression/
>>
>>>
>>> On 11/8/06, Robin Garner <ro...@anu.edu.au> wrote:
>>>>
>>>> I've just finished adding drlvm to the nightly DaCapo benchmark
>>>> regression tests. The results are available here:
>>>>
>>>> http://cs/people/Robin.Garner/dacapo/regression/
>>>>
>>>> JikesRVM and DRLVM/Harmony classlib are built from svn checkouts taken
>>>> when the nightly run kicks off (00:35 Australian Eastern time).
>>>>
>>>> I'm currently working on adding performance stats for DRLVM and
>>>> JikesRVM, so some suggestions about the best command line parameters to
>>>> use would be appreciated.
>>>>
>>>> cheers
>>>>
>>>> --
>>>> Robin Garner
>>>> Dept. of Computer Science
>>>> Australian National University
>>>>
>>>
>>>
>>>
>>
>>
--
Robin Garner
Dept. of Computer Science
Australian National University
Re: [drlvm][classlib] DaCapo benchmark regressions
Posted by "Geir Magnusson Jr." <ge...@pobox.com>.
Nice - we should put this on the website (maybe same place where we
point to JAPI results).
Are you tracking performance #'s over time? You are just tracking
regression in terms of how much runs, rather than how fast?
geir
Robin Garner wrote:
>
>
> Weldon Washburn wrote:
>> Fantastic!
>>
>> By the way, the http:// link below did not work for me.
>
> Doh!
>
> http://cs.anu.edu.au/people/Robin.Garner/dacapo/regression/
>
>>
>> On 11/8/06, Robin Garner <ro...@anu.edu.au> wrote:
>>>
>>> I've just finished adding drlvm to the nightly DaCapo benchmark
>>> regression tests. The results are available here:
>>>
>>> http://cs/people/Robin.Garner/dacapo/regression/
>>>
>>> JikesRVM and DRLVM/Harmony classlib are built from svn checkouts taken
>>> when the nightly run kicks off (00:35 Australian Eastern time).
>>>
>>> I'm currently working on adding performance stats for DRLVM and
>>> JikesRVM, so some suggestions about the best command line parameters to
>>> use would be appreciated.
>>>
>>> cheers
>>>
>>> --
>>> Robin Garner
>>> Dept. of Computer Science
>>> Australian National University
>>>
>>
>>
>>
>
>
Re: [drlvm][classlib] DaCapo benchmark regressions
Posted by Robin Garner <ro...@anu.edu.au>.
Weldon Washburn wrote:
> Fantastic!
>
> By the way, the http:// link below did not work for me.
Doh!
http://cs.anu.edu.au/people/Robin.Garner/dacapo/regression/
>
> On 11/8/06, Robin Garner <ro...@anu.edu.au> wrote:
>>
>> I've just finished adding drlvm to the nightly DaCapo benchmark
>> regression tests. The results are available here:
>>
>> http://cs/people/Robin.Garner/dacapo/regression/
>>
>> JikesRVM and DRLVM/Harmony classlib are built from svn checkouts taken
>> when the nightly run kicks off (00:35 Australian Eastern time).
>>
>> I'm currently working on adding performance stats for DRLVM and
>> JikesRVM, so some suggestions about the best command line parameters to
>> use would be appreciated.
>>
>> cheers
>>
>> --
>> Robin Garner
>> Dept. of Computer Science
>> Australian National University
>>
>
>
>
--
Robin Garner
Dept. of Computer Science
Australian National University
Re: [drlvm][classlib] DaCapo benchmark regressions
Posted by Weldon Washburn <we...@gmail.com>.
Fantastic!
By the way, the http:// link below did not work for me.
On 11/8/06, Robin Garner <ro...@anu.edu.au> wrote:
>
> I've just finished adding drlvm to the nightly DaCapo benchmark
> regression tests. The results are available here:
>
> http://cs/people/Robin.Garner/dacapo/regression/
>
> JikesRVM and DRLVM/Harmony classlib are built from svn checkouts taken
> when the nightly run kicks off (00:35 Australian Eastern time).
>
> I'm currently working on adding performance stats for DRLVM and
> JikesRVM, so some suggestions about the best command line parameters to
> use would be appreciated.
>
> cheers
>
> --
> Robin Garner
> Dept. of Computer Science
> Australian National University
>
--
Weldon Washburn
Intel Enterprise Solutions Software Division