You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@commons.apache.org by "Gilles (JIRA)" <ji...@apache.org> on 2011/07/29 23:16:09 UTC
[jira] [Created] (MATH-637) Simple utility for micro-benchmarking
Simple utility for micro-benchmarking
-------------------------------------
Key: MATH-637
URL: https://issues.apache.org/jira/browse/MATH-637
Project: Commons Math
Issue Type: Wish
Reporter: Gilles
Assignee: Gilles
Priority: Minor
Fix For: 3.0
As per the discussion on the "dev" ML (with subject: "Simple benchmarking utility"), it would be useful to have an easy way to benchmark alternative implementations of some functionality.
The proposed utility methods will be collected in a class located in the "src/test/java" part of the code repository.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (MATH-637) Simple utility for micro-benchmarking
Posted by "Gilles (Resolved) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MATH-637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Gilles resolved MATH-637.
-------------------------
Resolution: Fixed
> Simple utility for micro-benchmarking
> -------------------------------------
>
> Key: MATH-637
> URL: https://issues.apache.org/jira/browse/MATH-637
> Project: Commons Math
> Issue Type: Wish
> Reporter: Gilles
> Assignee: Gilles
> Priority: Minor
> Labels: test
> Fix For: 3.0
>
> Attachments: PerfUtils.patch
>
>
> As per the discussion on the "dev" ML (with subject: "Simple benchmarking utility"), it would be useful to have an easy way to benchmark alternative implementations of some functionality.
> The proposed utility methods will be collected in a class located in the "src/test/java" part of the code repository.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MATH-637) Simple utility for micro-benchmarking
Posted by "Gilles (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MATH-637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13073353#comment-13073353 ]
Gilles commented on MATH-637:
-----------------------------
Thanks. Applied in revision 1152584.
> Simple utility for micro-benchmarking
> -------------------------------------
>
> Key: MATH-637
> URL: https://issues.apache.org/jira/browse/MATH-637
> Project: Commons Math
> Issue Type: Wish
> Reporter: Gilles
> Assignee: Gilles
> Priority: Minor
> Labels: test
> Fix For: 3.0
>
> Attachments: PerfUtils.patch
>
>
> As per the discussion on the "dev" ML (with subject: "Simple benchmarking utility"), it would be useful to have an easy way to benchmark alternative implementations of some functionality.
> The proposed utility methods will be collected in a class located in the "src/test/java" part of the code repository.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MATH-637) Simple utility for micro-benchmarking
Posted by "Gilles (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MATH-637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13073034#comment-13073034 ]
Gilles commented on MATH-637:
-----------------------------
Initial code committed in revision 1152380.
> Simple utility for micro-benchmarking
> -------------------------------------
>
> Key: MATH-637
> URL: https://issues.apache.org/jira/browse/MATH-637
> Project: Commons Math
> Issue Type: Wish
> Reporter: Gilles
> Assignee: Gilles
> Priority: Minor
> Labels: test
> Fix For: 3.0
>
>
> As per the discussion on the "dev" ML (with subject: "Simple benchmarking utility"), it would be useful to have an easy way to benchmark alternative implementations of some functionality.
> The proposed utility methods will be collected in a class located in the "src/test/java" part of the code repository.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MATH-637) Simple utility for micro-benchmarking
Posted by "Phil Steitz (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MATH-637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Phil Steitz updated MATH-637:
-----------------------------
Attachment: PerfUtils.patch
One thing to think about is whether we really want / need to store all of the timing results in an array. The times array could get quite large if the number of iterations is very large.
The attached patch prepares for eventual move to just streaming the execution times by changing the statistical aggregator from DescriptiveStatistics to SummaryStatistics. The latter does not store velues in memory. The patch also replaces the array of DescriptiveStatistics describing method results with an array of StatisticalSummary instances. The latter are immutable value objects that just maintain values of statistics. These changes should probably be made even if we decide to hold the full time array in storage, since the current impl is needlessly storing the raw data again inside the DescriptiveStatistics instances and all you really need to store is the result of the statistical analysis.
> Simple utility for micro-benchmarking
> -------------------------------------
>
> Key: MATH-637
> URL: https://issues.apache.org/jira/browse/MATH-637
> Project: Commons Math
> Issue Type: Wish
> Reporter: Gilles
> Assignee: Gilles
> Priority: Minor
> Labels: test
> Fix For: 3.0
>
> Attachments: PerfUtils.patch
>
>
> As per the discussion on the "dev" ML (with subject: "Simple benchmarking utility"), it would be useful to have an easy way to benchmark alternative implementations of some functionality.
> The proposed utility methods will be collected in a class located in the "src/test/java" part of the code repository.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MATH-637) Simple utility for micro-benchmarking
Posted by "Gilles (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MATH-637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13073257#comment-13073257 ]
Gilles commented on MATH-637:
-----------------------------
Revision 1152524 contains significant changes that aim to thwart some of the criticisms discussed [here|http://blog.juma.me.uk/2011/02/23/performance-of-fastmath-from-commons-math/].
Please review.
> Simple utility for micro-benchmarking
> -------------------------------------
>
> Key: MATH-637
> URL: https://issues.apache.org/jira/browse/MATH-637
> Project: Commons Math
> Issue Type: Wish
> Reporter: Gilles
> Assignee: Gilles
> Priority: Minor
> Labels: test
> Fix For: 3.0
>
>
> As per the discussion on the "dev" ML (with subject: "Simple benchmarking utility"), it would be useful to have an easy way to benchmark alternative implementations of some functionality.
> The proposed utility methods will be collected in a class located in the "src/test/java" part of the code repository.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira