You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Ben Kietzman (Jira)" <ji...@apache.org> on 2021/02/24 20:28:00 UTC
[jira] [Resolved] (ARROW-11575) [Developer][Archery] Expose
execution time in benchmark results
[ https://issues.apache.org/jira/browse/ARROW-11575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ben Kietzman resolved ARROW-11575.
----------------------------------
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 9458
[https://github.com/apache/arrow/pull/9458]
> [Developer][Archery] Expose execution time in benchmark results
> ---------------------------------------------------------------
>
> Key: ARROW-11575
> URL: https://issues.apache.org/jira/browse/ARROW-11575
> Project: Apache Arrow
> Issue Type: Improvement
> Components: Archery, Developer Tools
> Reporter: Diana Clarke
> Assignee: Diana Clarke
> Priority: Minor
> Labels: pull-request-available
> Fix For: 4.0.0
>
> Time Spent: 2h 20m
> Remaining Estimate: 0h
>
> Google Benchmark reports both cpu time & real time in each benchmark observation. For example:
> {code}
> {'cpu_time': 9718937.499999996,
> 'items_per_second': 26972495.707478322,
> 'iterations': 64,
> 'name': 'TakeStringRandomIndicesWithNulls/262144/0',
> 'null_percent': 0.0,
> 'real_time': 10297947.859726265,
> 'repetition_index': 2,
> 'repetitions': 0,
> 'run_name': 'TakeStringRandomIndicesWithNulls/262144/0',
> 'run_type': 'iteration',
> 'size': 262144.0,
> 'threads': 1,
> 'time_unit': 'ns'},
> {code}
> Currently, Archery doesn't expose the execution time in its json results though. For example:
> {code}
> {
> "name": "TakeStringRandomIndicesWithNulls/262144/2",
> "unit": "items_per_second",
> "less_is_better": false,
> "values": [
> 20900887.666890558,
> 21737551.30809738,
> 21872425.314689018
> ]
> }
> {code}
> This pull request updates Archery to expose the real time as well. For example:
> {code}
> {
> "name": "TakeStringRandomIndicesWithNulls/262144/2",
> "unit": "items_per_second",
> "less_is_better": false,
> "values": [
> 20900887.666890558,
> 21737551.30809738,
> 21872425.314689018
> ],
> "time_unit": "ns",
> "times": [
> 34939132.454438195,
> 44459594.18080747,
> 46606865.63566384
> ]
> }
> {code}
> Motivation: I am persisting these results and would also like to store the execution time to debug slow benchmarks.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)