You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2021/02/09 21:59:00 UTC
[jira] [Updated] (ARROW-11575) [Developer] [Archery] Expose
execution time in benchmark results
[ https://issues.apache.org/jira/browse/ARROW-11575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
ASF GitHub Bot updated ARROW-11575:
-----------------------------------
Labels: pull-request-available (was: )
> [Developer] [Archery] Expose execution time in benchmark results
> ----------------------------------------------------------------
>
> Key: ARROW-11575
> URL: https://issues.apache.org/jira/browse/ARROW-11575
> Project: Apache Arrow
> Issue Type: Improvement
> Components: Archery, Developer Tools
> Reporter: Diana Clarke
> Assignee: Diana Clarke
> Priority: Minor
> Labels: pull-request-available
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Google Benchmark reports both cpu time & real time in each benchmark observation. For example:
> {code}
> {'cpu_time': 9718937.499999996,
> 'items_per_second': 26972495.707478322,
> 'iterations': 64,
> 'name': 'TakeStringRandomIndicesWithNulls/262144/0',
> 'null_percent': 0.0,
> 'real_time': 10297947.859726265,
> 'repetition_index': 2,
> 'repetitions': 0,
> 'run_name': 'TakeStringRandomIndicesWithNulls/262144/0',
> 'run_type': 'iteration',
> 'size': 262144.0,
> 'threads': 1,
> 'time_unit': 'ns'},
> {code}
> Currently, Archery doesn't expose the execution time in its json results though. For example:
> {code}
> {
> "name": "TakeStringRandomIndicesWithNulls/262144/2",
> "unit": "items_per_second",
> "less_is_better": false,
> "values": [
> 20900887.666890558,
> 21737551.30809738,
> 21872425.314689018
> ]
> }
> {code}
> This pull request updates Archery to expose the real time as well. For example:
> {code}
> {
> "name": "TakeStringRandomIndicesWithNulls/262144/2",
> "unit": "items_per_second",
> "less_is_better": false,
> "values": [
> 20900887.666890558,
> 21737551.30809738,
> 21872425.314689018
> ],
> "time_unit": "ns",
> "times": [
> 34939132.454438195,
> 44459594.18080747,
> 46606865.63566384
> ]
> }
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)