You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Diana Clarke (Jira)" <ji...@apache.org> on 2021/02/09 21:56:00 UTC

[jira] [Created] (ARROW-11575) [Developer] [Archery] Expose execution time in benchmark results

Diana Clarke created ARROW-11575:
------------------------------------

             Summary: [Developer] [Archery] Expose execution time in benchmark results
                 Key: ARROW-11575
                 URL: https://issues.apache.org/jira/browse/ARROW-11575
             Project: Apache Arrow
          Issue Type: Improvement
          Components: Archery, Developer Tools
            Reporter: Diana Clarke
            Assignee: Diana Clarke


Google Benchmark reports both cpu time & real time in each benchmark observation. For example:

{code}
{'cpu_time': 9718937.499999996,
  'items_per_second': 26972495.707478322,
  'iterations': 64,
  'name': 'TakeStringRandomIndicesWithNulls/262144/0',
  'null_percent': 0.0,
  'real_time': 10297947.859726265,
  'repetition_index': 2,
  'repetitions': 0,
  'run_name': 'TakeStringRandomIndicesWithNulls/262144/0',
  'run_type': 'iteration',
  'size': 262144.0,
  'threads': 1,
  'time_unit': 'ns'},
{code}

Currently, Archery doesn't expose the execution time in its json results though. For example:

{code}
                {
                    "name": "TakeStringRandomIndicesWithNulls/262144/2",
                    "unit": "items_per_second",
                    "less_is_better": false,
                    "values": [
                        20900887.666890558,
                        21737551.30809738,
                        21872425.314689018
                    ]
                }
{code}

This pull request updates Archery to expose the real time as well. For example:

{code}
                {
                    "name": "TakeStringRandomIndicesWithNulls/262144/2",
                    "unit": "items_per_second",
                    "less_is_better": false,
                    "values": [
                        20900887.666890558,
                        21737551.30809738,
                        21872425.314689018
                    ],
                    "time_unit": "ns",
                    "times": [
                        34939132.454438195,
                        44459594.18080747,
                        46606865.63566384
                    ]
                }
{code}





--
This message was sent by Atlassian Jira
(v8.3.4#803005)