You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Weston Pace (Jira)" <ji...@apache.org> on 2022/03/09 01:48:00 UTC

[jira] [Created] (ARROW-15877) [C++] Add a C++ query testing tool

Weston Pace created ARROW-15877:
-----------------------------------

             Summary: [C++] Add a C++ query testing tool
                 Key: ARROW-15877
                 URL: https://issues.apache.org/jira/browse/ARROW-15877
             Project: Apache Arrow
          Issue Type: New Feature
          Components: C++
            Reporter: Weston Pace


We have a number of tools for running queries today that we can use when benchmarking and profiling.

* We can create tests in google test but then it is often difficult to pass in extra arguments like switching between queries and dynamically changing the number of iterations.
* We can simply create a quick executable but there is some project creation overhead and queries end up being hard-coded to something rather specific.
* We can use arrowbench but that adds an R dependency which is a burden for C++ testers that don't work with R much and it also adds some R overhead or complications for debugging.

This JIRA proposes we create a new query testing tool, inspired by arrowbench, but written in C++, which will initially allow us to run builtin TPC-H queries against the TPC-H data generator but will eventually allow for downloading datasets from remote sources, running custom queries via SQL or Substrait, etc.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)