[jira] [Created] (IGNITE-13070) SQL regressions detection framework

["Roman Kondakov (Jira)" <ji...@apache.org>]

Roman Kondakov created IGNITE-13070:
---------------------------------------

             Summary: SQL regressions detection framework
                 Key: IGNITE-13070
                 URL: https://issues.apache.org/jira/browse/IGNITE-13070
             Project: Ignite
          Issue Type: Test
          Components: sql
            Reporter: Roman Kondakov


We need to detect SQL regressions early. We can do it by comparing the SQL query performance for different Ignite versions. This test framework should work in the following way:
 # It starts two Ignite clusters with different versions (current version and the previous release version).
 # Framework then runs randomly generated queries in both clusters and checks the execution time for each cluster. We need to port SQLSmith library from C++ to java for this step. But initially we can start with some set of hardcoded queries and postpone the SQLSmith port. Randomized queries can be added later.
 # All problematic queries are then reported as performance issues. In this way we can manually examine the problems.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)