[jira] [Created] (IMPALA-6007) Add a mechanism to the stress test driver to respect Pytest marker tags on tests

["Tim Wood (JIRA)" <ji...@apache.org>]

Tim Wood created IMPALA-6007:
--------------------------------

             Summary: Add a mechanism to the stress test driver to respect Pytest marker tags on tests
                 Key: IMPALA-6007
                 URL: https://issues.apache.org/jira/browse/IMPALA-6007
             Project: IMPALA
          Issue Type: Improvement
          Components: Infrastructure
    Affects Versions: Impala 2.10.0
            Reporter: Tim Wood
            Assignee: Tim Wood


Test suites run under Pytest, specifically the complete TPC-DS suite, may contain test cases marked with Pytest decorators like pytest.mark.skip and pytest.mark.xfail, because the cases contain unsupported SQL features, or are known to fail due to bugs.  Pytest accordingly avoids executing and/or checking such cases.  The stress test is a non-Pytest custom framework, but since it consumes tests also written for execution in Pytest, it should respect the Pytest decorators that configure out execution of those cases.

After some discussion, a logical design would make the stress test inspect a given Pytest-compliant test driver module for test methods marked as above, and avoid executing them.  The benefit of this approach is it retains the original Pytest driver module as the single source of truth as to the status of each test case, rather than creating and maintaining a separate file or files with this metadata that the driver module already expresses.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)