[jira] [Created] (IMPALA-5979) Impala test driver exits nonzero after executing an xfail test case

["Tim Wood (JIRA)" <ji...@apache.org>]

Tim Wood created IMPALA-5979:
--------------------------------

             Summary: Impala test driver exits nonzero after executing an xfail test case
                 Key: IMPALA-5979
                 URL: https://issues.apache.org/jira/browse/IMPALA-5979
             Project: IMPALA
          Issue Type: Bug
          Components: Infrastructure
    Affects Versions: Impala 2.10.0
            Reporter: Tim Wood


I've determined that $IMPALA_HOME/tests/run-tests.py exits non-zero when an expected-fail test is executed.  This seems like wrong behavior from the framework.  Instead, it should exit nonzero unless every test case behaves as expected.  So when bugs behind an xfail case are fixed, that case will xpass, and fail the suite run.  That's a reminder to fix the expectation for that case in the suite.

Reproduce (after Gerrit review #8102 committed):
% $IMPALA_HOME/tests/run-tests.py query_test/test_tpcds_queries.py -k test_tpcds_q90
... output ...
% echo $?
1




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)