[jira] [Created] (DRILL-3205) Test framework should report actual values in case of failures

["Hanifi Gunes (JIRA)" <ji...@apache.org>]

Hanifi Gunes created DRILL-3205:
-----------------------------------

             Summary: Test framework should report actual values in case of failures
                 Key: DRILL-3205
                 URL: https://issues.apache.org/jira/browse/DRILL-3205
             Project: Apache Drill
          Issue Type: Bug
          Components: Tools, Build & Test
    Affects Versions: 1.0.0
            Reporter: Hanifi Gunes
            Assignee: Steven Phillips


Test framework seems to report expected results alone. This makes it particularly hard to investigate and reason about the problem. Even in case where test result matcher is un-ordered we can report actual results if returned number of rows & columns is manageable (say r x c ≤ 100)

{code:title=Sample test failure that reports expected result but not the actual value}
Tests run: 43, Failures: 0, Errors: 1, Skipped: 3, Time elapsed: 30.168 sec <<< FAILURE! - in org.apache.drill.TestFunctionsQuery
testToCharFunction(org.apache.drill.TestFunctionsQuery)  Time elapsed: 0.112 sec  <<< ERROR!
java.lang.Exception: Did not find expected record in result set: `DEC28_1` : 12,345,678,912,345,678,912.5567, `DEC38_1` : 999999999999999999999999999.5, `DEC9_1` : 1,234.56, `DEC18_1` : 99999912399.9567, `FLOAT8_1` : 1,234.56, `FLOAT8_2` : $1,234.50, 

	at org.apache.drill.DrillTestWrapper.compareResults(DrillTestWrapper.java:541)
	at org.apache.drill.DrillTestWrapper.compareUnorderedResults(DrillTestWrapper.java:295)
	at org.apache.drill.DrillTestWrapper.run(DrillTestWrapper.java:119)
	at org.apache.drill.TestBuilder.go(TestBuilder.java:125)
	at org.apache.drill.TestFunctionsQuery.testToCharFunction(TestFunctionsQuery.java:517)
{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)