[jira] Updated: (HIVE-1464) improve test query performance

["Joydeep Sen Sarma (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HIVE-1464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Joydeep Sen Sarma updated HIVE-1464:
------------------------------------

    Attachment: 1464.1.patch

- skips loading source tables again and again for each test. 
- clears state before a test by removing all tables other than the source tables and reinitializing hiveconf
- some test results have changed because the previous results were incorrect. they depended on the presence of tables from prior tests. once those tables are cleared out - the test results change
- added a pre-execute hook for test runs to make sure that none of the source tables are cleaned out.

Result: TestNegativeCliDriver is taking about:
- 7 min in current trunk
- 1.5 min with this patch

this includes compilation etc. as well i presume - so the actual speedup is higher.

TestCliDriver is too long to do a comparative run.

> improve test query performance
> ------------------------------
>
>                 Key: HIVE-1464
>                 URL: https://issues.apache.org/jira/browse/HIVE-1464
>             Project: Hadoop Hive
>          Issue Type: Test
>          Components: Testing Infrastructure
>            Reporter: Joydeep Sen Sarma
>         Attachments: 1464.1.patch
>
>
> clientpositive/negative tests are extremely slow.
> one major problem seems to be that all the test warehouse tables are deleted and created/re-populated for each test. most of the times this is not required and if we can fix this the tests will run much faster.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.