You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Zoltan Haindrich (JIRA)" <ji...@apache.org> on 2018/01/05 08:59:00 UTC

[jira] [Created] (HIVE-18383) Qtests: running all cases from TestNegativeCliDriver results in OOMs

Zoltan Haindrich created HIVE-18383:
---------------------------------------

             Summary: Qtests: running all cases from TestNegativeCliDriver results in OOMs
                 Key: HIVE-18383
                 URL: https://issues.apache.org/jira/browse/HIVE-18383
             Project: Hive
          Issue Type: Bug
          Components: Tests
            Reporter: Zoltan Haindrich
            Assignee: Zoltan Haindrich


I think that it is caused by unclosed SessionState objects which are piling up and cause OOM..

There is special have been made to start a new sessionstate for every qtest; but the old one is not closed up to this [point|https://github.com/apache/hive/blob/20c9a3905f4b1b627c935ad54a53a7a59015587c/itests/util/src/main/java/org/apache/hadoop/hive/ql/QTestUtil.java#L1202]

this prevents running all {{TestNegativeCliDriver}} tests in one maven call....I keep getting OOMs

This issues sometimes appears on the ptest executor as well and its reported as a failed batch.


I've gone back in time a bit....seems like at c925cf8d2bdf646f5c3c57ed7252c01b2ab33eec it was ok to execute the whole batch; but at 1b4baf474c15377cc9f0bacdda317feabeefacaf and probably also at a42314deb07a1c8d9d4daeaa799ad1c1ebb0c6c9 its not possible anymore. I suspect that there is possibly another issue....or these are just the consequences that the sessionstate got heavier by a few hundred bytes; and made it easier to fill up the heap....



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)