You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by Igor Kryvenko <kr...@gmail.com> on 2018/03/20 20:24:37 UTC

Review Request 66180: HIVE-18990: Hive doesn't close Tez session properly

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/66180/
-----------------------------------------------------------

Review request for hive.


Bugs: HIVE-18990
    https://issues.apache.org/jira/browse/HIVE-18990


Repository: hive-git


Description
-------

Hive doesn't close Tez session properly if AM isn't ready for accepting DAG.

STR
This can be easily reproduced using the following steps:
1) configure cluster on Tez;

2) create file test.hql
cat ~/test.hql
show databases;

3) run the job
$ hive --hiveconf hive.root.logger=DEBUG,console --hiveconf hive.execution.engine=tez -f ~/test.hql

If we login into Yarn UI, we will see that jobs status is failed even it finished successfully.

It happens because hive creates tez session by default. And if query finished very quickly, we can't close tez session properly because AM isn't ready for accepting any requests.


Diffs
-----

  ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezSessionState.java 046ea19c7227c16ec9c71cf470652385347cc78b 


Diff: https://reviews.apache.org/r/66180/diff/1/


Testing
-------


Thanks,

Igor Kryvenko