[jira] [Created] (HIVE-26760) HiveServer2 hanging due to JVM Pauses or going down due to OOM

["Gopinath (Jira)" <ji...@apache.org>]

Gopinath created HIVE-26760:
-------------------------------

             Summary: HiveServer2 hanging due to JVM Pauses  or going down due to OOM
                 Key: HIVE-26760
                 URL: https://issues.apache.org/jira/browse/HIVE-26760
             Project: Hive
          Issue Type: Bug
          Components: HiveServer2
            Reporter: Gopinath


The problem was HiveServer2 hanging or going down frequently due to OOM or JVM pauses.

The issue was with a specific query on an External table. Hive did not load the data and no statistics were generated for the same. Hence when running the query (select * from ) on top of the table, HS2 requested a direct fetch, As the amount of data present at the location was huge and Hive was trying to load all the data in the memory directly because of the direct fetch, HiveServer2 was running out of memory and thus, leading to JVM Pauses/OOM.

To fix the issue as a workaround, after identifying the corresponding query, try setting the below property or collecting stats for the table involved.

*SET hive.fetch.task.conversion=none;*


*Action Needed* 
Avoid service level impact by considering a directory size or file size before triggering a direct fetch if stats are empty or partial. 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)