You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "zhaojk (Jira)" <ji...@apache.org> on 2021/01/18 07:15:00 UTC
[jira] [Updated] (HIVE-24650) hiveserver2 memory usage is extremely
high, GC unable to recycle
[ https://issues.apache.org/jira/browse/HIVE-24650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
zhaojk updated HIVE-24650:
--------------------------
Description:
HDP's HiveServer2 is using 80GB of memory (HEAP is configured with 74GB), and when the memory is full, there will be frequent Full GC, and then the memory cannot be recycled, resulting in a service exception.Analyze memory usage.
GC config:
export HADOOP_OPTS="$HADOOP_OPTS -Xloggc:\{{hive_log_dir}}/hiveserver2-gc-%t.log -XX:ConcGCThreads=30 -XX:ParallelGCThreads=30 -XX:+UseG1GC -XX:G1HeapRegionSize=8M -XX:+UseStringDeduplication -XX:MaxGCPauseMillis=1000 -XX:InitiatingHeapOccupancyPercent=40 -XX:G1ReservePercent=15 -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintGCCause -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=10 -XX:GCLogFileSize=100M -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/home/hive/hs2_heapdump.hprof -Dhive.log.dir=\{{hive_log_dir}} -Dhive.log.file=hiveserver2.log
The details at
[https://blog.csdn.net/Small_codeing/article/details/112601226]
was:
HDP's HiveServer2 is using 80GB of memory (HEAP is configured with 74GB), and when the memory is full, there will be frequent Full GC, and then the memory cannot be recycled, resulting in a service exception.Analyze memory usage.The details at
https://blog.csdn.net/Small_codeing/article/details/112601226
> hiveserver2 memory usage is extremely high, GC unable to recycle
> ----------------------------------------------------------------
>
> Key: HIVE-24650
> URL: https://issues.apache.org/jira/browse/HIVE-24650
> Project: Hive
> Issue Type: Bug
> Components: HiveServer2
> Affects Versions: 3.1.0
> Environment: hive3.1.0
> Reporter: zhaojk
> Priority: Major
> Attachments: 1.png, 2.png, 3.png
>
>
> HDP's HiveServer2 is using 80GB of memory (HEAP is configured with 74GB), and when the memory is full, there will be frequent Full GC, and then the memory cannot be recycled, resulting in a service exception.Analyze memory usage.
> GC config:
> export HADOOP_OPTS="$HADOOP_OPTS -Xloggc:\{{hive_log_dir}}/hiveserver2-gc-%t.log -XX:ConcGCThreads=30 -XX:ParallelGCThreads=30 -XX:+UseG1GC -XX:G1HeapRegionSize=8M -XX:+UseStringDeduplication -XX:MaxGCPauseMillis=1000 -XX:InitiatingHeapOccupancyPercent=40 -XX:G1ReservePercent=15 -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintGCCause -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=10 -XX:GCLogFileSize=100M -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/home/hive/hs2_heapdump.hprof -Dhive.log.dir=\{{hive_log_dir}} -Dhive.log.file=hiveserver2.log
> The details at
> [https://blog.csdn.net/Small_codeing/article/details/112601226]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)