You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "László Bodor (Jira)" <ji...@apache.org> on 2020/07/27 12:13:00 UTC

[jira] [Updated] (HIVE-23938) LLAP: JDK11 - some GC log file rotation related jvm arguments cannot be used anymore

     [ https://issues.apache.org/jira/browse/HIVE-23938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

László Bodor updated HIVE-23938:
--------------------------------
    Description: 
https://github.com/apache/hive/blob/master/llap-server/bin/runLlapDaemon.sh#L55
{code}
JAVA_OPTS_BASE="-server -Djava.net.preferIPv4Stack=true -XX:+UseNUMA -XX:+PrintGCDetails -verbose:gc -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=4 -XX:GCLogFileSize=100M -XX:+PrintGCDateStamps"
{code}

on JDK11 I got something like:
{code}
+ exec /usr/lib/jvm/jre-11-openjdk/bin/java -Dproc_llapdaemon -Xms32000m -Xmx64000m -Dhttp.maxConnections=17 -XX:+UseG1GC -XX:+ResizeTLAB -XX:+UseNUMA -XX:+AggressiveOpts -XX:MetaspaceSize=1024m -XX:InitiatingHeapOccupancyPercent=80 -XX:MaxGCPauseMillis=200 -XX:+PreserveFramePointer -XX:AllocatePrefetchStyle=2 -Dhttp.maxConnections=10 -Dasync.profiler.home=/grid/0/async-profiler -server -Djava.net.preferIPv4Stack=true -XX:+UseNUMA -XX:+PrintGCDetails -verbose:gc -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=4 -XX:GCLogFileSize=100M -XX:+PrintGCDateStamps -Xloggc:/grid/2/yarn/container-logs/application_1595375468459_0113/container_e26_1595375468459_0113_01_000009/gc_2020-07-27-12.log -Djava.io.tmpdir=/grid/ssd/yarn/nm/usercache/lbodor/appcache/application_1595375468459_0113/container_e26_1595375468459_0113_01_000009/tmp/ -Dlog4j.configurationFile= -Dllap.daemon.log.dir=/grid/2/yarn/container-logs/application_1595375468459_0113/container_e26_1595375468459_0113_01_000009 -Dllap.daemon.log.file=llap-daemon-lbodor-ctr-e141-1563959304486-69251-01-000011.hwx.site.log -Dllap.daemon.root.logger=query-routing -Dllap.daemon.log.level=INFO -classpath '/grid/ssd/yarn/nm/usercache/lbodor/appcache/application_1595375468459_0113/container_e26_1595375468459_0113_01_000009/lib/conf/:/grid/ssd/yarn/nm/usercache/lbodor/appcache/application_1595375468459_0113/container_e26_1595375468459_0113_01_000009/lib//lib/*:/grid/ssd/yarn/nm/usercache/lbodor/appcache/application_1595375468459_0113/container_e26_1595375468459_0113_01_000009/lib//lib/tez/*:/grid/ssd/yarn/nm/usercache/lbodor/appcache/application_1595375468459_0113/container_e26_1595375468459_0113_01_000009/lib//lib/udfs/*:.:' org.apache.hadoop.hive.llap.daemon.impl.LlapDaemon
OpenJDK 64-Bit Server VM warning: Option AggressiveOpts was deprecated in version 11.0 and will likely be removed in a future release.
Unrecognized VM option 'UseGCLogFileRotation'
Error: Could not create the Java Virtual Machine.
Error: A fatal exception has occurred. Program will exit.
{code}

> LLAP: JDK11 - some GC log file rotation related jvm arguments cannot be used anymore
> ------------------------------------------------------------------------------------
>
>                 Key: HIVE-23938
>                 URL: https://issues.apache.org/jira/browse/HIVE-23938
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: László Bodor
>            Assignee: László Bodor
>            Priority: Major
>
> https://github.com/apache/hive/blob/master/llap-server/bin/runLlapDaemon.sh#L55
> {code}
> JAVA_OPTS_BASE="-server -Djava.net.preferIPv4Stack=true -XX:+UseNUMA -XX:+PrintGCDetails -verbose:gc -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=4 -XX:GCLogFileSize=100M -XX:+PrintGCDateStamps"
> {code}
> on JDK11 I got something like:
> {code}
> + exec /usr/lib/jvm/jre-11-openjdk/bin/java -Dproc_llapdaemon -Xms32000m -Xmx64000m -Dhttp.maxConnections=17 -XX:+UseG1GC -XX:+ResizeTLAB -XX:+UseNUMA -XX:+AggressiveOpts -XX:MetaspaceSize=1024m -XX:InitiatingHeapOccupancyPercent=80 -XX:MaxGCPauseMillis=200 -XX:+PreserveFramePointer -XX:AllocatePrefetchStyle=2 -Dhttp.maxConnections=10 -Dasync.profiler.home=/grid/0/async-profiler -server -Djava.net.preferIPv4Stack=true -XX:+UseNUMA -XX:+PrintGCDetails -verbose:gc -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=4 -XX:GCLogFileSize=100M -XX:+PrintGCDateStamps -Xloggc:/grid/2/yarn/container-logs/application_1595375468459_0113/container_e26_1595375468459_0113_01_000009/gc_2020-07-27-12.log -Djava.io.tmpdir=/grid/ssd/yarn/nm/usercache/lbodor/appcache/application_1595375468459_0113/container_e26_1595375468459_0113_01_000009/tmp/ -Dlog4j.configurationFile= -Dllap.daemon.log.dir=/grid/2/yarn/container-logs/application_1595375468459_0113/container_e26_1595375468459_0113_01_000009 -Dllap.daemon.log.file=llap-daemon-lbodor-ctr-e141-1563959304486-69251-01-000011.hwx.site.log -Dllap.daemon.root.logger=query-routing -Dllap.daemon.log.level=INFO -classpath '/grid/ssd/yarn/nm/usercache/lbodor/appcache/application_1595375468459_0113/container_e26_1595375468459_0113_01_000009/lib/conf/:/grid/ssd/yarn/nm/usercache/lbodor/appcache/application_1595375468459_0113/container_e26_1595375468459_0113_01_000009/lib//lib/*:/grid/ssd/yarn/nm/usercache/lbodor/appcache/application_1595375468459_0113/container_e26_1595375468459_0113_01_000009/lib//lib/tez/*:/grid/ssd/yarn/nm/usercache/lbodor/appcache/application_1595375468459_0113/container_e26_1595375468459_0113_01_000009/lib//lib/udfs/*:.:' org.apache.hadoop.hive.llap.daemon.impl.LlapDaemon
> OpenJDK 64-Bit Server VM warning: Option AggressiveOpts was deprecated in version 11.0 and will likely be removed in a future release.
> Unrecognized VM option 'UseGCLogFileRotation'
> Error: Could not create the Java Virtual Machine.
> Error: A fatal exception has occurred. Program will exit.
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)