[jira] [Commented] (AMBARI-11870) HDP-2.3 'hive.tez.java.opts' should not contain Xmx and add additional JDK1.8 params

["Hadoop QA (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/AMBARI-11870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14582752#comment-14582752 ] 

Hadoop QA commented on AMBARI-11870:
------------------------------------

{color:green}+1 overall{color}.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12739140/AMBARI-11870.patch
  against trunk revision .

    {color:green}+1 @author{color}.  The patch does not contain any @author tags.

    {color:green}+1 tests included{color}.  The patch appears to include 1 new or modified test files.

    {color:green}+1 javac{color}.  The applied patch does not increase the total number of javac compiler warnings.

    {color:green}+1 release audit{color}.  The applied patch does not increase the total number of release audit warnings.

    {color:green}+1 core tests{color}.  The patch passed unit tests in ambari-server.

Test results: https://builds.apache.org/job/Ambari-trunk-test-patch/3145//testReport/
Console output: https://builds.apache.org/job/Ambari-trunk-test-patch/3145//console

This message is automatically generated.

> HDP-2.3 'hive.tez.java.opts' should not contain Xmx and add additional JDK1.8 params
> ------------------------------------------------------------------------------------
>
>                 Key: AMBARI-11870
>                 URL: https://issues.apache.org/jira/browse/AMBARI-11870
>             Project: Ambari
>          Issue Type: Bug
>          Components: contrib
>    Affects Versions: 2.1.0
>            Reporter: Srimanth Gunturi
>            Assignee: Srimanth Gunturi
>             Fix For: 2.1.0
>
>         Attachments: AMBARI-11870.patch
>
>
> {{hive.tez.java.opts}} for HDP-2.3 should not contain the Xmx JVM parameter. The reason for this is:
> {noformat}
> Tez does it based on the allocated container (i.e if you use a 1.5Gig container.size and YARN returns a 4Gig one, Tez should use a 0.8*4096).
> https://github.com/apache/tez/blob/master/tez-api/src/main/java/org/apache/tez/client/TezClientUtils.java#L920
> This would work much better if you removed the whole Xmx parameter from the config in hive-site.xml.
> {noformat}
> Also, for JDK8 the preferred GC isn't {{-XX:+UseParallelGC}} it is {{-XX:+UseG1GC -XX:+ResizeTLAB}} while retaining all the other java parameters. In some JDK7 versions, the G1GC occasionally segfaults, so the choice of those two are based on whether the install is on JDK8 or not.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)