[jira] [Updated] (AMBARI-19138) Option for getting heap dump for Hive and Tez services.

["Swapan Shridhar (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/AMBARI-19138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Swapan Shridhar updated AMBARI-19138:
-------------------------------------
    Resolution: Fixed
        Status: Resolved  (was: Patch Available)

> Option for getting heap dump for Hive and Tez services.
> -------------------------------------------------------
>
>                 Key: AMBARI-19138
>                 URL: https://issues.apache.org/jira/browse/AMBARI-19138
>             Project: Ambari
>          Issue Type: Bug
>          Components: ambari-server
>    Affects Versions: 2.4.1
>            Reporter: Swapan Shridhar
>            Assignee: Swapan Shridhar
>             Fix For: 2.5.0
>
>         Attachments: AMBARI-19138.patch
>
>
> We need to add the heap dump option for:
> - All Hive services (Hive1/HiveServer2, Hive2/HiveServer2 and Metastore): 
> {code}
> -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=<'/tmp/' by default or 'Configurable location provided'>
> {code}
> option appended to "Advance hive-env" -> hive-env-template -> HADOOP_CLIENT_OPTS environment variable
> - HSI YARN jobs:
> {code}
> -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=<'/tmp/' by default or 'Configurable location provided'>
> {code}
> option added to "Advanced hive-interactive-env" -> Llap app java opts. Logs will be generated at: /<'Configurable location provided'>/java_<pid-of-llap-daemon>.hprof on the nodes that failed with OOM.
> - Tez component:
> {code}
> -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=<'/tmp/' by default or 'Configurable location provided'>
> {code}
> option added to tez.am.launch.cmd-opts for AM OOM and tez.task.launch.cmd-opts for task OOM.
> *>>>>* 'Configurable location provided' should be one config where user can change the location and consumable by all others.
> Further, whether to keep the heap dump option ENABLED or DISABLED should be configurable via Ambari. [~carter] to confirm for this. By default, option should be DISABLED. 
> *>>>>* ENABLING/DISABLING of option will require the above components RESATARt for change to take effect.
> *>>>>* permissions for dump file can be 600 for <hive user>:<hive group>.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)