You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@hive.apache.org by "Sergey Shelukhin (JIRA)" <ji...@apache.org> on 2018/03/20 21:55:00 UTC

[jira] [Created] (HIVE-19002) add LLAP debug history dump

Sergey Shelukhin created HIVE-19002:
---------------------------------------

             Summary: add LLAP debug history dump
                 Key: HIVE-19002
                 URL: https://issues.apache.org/jira/browse/HIVE-19002
             Project: Hive
          Issue Type: Bug
            Reporter: Sergey Shelukhin


LLAP is well positioned to provide basic debugging overview of the tasks for the entire cluster (not just per query).
We can store a few longs per task (app/dag/vertex/task/attempt together, start time, queue time, run time, success flag, key counters like cache hit rate, IO FS time, bytes read perhaps) to minimize memory usage, so we can store history for a very long time and provide the ability to dump this via JMX in human readable form, and aggregate via HS2 UI for now. 
This will be useful for analysis of large scale cluster issues.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)