[jira] [Commented] (HIVE-11994) SHOW COMPACTIONS should include history and meta info

["Eugene Koifman (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HIVE-11994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15118324#comment-15118324 ] 

Eugene Koifman commented on HIVE-11994:
---------------------------------------

HIVE-12353 has added history tracking but not the display of it in SHOW COMPACTIONS

> SHOW COMPACTIONS should include history and meta info
> -----------------------------------------------------
>
>                 Key: HIVE-11994
>                 URL: https://issues.apache.org/jira/browse/HIVE-11994
>             Project: Hive
>          Issue Type: Improvement
>          Components: Metastore, Transactions
>    Affects Versions: 1.0.0
>            Reporter: Eugene Koifman
>            Assignee: Eugene Koifman
>
> Currently output of SHOW COMPACTIONS only has current information.
> it would very useful if it could retain the data for a configurable period of time after the Cleaner handles the entry.  Perhaps the entry can go into 'h' state for 'historical'.
> Such historical data can be used to drive alert generating logic.
> We can add a column with a JSON doc which can include various stats about the job: number of delta files, size in MB, time taken.  Also can be useful to collect job properties from Hadoop, such as RAM used for example.  
> All of this can enhance the type/quality of alerts.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)