You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Lefty Leverenz (JIRA)" <ji...@apache.org> on 2014/07/21 07:28:40 UTC

[jira] [Updated] (HIVE-6578) Use ORC file footer statistics through StatsProvidingRecordReader interface for analyze command

     [ https://issues.apache.org/jira/browse/HIVE-6578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Lefty Leverenz updated HIVE-6578:
---------------------------------

    Labels: TODOC13 orcfile  (was: orcfile)

> Use ORC file footer statistics through StatsProvidingRecordReader interface for analyze command
> -----------------------------------------------------------------------------------------------
>
>                 Key: HIVE-6578
>                 URL: https://issues.apache.org/jira/browse/HIVE-6578
>             Project: Hive
>          Issue Type: New Feature
>    Affects Versions: 0.13.0
>            Reporter: Prasanth J
>            Assignee: Prasanth J
>              Labels: TODOC13, orcfile
>             Fix For: 0.13.0
>
>         Attachments: HIVE-6578.1.patch, HIVE-6578.2.patch, HIVE-6578.3.patch, HIVE-6578.4.patch, HIVE-6578.4.patch.txt
>
>
> ORC provides file level statistics which can be used in analyze partialscan and noscan cases to compute basic statistics like number of rows, number of files, total file size and raw data size. On the writer side, a new interface was added earlier (StatsProvidingRecordWriter) that exposed stats when writing a table. Similarly, a new interface StatsProvidingRecordReader can be added which when implemented should provide stats that are gathered by the underlying file format.



--
This message was sent by Atlassian JIRA
(v6.2#6252)