You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Jesus Camacho Rodriguez (JIRA)" <ji...@apache.org> on 2017/08/12 02:18:00 UTC
[jira] [Comment Edited] (HIVE-17265) Cache merged column stats from
retrieved partitions
[ https://issues.apache.org/jira/browse/HIVE-17265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16124404#comment-16124404 ]
Jesus Camacho Rodriguez edited comment on HIVE-17265 at 8/12/17 2:17 AM:
-------------------------------------------------------------------------
[~ashutoshc], sure, I have created it in : https://reviews.apache.org/r/61604/
Thanks
was (Author: jcamachorodriguez):
Sure, I have created it in : https://reviews.apache.org/r/61604/
Thanks
> Cache merged column stats from retrieved partitions
> ---------------------------------------------------
>
> Key: HIVE-17265
> URL: https://issues.apache.org/jira/browse/HIVE-17265
> Project: Hive
> Issue Type: Bug
> Components: Statistics
> Affects Versions: 3.0.0
> Reporter: Jesus Camacho Rodriguez
> Assignee: Jesus Camacho Rodriguez
> Attachments: HIVE-17265.02.patch, HIVE-17265.patch
>
>
> Currently when we retrieve stats from the metastore for a column in a partitioned table, we will execute the logic to merge the column stats coming from each partition multiple times.
> Even though we avoid multiple calls to metastore if the cache for the stats in enabled, merging the stats for a given column can take a large amount of time if there is a large number of partitions.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)