You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@hive.apache.org by "Alice Fan (JIRA)" <ji...@apache.org> on 2018/07/26 22:39:00 UTC

[jira] [Created] (HIVE-20246) Make some collect stats flags be user configurable

Alice Fan created HIVE-20246:
--------------------------------

             Summary: Make some collect stats flags be user configurable
                 Key: HIVE-20246
                 URL: https://issues.apache.org/jira/browse/HIVE-20246
             Project: Hive
          Issue Type: Improvement
          Components: Metastore
            Reporter: Alice Fan
            Assignee: Alice Fan
             Fix For: 4.0.0


When hive.stats.autogather=true then the Metastore lists all files under the table directory to populate basic stats like file counts and sizes. This file listing operation can be very expensive particularly on filesystems like S3.
One way to address this issue is to reconfigure hive.stats.autogather=false.
However, set metaconf:hive.stats.autogather=false will not be taken by HiveMetaStore when user set this in session.




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)