You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Sergey Shelukhin (JIRA)" <ji...@apache.org> on 2018/02/07 01:27:00 UTC

[jira] [Created] (HIVE-18644) archived partitions check is very slow

Sergey Shelukhin created HIVE-18644:
---------------------------------------

             Summary: archived partitions check is very slow
                 Key: HIVE-18644
                 URL: https://issues.apache.org/jira/browse/HIVE-18644
             Project: Hive
          Issue Type: Bug
            Reporter: Sergey Shelukhin


See ArchiveUtils. 
Does # of affected partitions x # of part keys calls to metastore.
This can take insane amount of time for a feature that I've never seen anyone actually use.
At the very least, we should have an API on metastore that will return list of tables with archived partitions, to be able to skip these checks after one MS call if we know that the table doesn't have any.
Or we could remove the feature altogether ;)



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)