[jira] [Updated] (HIVE-13901) Hivemetastore add partitions can be slow depending on filesystems

["Rajesh Balamohan (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HIVE-13901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Rajesh Balamohan updated HIVE-13901:
------------------------------------
    Attachment: HIVE-13901.1.patch

Creating an external table (tpcds inventory/web_sales) in S3 and running msck  on it took lot longer time. 

inventory (tpcds):
============
msck time taken before patch:193.273 seconds
msck time taken after patch:71 seconds

web_sales (tpcds):
============
msck time taken before patch:1335.19 seconds
msck time taken after patch:471.264 seconds


> Hivemetastore add partitions can be slow depending on filesystems
> -----------------------------------------------------------------
>
>                 Key: HIVE-13901
>                 URL: https://issues.apache.org/jira/browse/HIVE-13901
>             Project: Hive
>          Issue Type: Improvement
>          Components: Metastore
>            Reporter: Rajesh Balamohan
>            Priority: Minor
>         Attachments: HIVE-13901.1.patch
>
>
> Depending on FS, creating external tables & adding partitions can be expensive (e.g msck which adds all partitions).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)