You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Sushil Kumar S (JIRA)" <ji...@apache.org> on 2016/09/27 06:54:20 UTC

[jira] [Issue Comment Deleted] (HIVE-14840) MSCK not adding the missing partitions to Hive Metastore when the partition names are not in lowercase

     [ https://issues.apache.org/jira/browse/HIVE-14840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sushil Kumar S updated HIVE-14840:
----------------------------------
    Comment: was deleted

(was: [~sershe] But through DDL CREATE EXTERNAL statement when we have case sensitive partition names, everything is being treated as lowercase(verified from SHOW CREATE TABLE) right? so shouldn't the case sensitive partition names when adding to metastore be also be converted to lowercase and repaired?)

> MSCK not adding the missing partitions to Hive Metastore when the partition names are not in lowercase
> ------------------------------------------------------------------------------------------------------
>
>                 Key: HIVE-14840
>                 URL: https://issues.apache.org/jira/browse/HIVE-14840
>             Project: Hive
>          Issue Type: Bug
>          Components: Hive
>    Affects Versions: 1.2.1
>            Reporter: Sushil Kumar S
>            Assignee: Sushil Kumar S
>            Priority: Minor
>              Labels: hive
>
> Hi,
>   There's is a bug while running MSCK REPAIR TABLE EXTERNAL_TABLE_NAME on Hive 1.2.1, all the partition that are not present in the metastore are being listed but not added if the partition names are not in lowercase, in other words if an external path has a camel case based name and value i.e s3n://some_external_path/myPartition=01 it just gets listed as partition not found in metastore but doesn’t add it.
> However, am not able to run ALTER TABLE MY_EXTERNAL_TABLE RECOVER PARTITIONS; on hive 1.2 and based on the source code from hive-exec am able to see under org/apache/hadoop/hive/ql/parse/HiveParser.g:1001:1 that there's no token matching in the grammar for RECOVER PARTITIONS.
> Example:
> - When external path = s3n://some_external_path/myPartition=01
>        hive> MSCK REPAIR TABLE my_external_table;
>        Partitions not in metastore: my_external_table:mypartition=01
>        Time taken: 1.729 seconds, Fetched: 2 row(s)
>         hive> show partitions foster.ola_raven_raven_users_raw;
>         OK
>         Time taken: 0.901 seconds, Fetched: 0 row(s)
> - When external path = s3n://some_external_path/mypartition=01
>         hive> MSCK REPAIR TABLE my_external_table;
>         Partitions not in metastore: my_external_table:mypartition=01
>         Repair: Added partition to metastore my_external_table:mypartition=01
>         Time taken: 1.729 seconds, Fetched: 2 row(s)
>          hive> show partitions my_external_table;
>          OK
>          mypartition=01
>          Time taken: 1.101 seconds, Fetched: 1 row(s)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)