You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Sushil Kumar S (JIRA)" <ji...@apache.org> on 2016/09/26 14:00:30 UTC

[jira] [Created] (HIVE-14840) MSCK not adding the missing partitions to Hive Metastore when the partition names are not in lowercase

Sushil Kumar S created HIVE-14840:
-------------------------------------

             Summary: MSCK not adding the missing partitions to Hive Metastore when the partition names are not in lowercase
                 Key: HIVE-14840
                 URL: https://issues.apache.org/jira/browse/HIVE-14840
             Project: Hive
          Issue Type: Bug
          Components: Hive
    Affects Versions: 1.2.1
            Reporter: Sushil Kumar S
            Assignee: Sushil Kumar S
            Priority: Minor


Hi,
  There's is a bug while running MSCK REPAIR TABLE EXTERNAL_TABLE_NAME on Hive 1.2.1, all the partition that are not present in the metastore are being listed but not added if the partition names are not in lowercase, in other words if an external path has a camel case based name and value i.e s3n://some_external_path/myPartition=01 it just gets listed as partition not found in metastore but doesn’t add it.

However, am not able to run ALTER TABLE MY_EXTERNAL_TABLE RECOVER PARTITIONS; on hive 1.2 and based on the source code from hive-exec am able to see under org/apache/hadoop/hive/ql/parse/HiveParser.g:1001:1 that there's no token matching in the grammar for RECOVER PARTITIONS.

Example:

- When external path = s3n://some_external_path/myPartition=01

       hive> MSCK REPAIR TABLE my_external_table;
       Partitions not in metastore: my_external_table:mypartition=01
       Time taken: 1.729 seconds, Fetched: 2 row(s)

        hive> show partitions foster.ola_raven_raven_users_raw;
        OK
        Time taken: 0.901 seconds, Fetched: 0 row(s)

- When external path = s3n://some_external_path/mypartition=01

        hive> MSCK REPAIR TABLE my_external_table;
        Partitions not in metastore: my_external_table:mypartition=01
        Repair: Added partition to metastore my_external_table:mypartition=01
        Time taken: 1.729 seconds, Fetched: 2 row(s)

         hive> show partitions my_external_table;
         OK
         mypartition=01
         Time taken: 1.101 seconds, Fetched: 1 row(s)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)