You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Ana Gillan (JIRA)" <ji...@apache.org> on 2016/05/06 10:22:13 UTC
[jira] [Updated] (HIVE-13703) "msck repair" on table with
non-partition subdirectories reporting partitions not in metastore
[ https://issues.apache.org/jira/browse/HIVE-13703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ana Gillan updated HIVE-13703:
------------------------------
Affects Version/s: 0.14.0
1.0.0
1.2.1
> "msck repair" on table with non-partition subdirectories reporting partitions not in metastore
> ----------------------------------------------------------------------------------------------
>
> Key: HIVE-13703
> URL: https://issues.apache.org/jira/browse/HIVE-13703
> Project: Hive
> Issue Type: Bug
> Components: Hive
> Affects Versions: 0.14.0, 1.0.0, 1.2.1
> Reporter: Ana Gillan
>
> PROBLEM: Subdirectories created with UNION ALL are listed in {{show partitions}} output, but show up as {{Partitions not in metastore}} in {{msck repair}} output.
> STEPS TO REPRODUCE: Table created from {{CTAS ... UNION ALL}} DDL
> {code}
> hive> msck repair table meter_001;
> OK
> Partitions not in metastore: meter_001:tech_datestamp=2016-03-09/1 meter_001:tech_datestamp=2016-03-09/2 meter_001:tech_datestamp=2016-03-10/1 meter_001:tech_datestamp=2016-03-10/2 meter_001:tech_datestamp=2016-03-11/1 meter_001:tech_datestamp=2016-03-11/2 meter_001:tech_datestamp=2016-03-12/1 meter_001:tech_datestamp=2016-03-12/2 meter_001:tech_datestamp=2016-03-13/1 meter_001:tech_datestamp=2016-03-13/2 meter_001:tech_datestamp=2016-03-14/1 meter_001:tech_datestamp=2016-03-14/2 meter_001:tech_datestamp=2016-03-15/1 meter_001:tech_datestamp=2016-03-15/2 meter_001:tech_datestamp=2016-03-16/1 meter_001:tech_datestamp=2016-03-16/2 meter_001:tech_datestamp=2016-03-17/1 meter_001:tech_datestamp=2016-03-17/2 meter_001:tech_datestamp=2016-03-18/1 meter_001:tech_datestamp=2016-03-18/2 meter_001:tech_datestamp=2016-03-19/1 meter_001:tech_datestamp=2016-03-19/2 meter_001:tech_datestamp=2016-03-20/1 meter_001:tech_datestamp=2016-03-20/2 meter_001:tech_datestamp=2016-03-21/1 meter_001:tech_datestamp=2016-03-21/2 meter_001:tech_datestamp=2016-03-22/1 meter_001:tech_datestamp=2016-03-22/2 meter_001:tech_datestamp=2016-03-23/1 meter_001:tech_datestamp=2016-03-23/2 meter_001:tech_datestamp=2016-03-24/1 meter_001:tech_datestamp=2016-03-24/2 meter_001:tech_datestamp=2016-03-25/1 meter_001:tech_datestamp=2016-03-25/2 meter_001:tech_datestamp=2016-03-26/1 meter_001:tech_datestamp=2016-03-26/2 meter_001:tech_datestamp=2016-03-27/1 meter_001:tech_datestamp=2016-03-27/2 meter_001:tech_datestamp=2016-03-28/1 meter_001:tech_datestamp=2016-03-28/2 meter_001:tech_datestamp=2016-03-29/1 meter_001:tech_datestamp=2016-03-29/2 meter_001:tech_datestamp=2016-03-30/1 meter_001:tech_datestamp=2016-03-30/2 meter_001:tech_datestamp=2016-03-31/1 meter_001:tech_datestamp=2016-03-31/2 meter_001:tech_datestamp=2016-04-01/1 meter_001:tech_datestamp=2016-04-01/2 meter_001:tech_datestamp=2016-04-02/1 meter_001:tech_datestamp=2016-04-02/2 meter_001:tech_datestamp=2016-04-03/1 meter_001:tech_datestamp=2016-04-03/2 meter_001:tech_datestamp=2016-04-04/1 meter_001:tech_datestamp=2016-04-04/2 meter_001:tech_datestamp=2016-04-05/1 meter_001:tech_datestamp=2016-04-05/2 meter_001:tech_datestamp=2016-04-06/1 meter_001:tech_datestamp=2016-04-06/2
> Time taken: 15.996 seconds, Fetched: 1 row(s)
> {code}
> {code}
> hive> show partitions meter_001;
> OK
> tech_datestamp=2016-03-09
> tech_datestamp=2016-03-10
> tech_datestamp=2016-03-11
> tech_datestamp=2016-03-12
> tech_datestamp=2016-03-13
> tech_datestamp=2016-03-14
> tech_datestamp=2016-03-15
> tech_datestamp=2016-03-16
> tech_datestamp=2016-03-17
> tech_datestamp=2016-03-18
> tech_datestamp=2016-03-19
> tech_datestamp=2016-03-20
> tech_datestamp=2016-03-21
> tech_datestamp=2016-03-22
> tech_datestamp=2016-03-23
> tech_datestamp=2016-03-24
> tech_datestamp=2016-03-25
> tech_datestamp=2016-03-26
> tech_datestamp=2016-03-27
> tech_datestamp=2016-03-28
> tech_datestamp=2016-03-29
> tech_datestamp=2016-03-30
> tech_datestamp=2016-03-31
> tech_datestamp=2016-04-01
> tech_datestamp=2016-04-02
> tech_datestamp=2016-04-03
> tech_datestamp=2016-04-04
> tech_datestamp=2016-04-05
> tech_datestamp=2016-04-06
> Time taken: 0.417 seconds, Fetched: 29 row(s)
> {code}
> Ideally msck repair should ignore subdirectory if that additional partition column doesn't exist.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)