[jira] [Comment Edited] (HIVE-13652) Import table change order of dynamic partitions

["Sankar Hariappan (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HIVE-13652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15997242#comment-15997242 ] 

Sankar Hariappan edited comment on HIVE-13652 at 5/4/17 7:05 PM:
-----------------------------------------------------------------

Added 01.patch:
- Fixed the partition ordering issue with import/repl load.
- Added a test case to verify the bootstrap and incremental replication for table with multi-partition-columns. This test will pass in base code as well as change in order doesn't affect the functionality but impacts performance.
- Added screenshots to show the path for partition data files before and after the fix.

Request [~sushanth], [~thejas] to review the patch. Thanks!


was (Author: sankarh):
Added 01.patch:
- Fixed the partition ordering issue with import/repl load.
- Added a test case to verify the bootstrap and incremental replication for table with multi-partition-columns. This test will pass in base code as well as change in order doesn't affect the functionality but impacts performance.
- Added screenshots to show the path for partition data files before and after the fix.

> Import table change order of dynamic partitions
> -----------------------------------------------
>
>                 Key: HIVE-13652
>                 URL: https://issues.apache.org/jira/browse/HIVE-13652
>             Project: Hive
>          Issue Type: Bug
>          Components: Import/Export, repl
>    Affects Versions: 1.2.0, 1.2.1
>            Reporter: Lukas Waldmann
>            Assignee: Sankar Hariappan
>              Labels: DR, replication
>         Attachments: HIVE-13652.01.patch, ReplLoad_PartitionOrder_AfterFix_Log.png, ReplLoad_PartitionOrder_BeforeFix_Log.png
>
>
> Table with multiple dynamic partitions like year,month, day exported using "export table" command is imported (using "import table") such a way that order of partitions is changed to day, month, year.
> Export DB:  Hive 0.14
> Import DB:  Hive 1.2.1000.2.4.0.0-169
> Tables created as:
> create table T1
> ( ... ) PARTITIONED BY (period_year string, period_month string, period_day string) STORED AS ORC TBLPROPERTIES ("orc.compress"="SNAPPY");
> export command:
> export table t1 to 'path'
> import command:
> import table t1 from 'path'
> HDFS file structure on both original table location and export path keeps the original partition order ../year/month/day
> HDFS file structure after import is .../day/month/year



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)