You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Eugene Koifman (JIRA)" <ji...@apache.org> on 2018/03/27 20:59:00 UTC
[jira] [Commented] (HIVE-18774) ACID: Use the _copy_N files
copyNumber as the implicit statement-id
[ https://issues.apache.org/jira/browse/HIVE-18774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16416236#comment-16416236 ]
Eugene Koifman commented on HIVE-18774:
---------------------------------------
This is not as simple:
Union All
may create
warehouse/t/HIVE_UNION_SUBDIR_1/000000_0
warehouse/t/HIVE_UNION_SUBDIR_2/000000_0
or
warehouse/t/1/000000_0
warehouse/t/2/000000_0
and I suppose
warehouse/t/1/000000_0_copy_1
warehouse/t/2/000000_0_copy_1
More generally, if something other than Hive is writing, it may not be safe to assume 1 level subfolder depth.
> ACID: Use the _copy_N files copyNumber as the implicit statement-id
> -------------------------------------------------------------------
>
> Key: HIVE-18774
> URL: https://issues.apache.org/jira/browse/HIVE-18774
> Project: Hive
> Issue Type: Bug
> Components: Transactions
> Reporter: Gopal V
> Assignee: Eugene Koifman
> Priority: Major
>
> When upgrading flat ORC files to ACID, use the _copy_N numbering as a statement-id to avoid having to align the row numbering between _copy_1 and _copy_2 files.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)