You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2017/06/21 04:38:00 UTC
[jira] [Commented] (HIVE-16892) Move creation of _files from
ReplCopyTask to analysis phase for boostrap replication
[ https://issues.apache.org/jira/browse/HIVE-16892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16056979#comment-16056979 ]
ASF GitHub Bot commented on HIVE-16892:
---------------------------------------
GitHub user anishek opened a pull request:
https://github.com/apache/hive/pull/196
HIVE-16892 : Move creation of _files from ReplCopyTask to analysis phase for boostrap replication
the export semantic analyzer is still using the inputs/outputs since that should be used by repl v1 and hence authorization there might be required outside of what is done in repl v2
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/anishek/hive HIVE-16892
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/hive/pull/196.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #196
----
commit e1a16e918e7809a7c6f6a1fd004e7f9798ff7c79
Author: Anishek Agarwal <an...@gmail.com>
Date: 2017-06-21T04:34:12Z
HIVE-16892 : Move creation of _files from ReplCopyTask to analysis phase for boostrap replication
----
> Move creation of _files from ReplCopyTask to analysis phase for boostrap replication
> -------------------------------------------------------------------------------------
>
> Key: HIVE-16892
> URL: https://issues.apache.org/jira/browse/HIVE-16892
> Project: Hive
> Issue Type: Sub-task
> Components: HiveServer2
> Affects Versions: 3.0.0
> Reporter: anishek
> Assignee: anishek
> Fix For: 3.0.0
>
>
> during replication boostrap we create the _files via ReplCopyTask for partitions and tables, this can be done inline as part of analysis phase rather than creating the replCopytask,
> This is done to prevent creation of huge number of these tasks in memory before giving it to the execution engine.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)