You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2017/08/11 08:56:00 UTC
[jira] [Commented] (HIVE-17289) EXPORT and IMPORT shouldn't perform
distcp with doAs privileged user.
[ https://issues.apache.org/jira/browse/HIVE-17289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16123052#comment-16123052 ]
ASF GitHub Bot commented on HIVE-17289:
---------------------------------------
GitHub user sankarh opened a pull request:
https://github.com/apache/hive/pull/227
HIVE-17289: EXPORT and IMPORT shouldn't perform distcp with doAs privileged user.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/sankarh/hive HIVE-17289
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/hive/pull/227.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #227
----
commit 29072b2905c1ffa83141a5d29f6095869e68a4e7
Author: Sankar Hariappan <ma...@gmail.com>
Date: 2017-08-11T08:15:02Z
HIVE-17289: EXPORT and IMPORT shouldn't perform distcp with doAs privileged user.
----
> EXPORT and IMPORT shouldn't perform distcp with doAs privileged user.
> ---------------------------------------------------------------------
>
> Key: HIVE-17289
> URL: https://issues.apache.org/jira/browse/HIVE-17289
> Project: Hive
> Issue Type: Sub-task
> Components: HiveServer2, repl
> Affects Versions: 3.0.0
> Reporter: Sankar Hariappan
> Assignee: Sankar Hariappan
> Labels: DR, Import, replication
> Fix For: 3.0.0
>
> Attachments: HIVE-17289.01.patch
>
>
> Currently, EXPORT uses distcp to dump data files to dump directory and IMPORT uses distcp to copy the larger files/large number of files from dump directory to table staging directory. But, this copy fails as distcp is always done with doAs user specified in hive.distcp.privileged.doAs, which is "hdfs' by default.
> Need to remove usage of doAs user when try to distcp from EXPORT/IMPORT flow.
> Privileged user based distcp should be done only for REPL DUMP/LOAD commands.
> Also, need to set the default config for hive.distcp.privileged.doAs to "hive" as "hdfs" super-user is never allowed.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)