You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Jianguo Tian (Jira)" <ji...@apache.org> on 2020/04/22 11:30:00 UTC
[jira] [Comment Edited] (HIVE-11995) Remove repetitively setting
permissions in insert/load overwrite partition
[ https://issues.apache.org/jira/browse/HIVE-11995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17089575#comment-17089575 ]
Jianguo Tian edited comment on HIVE-11995 at 4/22/20, 11:29 AM:
----------------------------------------------------------------
{code:java}
// first call FileUtils.mkdir to make sure that destf directory exists, if not, it creates
// destf with inherited permissions
boolean destfExist = FileUtils.mkdir(destFs, destf, true, conf);
{code}
Why did you set inheritPerms param to true in this line, it makes hive.warehouse.subdir.inherit.perms didn't work.
If the table hdfs dir permission is 770, and I want partition dir permission is 755(use default umask 022), so I need to set hive.warehouse.subdir.inherit.perms=false.
But it has been set to true in a hard code way, so hive.warehouse.subdir.inherit.perms=false didn't work, the partition dir permission will also be 770.
How do u think about this scenario. THX!
was (Author: jonnyr):
{code:java}
// first call FileUtils.mkdir to make sure that destf directory exists, if not, it creates
// destf with inherited permissions
boolean destfExist = FileUtils.mkdir(destFs, destf, true, conf);
{code}
Why did you set inheritPerms param to true in this line, it makes hive.warehouse.subdir.inherit.perms didn't work.
If the table hdfs dir permission is 770, and I want partition dir permission is 755, so I need to set hive.warehouse.subdir.inherit.perms=false.
But it has been set to true in hard code way, so hive.warehouse.subdir.inherit.perms=false didn't work.
How do u think about this scenario. THX!
> Remove repetitively setting permissions in insert/load overwrite partition
> --------------------------------------------------------------------------
>
> Key: HIVE-11995
> URL: https://issues.apache.org/jira/browse/HIVE-11995
> Project: Hive
> Issue Type: Bug
> Components: Security
> Reporter: Chaoyu Tang
> Assignee: Chaoyu Tang
> Priority: Major
> Fix For: 2.0.0
>
> Attachments: HIVE-11995.patch
>
>
> When hive.warehouse.subdir.inherit.perms is set to true, insert/load overwrite .. partition set table and partition permissions repetitively which is not necessary and causing performance issue especially in the cases where there are multiple levels of partitions involved.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)