You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Rajkumar Singh (JIRA)" <ji...@apache.org> on 2018/05/08 22:39:00 UTC
[jira] [Created] (HIVE-19469) HiveServer2: SqlStdAuth take too much
time while doing checkFileAccessWithImpersonation if the table location has
too many files/dirs
Rajkumar Singh created HIVE-19469:
-------------------------------------
Summary: HiveServer2: SqlStdAuth take too much time while doing checkFileAccessWithImpersonation if the table location has too many files/dirs
Key: HIVE-19469
URL: https://issues.apache.org/jira/browse/HIVE-19469
Project: Hive
Issue Type: Task
Components: HiveServer2
Affects Versions: 2.1.0
Reporter: Rajkumar Singh
HiveServer2 doAuthorization call takes too much time while doing checkFileAccessWithImpersonation if the table location has too many files/dirs which increases the query compilation time.
{code}
at org.apache.hadoop.hive.shims.Hadoop23Shims.checkFileAccess(Hadoop23Shims.java:1006)
at org.apache.hadoop.hive.common.FileUtils.checkFileAccessWithImpersonation(FileUtils.java:378)
at org.apache.hadoop.hive.common.FileUtils.isActionPermittedForFileHierarchy(FileUtils.java:417)
at org.apache.hadoop.hive.common.FileUtils.isActionPermittedForFileHierarchy(FileUtils.java:431)
at org.apache.hadoop.hive.common.FileUtils.isActionPermittedForFileHierarchy(FileUtils.java:431)
at org.apache.hadoop.hive.common.FileUtils.isActionPermittedForFileHierarchy(FileUtils.java:431)
at org.apache.hadoop.hive.common.FileUtils.isActionPermittedForFileHierarchy(FileUtils.java:431)
at org.apache.hadoop.hive.common.FileUtils.isActionPermittedForFileHierarchy(FileUtils.java:431)
at org.apache.ranger.authorization.hive.authorizer.RangerHiveAuthorizer.isURIAccessAllowed(RangerHiveAuthorizer.java:752)
{code}
the improvement we can make here is to parallelize checkFileAccessWithImpersonation call.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)