You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Denys Kuzmenko (Jira)" <ji...@apache.org> on 2023/03/20 15:28:00 UTC
[jira] [Commented] (HIVE-27140) Set HADOOP_PROXY_USER cause hiveMetaStoreClient close everytime
[ https://issues.apache.org/jira/browse/HIVE-27140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17702804#comment-17702804 ]
Denys Kuzmenko commented on HIVE-27140:
---------------------------------------
Merged to master.
Thanks [~chenruotao] for the patch and [~wechar] for the review!
> Set HADOOP_PROXY_USER cause hiveMetaStoreClient close everytime
> ----------------------------------------------------------------
>
> Key: HIVE-27140
> URL: https://issues.apache.org/jira/browse/HIVE-27140
> Project: Hive
> Issue Type: Bug
> Components: Metastore
> Affects Versions: 2.3.8, 3.1.2
> Reporter: chenruotao
> Assignee: chenruotao
> Priority: Major
> Labels: pull-request-available
> Attachments: image-2023-03-14-20-51-32-317.png, image-2023-03-14-20-53-40-132.png, image-2023-03-14-20-56-00-757.png, image-2023-03-14-21-00-18-049.png, image-2023-03-14-21-03-52-764.png, image-2023-03-14-21-56-06-605.png, image-2023-03-14-21-56-27-408.png
>
> Time Spent: 1h 40m
> Remaining Estimate: 0h
>
> In order to use proxy user to access hive metastore server with kerberos, I set HADOOP_PROXY_USER = proxy user.
> this is the code of HiveMetaStoreClient
> !image-2023-03-14-20-51-32-317.png|width=606,height=393!
> but when I run a spark job with hive metatsore client, the connection to hive metatsore server always close
> !image-2023-03-14-20-53-40-132.png|width=687,height=375!
> and I notice that some log before close :
> {color:#ff0000}Mestastore configuration hive.metastore.token.signature changed from DelegationTokenForHiveMetaStoreServer to{color}
> so we can find why the connection close always, hive metatsore client will compare currentMetaVars with hiveconf
> !image-2023-03-14-20-56-00-757.png|width=903,height=463!
> but if we set HADOOP_PROXY_USER and init hive metatsore client, the ConfVars.METASTORE_TOKEN_SIGNATURE always is set
> !image-2023-03-14-21-00-18-049.png|width=905,height=592!
> so I think this solutions can fix the bug:
> ConfVars.METASTORE_TOKEN_SIGNATURE is no need to check in hive metatsore client
> !image-2023-03-14-21-03-52-764.png|width=905,height=606!
> obviously that is no more close
> !image-2023-03-14-21-56-27-408.png|width=903,height=452!
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)