You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "Issac Buenrostro (Jira)" <ji...@apache.org> on 2020/08/27 23:26:00 UTC
[jira] [Updated] (HDFS-15545) (S)Webhdfs will not use updated
delegation tokens available in the ugi after the old ones expire
[ https://issues.apache.org/jira/browse/HDFS-15545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Issac Buenrostro updated HDFS-15545:
------------------------------------
Description:
WebHdfsFileSystem can select a delegation token to use from the current user UGI. The token selection is sticky, and WebHdfsFileSystem will re-use it every time without searching the UGI again.
If the previous token expires, WebHdfsFileSystem will catch the exception and attempt to get a new token. However, the mechanism to get a new token bypasses searching for one on the UGI, so even if there is external logic that has retrieved a new token, it is not possible to make the FileSystem use the new, valid token, rendering the FileSystem object unusable.
A simple fix would allow WebHdfsFileSystem to re-search the UGI, and if it finds a different token than the cached one try to use it.
was:
WebHdfsFileSystem can select a delegation token to use from the current user UGI. The token selection is sticky, and WebHdfsFileSystem will re-use it every time without searching the UGI again.
If the previous token expires, WebHdfsFileSystem will catch the exception and attempt to get a new token. However, the mechanism to get a new token bypasses searching for one on the UGI, so even if there is external logic that has retrieved a new token, it is not possible to make the FileSystem use the new, valid token, rendering the FileSystem object unusable.
> (S)Webhdfs will not use updated delegation tokens available in the ugi after the old ones expire
> ------------------------------------------------------------------------------------------------
>
> Key: HDFS-15545
> URL: https://issues.apache.org/jira/browse/HDFS-15545
> Project: Hadoop HDFS
> Issue Type: Bug
> Reporter: Issac Buenrostro
> Priority: Major
>
> WebHdfsFileSystem can select a delegation token to use from the current user UGI. The token selection is sticky, and WebHdfsFileSystem will re-use it every time without searching the UGI again.
> If the previous token expires, WebHdfsFileSystem will catch the exception and attempt to get a new token. However, the mechanism to get a new token bypasses searching for one on the UGI, so even if there is external logic that has retrieved a new token, it is not possible to make the FileSystem use the new, valid token, rendering the FileSystem object unusable.
> A simple fix would allow WebHdfsFileSystem to re-search the UGI, and if it finds a different token than the cached one try to use it.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org