You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Sujith (JIRA)" <ji...@apache.org> on 2018/12/23 17:45:00 UTC
[jira] [Commented] (SPARK-26432) Getting NoSuchMethodException
while trying to obtain token from Hbase 2.1 service
[ https://issues.apache.org/jira/browse/SPARK-26432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16728014#comment-16728014 ]
Sujith commented on SPARK-26432:
--------------------------------
This is mainly happening because in spark uses a deprecated hbase api
public static Token<AuthenticationTokenIdentifier> obtainToken(Configuration conf)
for obtaining the kerberos security token and the API has been removed from hbase 2.1 version , as i analyzed there is one more stable API in
public static Token<AuthenticationTokenIdentifier> obtainToken(Connection conn) in TokenUtil class , i think spark shall use this stable api for getting the delegation token.
To invoke this api first connection object has to be retrieved from ConnectionFactory and the same connection can be passed to obtainToken(Connection conn) for getting token.
I can rase a PR soon for handling this issue, please let me know for any clarifications or suggestions.
> Getting NoSuchMethodException while trying to obtain token from Hbase 2.1 service
> ---------------------------------------------------------------------------------
>
> Key: SPARK-26432
> URL: https://issues.apache.org/jira/browse/SPARK-26432
> Project: Spark
> Issue Type: Improvement
> Components: Spark Core
> Affects Versions: 2.3.2, 2.4.0
> Reporter: Sujith
> Priority: Major
> Attachments: hbase-dep-obtaintok.png
>
>
> Getting NoSuchMethodException :
> org.apache.hadoop.hbase.security.token.TokenUtil(org.apache.hadoop.conf.Configuration)
> while trying connect hbase 2.1 service from spark.
> This is mainly happening because in spark uses a deprecated hbase api
> public static Token<AuthenticationTokenIdentifier> obtainToken(Configuration conf)
> for obtaining the token and the same has been removed from hbase 2.1 version.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org