[jira] [Commented] (SQOOP-3177) ParquetJob should check for active tokens in a more reliable way

["Robert Kanter (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SQOOP-3177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15993330#comment-15993330 ] 

Robert Kanter commented on SQOOP-3177:
--------------------------------------

You can also look through the tokens and check the kind for {{HIVE_DELEGATION_TOKEN}}
https://github.com/apache/hive/blob/ff67cdda1c538dc65087878eeba3e165cf3230f4/shims/common/src/main/java/org/apache/hadoop/hive/thrift/DelegationTokenIdentifier.java#L29

> ParquetJob should check for active tokens in a more reliable way
> ----------------------------------------------------------------
>
>                 Key: SQOOP-3177
>                 URL: https://issues.apache.org/jira/browse/SQOOP-3177
>             Project: Sqoop
>          Issue Type: Bug
>    Affects Versions: 1.4.5
>            Reporter: Peter Cseh
>         Attachments: SQOOP-3177-1.patch
>
>
> Right now ParquetJob checks whether there is a Hive token in the job credentials by calling [conf.getCredentials.getToken()|https://github.com/apache/sqoop/blob/trunk/src/java/org/apache/sqoop/mapreduce/ParquetJob.java#L112] with the alias "HCat Token".
> This is not finding delegation tokens issued by Oozie as Oozie uses a different alias.
> Sqoop could rely on {{org.apache.hadoop.hive.thrift.DelegationTokenSelector}} to look for available delegation tokens.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)