You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@sqoop.apache.org by "Peter Cseh (JIRA)" <ji...@apache.org> on 2017/04/28 14:02:04 UTC

[jira] [Updated] (SQOOP-3177) ParquetJob should check for active tokens in a more reliable way

     [ https://issues.apache.org/jira/browse/SQOOP-3177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Peter Cseh updated SQOOP-3177:
------------------------------
    Attachment: SQOOP-3177-1.patch

Attaching first version of the fix.
I don't like the fact that we need the service's name that's in the token to check for it. I'll look into it next week. 
Any ideas for a better check?

> ParquetJob should check for active tokens in a more reliable way
> ----------------------------------------------------------------
>
>                 Key: SQOOP-3177
>                 URL: https://issues.apache.org/jira/browse/SQOOP-3177
>             Project: Sqoop
>          Issue Type: Bug
>    Affects Versions: 1.4.5
>            Reporter: Peter Cseh
>         Attachments: SQOOP-3177-1.patch
>
>
> Right now ParquetJob checks whether there is a Hive token in the job credentials by calling [conf.getCredentials.getToken()|https://github.com/apache/sqoop/blob/trunk/src/java/org/apache/sqoop/mapreduce/ParquetJob.java#L112] with the alias "HCat Token".
> This is not finding delegation tokens issued by Oozie as Oozie uses a different alias.
> Sqoop could rely on {{org.apache.hadoop.hive.thrift.DelegationTokenSelector}} to look for available delegation tokens.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)