You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@sqoop.apache.org by Abraham Fine <ab...@cloudera.com> on 2015/12/01 00:15:31 UTC
Re: Review Request 40625: SQOOP-2709 Sqoop2: HDFS: Impersonation on
secured cluster doesn't work
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/40625/#review108409
-----------------------------------------------------------
connector/connector-hdfs/src/main/java/org/apache/sqoop/connector/hdfs/security/SecurityUtils.java (line 82)
<https://reviews.apache.org/r/40625/#comment167874>
if this path is on s3, we end up putting an empty list of tokens in credentials. which causes an exception when deserializing the token.
- Abraham Fine
On Nov. 24, 2015, 12:58 a.m., Jarek Cecho wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/40625/
> -----------------------------------------------------------
>
> (Updated Nov. 24, 2015, 12:58 a.m.)
>
>
> Review request for Sqoop.
>
>
> Bugs: SQOOP-2709
> https://issues.apache.org/jira/browse/SQOOP-2709
>
>
> Repository: sqoop-sqoop2
>
>
> Description
> -------
>
> I've provided util class that can retrieve delegation token for "current" user and store it in our Context that is passed to execution engine.
>
>
> Diffs
> -----
>
> connector/connector-hdfs/src/main/java/org/apache/sqoop/connector/hdfs/HdfsConstants.java 39ee4a3
> connector/connector-hdfs/src/main/java/org/apache/sqoop/connector/hdfs/HdfsExtractor.java 583acdd
> connector/connector-hdfs/src/main/java/org/apache/sqoop/connector/hdfs/HdfsFromInitializer.java be837ca
> connector/connector-hdfs/src/main/java/org/apache/sqoop/connector/hdfs/HdfsLoader.java 04acd18
> connector/connector-hdfs/src/main/java/org/apache/sqoop/connector/hdfs/HdfsPartitioner.java 998b903
> connector/connector-hdfs/src/main/java/org/apache/sqoop/connector/hdfs/HdfsToDestroyer.java 2bad23a
> connector/connector-hdfs/src/main/java/org/apache/sqoop/connector/hdfs/HdfsToInitializer.java 5856371
> connector/connector-hdfs/src/main/java/org/apache/sqoop/connector/hdfs/security/SecurityUtils.java PRE-CREATION
> connector/connector-hdfs/src/test/java/org/apache/sqoop/connector/hdfs/security/TestSecurityUtils.java PRE-CREATION
>
> Diff: https://reviews.apache.org/r/40625/diff/
>
>
> Testing
> -------
>
> I've tested the patch on secured real cluster to make sure that it's working. Sadly I did not included any integration test as our suite currently doesn't have any support for MiniKDC (this is something that we will add later).
>
>
> Thanks,
>
> Jarek Cecho
>
>