You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@sqoop.apache.org by "Szabolcs Vasas (JIRA)" <ji...@apache.org> on 2018/11/07 09:23:00 UTC

[jira] [Resolved] (SQOOP-2943) Make sqoop able to import to Parquet file format in case of HDFS encryption zones are turned on

     [ https://issues.apache.org/jira/browse/SQOOP-2943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Szabolcs Vasas resolved SQOOP-2943.
-----------------------------------
    Resolution: Duplicate

Resolving this as this issue is solved by https://issues.apache.org/jira/browse/SQOOP-3313

> Make sqoop able to import to Parquet file format in case of HDFS encryption zones are turned on
> -----------------------------------------------------------------------------------------------
>
>                 Key: SQOOP-2943
>                 URL: https://issues.apache.org/jira/browse/SQOOP-2943
>             Project: Sqoop
>          Issue Type: Improvement
>    Affects Versions: 1.4.7
>            Reporter: Attila Szabo
>            Priority: Major
>             Fix For: 1.5.0
>
>
> If HDFS encryption zones are turned on, and the user tries to import into Parquet format, where the target location is in a very different encryption zone, than the zone of the /tmp/ location (typical use case for that encrypted hive warehouse directory), even the mapper jobs are executed successfully, and the partial results stored on the temp storage correctly, the MergeOutputMapper class of Kite SDK dies with an HDFS related exception ("can't be moved into an encryption zone").
> The problem does not appear in case of clear text output formats.
> Please make Sqoop able to solve this scenario as well!



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)