You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@sqoop.apache.org by "C Scyphers (JIRA)" <ji...@apache.org> on 2018/01/29 15:58:00 UTC

[jira] [Created] (SQOOP-3281) Support for Hive UDFs on import

C Scyphers created SQOOP-3281:
---------------------------------

             Summary: Support for Hive UDFs on import
                 Key: SQOOP-3281
                 URL: https://issues.apache.org/jira/browse/SQOOP-3281
             Project: Sqoop
          Issue Type: Improvement
          Components: hive-integration
    Affects Versions: 1.4.6
            Reporter: C Scyphers


As many companies are using UDF to establish column level encryption during write time, Sqoop should support applying such a UDF during the write process.  This would be an extension of the map-column-hive functionality, where the value of the parseColumnMapping would accept the UDF:

{{sqoop import --verbose --connect "jdbcconnectionstring" --username user --password password --hive-import --hive-database hiveschematest --map-column-hive "emptest.id=int,emptest.name=varchar(100),emptest.ssn=UDF_ENCRYPT()" -m 1}}

With this approach, the data does not have to be written to HDFS in the clear.  This functionality can also be extended to other UDFs (naturally).

 

 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)