You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@sqoop.apache.org by "Daniel Voros (JIRA)" <ji...@apache.org> on 2018/05/30 15:22:00 UTC
[jira] [Resolved] (SQOOP-2471) Support arrays and structs datatypes
with Sqoop Hcatalog integration
[ https://issues.apache.org/jira/browse/SQOOP-2471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Daniel Voros resolved SQOOP-2471.
---------------------------------
Resolution: Duplicate
I believe this has been superseded by SQOOP-2935.
> Support arrays and structs datatypes with Sqoop Hcatalog integration
> --------------------------------------------------------------------
>
> Key: SQOOP-2471
> URL: https://issues.apache.org/jira/browse/SQOOP-2471
> Project: Sqoop
> Issue Type: New Feature
> Components: hive-integration
> Affects Versions: 1.4.6
> Reporter: Pavel Benes
> Priority: Critical
>
> Currently sqoop import is not able to handle any complex type. On the other side the hive already has support for the following complex types:
> - arrays: ARRAY<data_type>
> - structs: STRUCT<col_name : data_type [COMMENT col_comment], ...>
> Since it is probably not possible to obtain all necessary information about those types from general JDBC database, this feature should somehow use an external information provided by arguments --map-column-java and --map-column-hive.
> For example it could look like this:
> --map-column-java item='inventory_item(name text, supplier_id integer,price numeric)'
> --map-column-hive item='STRUCT<name : string, supplier_id : int, price : decimal>'
> In case no additional information is provided some more general type should be created if possible.
> It should be possible to serialize the complex datatypes values into strings when the Hive target column's type is explicitly set to 'STRING'.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)