You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Rahul Patwari (Jira)" <ji...@apache.org> on 2020/04/28 13:01:00 UTC
[jira] [Updated] (BEAM-9840) Support for Parameterized Types when
converting from HCatRecords to Rows in HCatalogIO
[ https://issues.apache.org/jira/browse/BEAM-9840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Rahul Patwari updated BEAM-9840:
--------------------------------
Summary: Support for Parameterized Types when converting from HCatRecords to Rows in HCatalogIO (was: Support for Parameterized Types in HCatalogIO)
> Support for Parameterized Types when converting from HCatRecords to Rows in HCatalogIO
> --------------------------------------------------------------------------------------
>
> Key: BEAM-9840
> URL: https://issues.apache.org/jira/browse/BEAM-9840
> Project: Beam
> Issue Type: Improvement
> Components: io-java-hcatalog
> Reporter: Rahul Patwari
> Assignee: Rahul Patwari
> Priority: Major
>
> In Hive, to use CHAR and VARCHAR as the data type for a column, the types have to be parameterized with the length of the character sequence. Refer https://github.com/apache/hive/blob/f37c5de6c32b9395d1b34fa3c02ed06d1bfbf6eb/serde/src/test/org/apache/hadoop/hive/serde2/typeinfo/TestTypeInfoUtils.java#L68
> In addition, for DECIMAL data type, custom precision and scale can be provided as parameters.
> A user has faced an Exception while reading data from a table created in Hive with parameterized DECIMAL data type. Refer [https://lists.apache.org/thread.html/r159012fbefce24d734096e3ec24ecd112de5f89b8029e57147d233b0%40%3Cuser.beam.apache.org%3E].
> This ticket is created to support reading data from tables in Hive, where the type of a column can be parameterized.
> To Support Parameterized data types, we can make use of HcatFieldSchema. Refer https://github.com/apache/hive/blob/f37c5de6c32b9395d1b34fa3c02ed06d1bfbf6eb/hcatalog/core/src/main/java/org/apache/hive/hcatalog/data/schema/HCatFieldSchema.java#L34
--
This message was sent by Atlassian Jira
(v8.3.4#803005)