You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hawq.apache.org by "Lili Ma (JIRA)" <ji...@apache.org> on 2016/06/17 03:38:05 UTC
[jira] [Comment Edited] (HAWQ-829) Register Hive generated parquet
file into HAWQ
[ https://issues.apache.org/jira/browse/HAWQ-829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15335296#comment-15335296 ]
Lili Ma edited comment on HAWQ-829 at 6/17/16 3:37 AM:
-------------------------------------------------------
About HAWQ data mapping to Parquet, I think we can modify some HAWQ data types to be compatible with Hive.
1. Currently HAWQ converts data type decimal to byte array, we can modify it to fixed length byte array, so that HAWQ can be compatible with Hive.
2. HAWQ itself can convert the data type char to int32 instead of byte array, so that the space for char storage can be saved.
3. To be compatible with Hive, HAWQ can change its type mapping for decimal to int96, but this need discussion.
Have opened another Task to track the HAWQ type re-implementation. https://issues.apache.org/jira/browse/HAWQ-831
was (Author: lilima):
About HAWQ data mapping to Parquet, I think we can modify some HAWQ data types to be compatible with Hive.
1. Currently HAWQ converts data type decimal to byte array, we can modify it to fixed length byte array, so that HAWQ can be compatible with Hive.
2. HAWQ itself can convert the data type char to int32 instead of byte array, so that the space for char storage can be saved.
3. To be compatible with Hive, HAWQ can change its type mapping for decimal to int96, but this need discussion.
> Register Hive generated parquet file into HAWQ
> ----------------------------------------------
>
> Key: HAWQ-829
> URL: https://issues.apache.org/jira/browse/HAWQ-829
> Project: Apache HAWQ
> Issue Type: Sub-task
> Components: Storage
> Reporter: Lili Ma
> Assignee: Lei Chang
> Attachments: HAWQTypeMappingtoParquetType.pdf
>
>
> As a user, I can register the parquet files generated by Hive to HAWQ, so that I can access Hive generated file from HAWQ directly.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)