You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hawq.apache.org by "Kavinder Dhaliwal (JIRA)" <ji...@apache.org> on 2016/06/17 16:36:05 UTC

[jira] [Commented] (HAWQ-786) HAWQ supports ORC as a native storage format

    [ https://issues.apache.org/jira/browse/HAWQ-786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15336415#comment-15336415 ] 

Kavinder Dhaliwal commented on HAWQ-786:
----------------------------------------

Thanks for design doc [~liming01]. From a high level having a framework similar to FDW looks like a good change to make to HAWQ. I have a couple points:

1. This document seems to join ORC support and the Foreign Data Wrapper framework into the same issue. Am I correct in thinking that the FDW abstraction will be used to support ORC as a native format? Why not work on it in two stages, first the FDW then ORC support?

2. Since this is such a large change can you update the document with information of the architectural changes that will be made to HAWQ to support FDW? 

3. Can you also add information about the impact this change will have on the existing PXF framework? How the two frameworks will differ and why in your opinion FDW is the preferred approach to PXF or whether the two will co-exist?

Overall I appreciate that the design doc explains the new User experience HAWQ will have through the FDW framework but I'd like more explanation of the internal changes to HAWQ that you are purposing.

> HAWQ supports ORC as a native storage format
> --------------------------------------------
>
>                 Key: HAWQ-786
>                 URL: https://issues.apache.org/jira/browse/HAWQ-786
>             Project: Apache HAWQ
>          Issue Type: New Feature
>          Components: Storage
>            Reporter: Lei Chang
>            Assignee: hongwu
>         Attachments: ORCdesign-v0.1-2016-06-17.pdf
>
>
> In current HAWQ, two native formats are supported: AO and parquet. Now we want to support ORC. A framework to support naive c/c++ pluggable format is needed to support ORC more easily. And it can also be potentially used for fast external data access.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)