[jira] [Commented] (HAWQ-786) Framework to support pluggable formats and file systems

["Radar Lei (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HAWQ-786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16102879#comment-16102879 ] 

Radar Lei commented on HAWQ-786:
--------------------------------

Hi [~lei_chang], glad to see this feature is scheduled in next release. We are starting to do some spike on Parquet 2.0 support, which is related with the pluggable storage feature your are working on. So we want to know more details about the interfaces between pluggable service and the parquet file format, this can help a lot to our spike.

As the design doc in this jira is for ORC only and might be out of date, would you update the design doc to include pluggable storage? Thanks a lot.

> Framework to support pluggable formats and file systems
> -------------------------------------------------------
>
>                 Key: HAWQ-786
>                 URL: https://issues.apache.org/jira/browse/HAWQ-786
>             Project: Apache HAWQ
>          Issue Type: Wish
>          Components: Storage
>            Reporter: Lei Chang
>            Assignee: Lei Chang
>             Fix For: backlog
>
>         Attachments: ORCdesign-v0.1-2016-06-17.pdf
>
>
> In current HAWQ, two native formats are supported: AO and parquet. Now we want to support ORC. A framework to support naive c/c++ pluggable format is needed to support ORC more easily. And it can also be potentially used for fast external data access.
> And there are a lot of requests for supporting S3, Ceph and other file systems, and this is closely related to pluggable formats, so this JIRA is proposing a framework to support both.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)