You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hawq.apache.org by "Gagan Brahmi (JIRA)" <ji...@apache.org> on 2018/02/20 04:47:00 UTC
[jira] [Updated] (HAWQ-1588) PXF and S3
[ https://issues.apache.org/jira/browse/HAWQ-1588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Gagan Brahmi updated HAWQ-1588:
-------------------------------
Description:
Right now to read Hive tables (ORC or RC or TextFile) we create external tables using PXF. However if the hive tables is stored on S3 or we have raw ORC files stored on S3 we are pretty much stuck since S3 does not have the custom format available to read ORC or RC file data.
It will be nice feature to have PXF the ability to read the data over S3 protocol with Hive ORC & RC SerDe.
This will be like a combination of S3 external table along with PXF external table which will enable users to read the Hive external table stored in S3 or Hive external table files available to read from S3.
was:
Right now to read Hive tables (ORC or RC or TextFile) we create external tables using PXF. However if the hive tables is stored on S3 or we have raw ORC files stored on S3 we are pretty much stuck since S3 does not have the custom format available to read ORC or RC file data.
It will be nice feature to have PXF the ability to read the data over S3 protocol with Hive ORC & RC SerDe.
This will be like a combination of S3 external table along with PXF external table which will enable users to read the Hive external table stored in S3 or Hive external table files available to read from S3.
> PXF and S3
> ----------
>
> Key: HAWQ-1588
> URL: https://issues.apache.org/jira/browse/HAWQ-1588
> Project: Apache HAWQ
> Issue Type: Improvement
> Components: External Tables, PXF
> Reporter: Gagan Brahmi
> Assignee: Ed Espino
> Priority: Major
>
> Right now to read Hive tables (ORC or RC or TextFile) we create external tables using PXF. However if the hive tables is stored on S3 or we have raw ORC files stored on S3 we are pretty much stuck since S3 does not have the custom format available to read ORC or RC file data.
> It will be nice feature to have PXF the ability to read the data over S3 protocol with Hive ORC & RC SerDe.
> This will be like a combination of S3 external table along with PXF external table which will enable users to read the Hive external table stored in S3 or Hive external table files available to read from S3.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)