You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hawq.apache.org by "Shivram Mani (JIRA)" <ji...@apache.org> on 2016/09/12 23:05:21 UTC
[jira] [Updated] (HAWQ-931) HiveORCAccessor with support for
Predicate pushdown and Column Projection
[ https://issues.apache.org/jira/browse/HAWQ-931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Shivram Mani updated HAWQ-931:
------------------------------
Description:
HiveORCAccessor will be a subclass of the existing HiveAccessor with support for Predicate Pushdown and Column projection.
We will be using the job configuration object which is used by the ORC reader. This will still be a record based reader and not batch/vector based
We will map the filter information passed from HAWQ via PXF into SearchArgument object and set in sarg.pushdown configuration property.
We will populate the column info passed from HAWQ (HAWQ-927) into the following configuration properties
hive.io.file.readcolumn.ids, hive.io.file.readcolumn.names. hive.io.file.read.all.columns will be set to false.
Refer to HAWQ-886 for more information
was:
HiveORCAccessor will be a subclass of the existing HiveAccessor with support for Predicate Pushdown and Column projection.
We will be using the job configuration object which is used by the ORC reader. This will still be a record based reader and not batch/vector based
We will map the filter information passed from HAWQ via PXF into SearchArgument object and set in sarg.pushdown configuration property.
We will populate the column info passed from HAWQ (HAWQ-927) into the following configuration properties
hive.io.file.readcolumn.ids, hive.io.file.readcolumn.names. hive.io.file.read.all.columns will be set to false.
> HiveORCAccessor with support for Predicate pushdown and Column Projection
> -------------------------------------------------------------------------
>
> Key: HAWQ-931
> URL: https://issues.apache.org/jira/browse/HAWQ-931
> Project: Apache HAWQ
> Issue Type: New Feature
> Components: PXF
> Reporter: Shivram Mani
> Assignee: Shivram Mani
> Fix For: 2.0.1.0-incubating
>
>
> HiveORCAccessor will be a subclass of the existing HiveAccessor with support for Predicate Pushdown and Column projection.
> We will be using the job configuration object which is used by the ORC reader. This will still be a record based reader and not batch/vector based
> We will map the filter information passed from HAWQ via PXF into SearchArgument object and set in sarg.pushdown configuration property.
> We will populate the column info passed from HAWQ (HAWQ-927) into the following configuration properties
> hive.io.file.readcolumn.ids, hive.io.file.readcolumn.names. hive.io.file.read.all.columns will be set to false.
> Refer to HAWQ-886 for more information
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)