You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hawq.apache.org by "Shivram Mani (JIRA)" <ji...@apache.org> on 2016/09/12 22:49:23 UTC

[jira] [Resolved] (HAWQ-971) Update PXF Hive Resolver to return partial content

     [ https://issues.apache.org/jira/browse/HAWQ-971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Shivram Mani resolved HAWQ-971.
-------------------------------
       Resolution: Fixed
    Fix Version/s:     (was: backlog)
                   2.0.1.0-incubating

Only columns appearing in the query will be projected and the rest will be sent as null values.

> Update PXF Hive Resolver to return partial content
> --------------------------------------------------
>
>                 Key: HAWQ-971
>                 URL: https://issues.apache.org/jira/browse/HAWQ-971
>             Project: Apache HAWQ
>          Issue Type: Sub-task
>          Components: PXF
>            Reporter: Shivram Mani
>            Assignee: Shivram Mani
>             Fix For: 2.0.1.0-incubating
>
>
> Most of the data formats on HDFS don't support projecting specific columns. For such formats we can still avoid resolving every individual field in the record and instead only resolve fields that need to be projected and send NULLs for other fields.
> This task is specifically focused on improving the performance of Hive profile which positively impacts both Hive and HiveORC profile
> We will be padding null objects of the appropriate type as part of the resolver for fields that are not required to be projected as per the SQL query. Only fields required by the query will be projected/resolved in the appropriate manner



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)