You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Narayanan Venkateswaran (Jira)" <ji...@apache.org> on 2020/11/11 08:50:00 UTC
[jira] [Commented] (HIVE-24369) Implement projection spec for
fetching only requested fields from tables
[ https://issues.apache.org/jira/browse/HIVE-24369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17229838#comment-17229838 ]
Narayanan Venkateswaran commented on HIVE-24369:
------------------------------------------------
The solution for this issue will closely model the work done in HIVE-20306
> Implement projection spec for fetching only requested fields from tables
> ------------------------------------------------------------------------
>
> Key: HIVE-24369
> URL: https://issues.apache.org/jira/browse/HIVE-24369
> Project: Hive
> Issue Type: Improvement
> Components: Hive
> Reporter: Narayanan Venkateswaran
> Assignee: Narayanan Venkateswaran
> Priority: Minor
>
> Currently HMS APIs that return Table objects return fully populated Table objects. This object table is a bit heavy with all columns, their datatype info, storage descriptor, list of properties set etc. So an API that can fetch large amounts of tables, say 100k, they may not be able to retrieve all of them in a single call due to memory constraints.
>
> To improve performance of the API for callers, they can selectively turn on what fields on the Table object to populate on the returned objects via a projection spec.
>
> Something similar has already been done for partitions in HIVE-20306.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)