You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "ASF subversion and git services (JIRA)" <ji...@apache.org> on 2019/03/27 15:51:00 UTC

[jira] [Commented] (IMPALA-7140) Build out support for HDFS tables and views in LocalCatalog

    [ https://issues.apache.org/jira/browse/IMPALA-7140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16802956#comment-16802956 ] 

ASF subversion and git services commented on IMPALA-7140:
---------------------------------------------------------

Commit bd1071110edcec33bebef15c547e818caace551b in impala's branch refs/heads/2.x from Todd Lipcon
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=bd10711 ]

IMPALA-7140 (part 6): fetch column stats for LocalTable

This adds fetching of column statistics for LocalTable. Currently, all
column stats are fetched when the table is loaded, even for simple
statements like 'DESCRIBE' where they aren't necessary. This is because
I couldn't find a convenient spot during analysis at which time the set
of necessary columns are known. I left a TODO for this potential
improvement.

With this change I can see that 'SHOW COLUMN STATS' shows the expected
results for functional.alltypes. A new simple unit test verifies this.

Planner tests still don't pass due to some NullPointerExceptions related
to loading functions from the builtins DB -- most of the tests seem to
rely on simple built-ins like COUNT and CAST.

Change-Id: Ib6403c2bedf4ee29c5e6f90e947382cb44f46e0c
Reviewed-on: http://gerrit.cloudera.org:8080/10797
Tested-by: Impala Public Jenkins <im...@cloudera.com>
Reviewed-by: Todd Lipcon <to...@apache.org>


> Build out support for HDFS tables and views in LocalCatalog
> -----------------------------------------------------------
>
>                 Key: IMPALA-7140
>                 URL: https://issues.apache.org/jira/browse/IMPALA-7140
>             Project: IMPALA
>          Issue Type: Sub-task
>          Components: Catalog, Frontend
>            Reporter: Todd Lipcon
>            Assignee: Todd Lipcon
>            Priority: Major
>             Fix For: Impala 3.1.0
>
>
> This subtask tracks the work to build out basic read-only support for HDFS tables and views in the LocalCatalog implementation:
> - loading table schemas
> - loading partitions
> - loading file information from HDFS
> This work will be broken up into a number of patches to keep each piece reviewable. Once this subtask is complete we should be able to plan most simple read-only queries.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org