[jira] [Resolved] (IMPALA-4943) Improve metadata load speed for "alter table add partition".

["bharath v (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/IMPALA-4943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

bharath v resolved IMPALA-4943.
-------------------------------
       Resolution: Fixed
    Fix Version/s: Impala 2.9.0

https://github.com/apache/incubator-impala/commit/8bd854dfa6f40bd32e8fcd6f284c15b045b4f1ee

> Improve metadata load speed for "alter table add partition".
> ------------------------------------------------------------
>
>                 Key: IMPALA-4943
>                 URL: https://issues.apache.org/jira/browse/IMPALA-4943
>             Project: IMPALA
>          Issue Type: Improvement
>          Components: Catalog
>    Affects Versions: Impala 2.9.0
>            Reporter: bharath v
>            Assignee: bharath v
>            Priority: Blocker
>              Labels: regression
>             Fix For: Impala 2.9.0
>
>
> The fix for IMPALA-4840 improved "REFRESH"s performance by doing a file by file load of block metadata instead of bulk loading it. This code path is also taken by "alter table add partition" that loads newly added partitions. Given we need to load the newly added partition md from scratch, we can leverage the listFiles() functionality here rather than following the refresh's code path that is sub-optimal for this case.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)