[jira] [Resolved] (KUDU-1807) GetTableSchema() is O(n) in the number of tablets

["Adar Dembo (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/KUDU-1807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Adar Dembo resolved KUDU-1807.
------------------------------
       Resolution: Fixed
    Fix Version/s: 1.6.0

Fixed in commits 2b95bf1, c1f78ff, and 052d1de.

> GetTableSchema() is O(n) in the number of tablets
> -------------------------------------------------
>
>                 Key: KUDU-1807
>                 URL: https://issues.apache.org/jira/browse/KUDU-1807
>             Project: Kudu
>          Issue Type: Sub-task
>          Components: master, perf
>    Affects Versions: 1.2.0
>            Reporter: Todd Lipcon
>            Assignee: Adar Dembo
>            Priority: Critical
>              Labels: data-scalability
>             Fix For: 1.6.0
>
>
> GetTableSchema calls TableInfo::IsCreateTableDone. This method checks each tablet for whether it is in the correct state, which requires acquiring the RWC lock for every tablet. This is somewhat slow for large tables with thousands of tablets, and this is actually a relatively hot path because every task in an Impala query ends up calling GetTableSchema() when it opens its scanner.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)