[jira] [Comment Edited] (GRIFFIN-194) [service] Hive API improvement

["Nikolay Sokolov (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/GRIFFIN-194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16620162#comment-16620162 ] 

Nikolay Sokolov edited comment on GRIFFIN-194 at 9/19/18 6:22 AM:
------------------------------------------------------------------

Yeah, I've mentioned that in a ticket. Problem is, that `getAllTables()` is doing n_tables metastore requests internally, making it really slow on large count of tables. This ticket is mainly to support GRIFFIN-195, however approach with `getAllDatabases()` followed by sequence of `getAllTableNames(String)` might work as well. Let me probably try leveraging existing APIs and see whether new endpoint is really required.


was (Author: chemikadze):
Yeah, I've mentioned that in a ticket. Problem is, that `getAllTables()` is doing `n_tables * n_databases` metastore requests internally, making it really slow on large count of tables. This ticket is mainly to support GRIFFIN-195, however approach with `getAllDatabases()` followed by sequence of `getAllTableNames(String)` might work as well. Let me probably try leveraging existing APIs and see whether new endpoint is really required.

> [service] Hive API improvement
> ------------------------------
>
>                 Key: GRIFFIN-194
>                 URL: https://issues.apache.org/jira/browse/GRIFFIN-194
>             Project: Griffin (Incubating)
>          Issue Type: Sub-task
>            Reporter: Nikolay Sokolov
>            Priority: Minor
>
> Hive API provides following relevant APIs right now:
> * listing DBs
> * getting all table names in DB
> * listing all table _objects_ in all _dbs_
> What's seems to be missing, is API call for all table names in all DBs (as middle ground between n+1 API requests and 1 API request with huge payload and n*m+1 metastore requests on backend).
> This api request should take no parameters, and return Map<String, List<String>> in response.
> Proposed API endpoint: TBD



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)