You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@atlas.apache.org by "Sarath Subramanian (Jira)" <ji...@apache.org> on 2021/02/04 06:11:00 UTC

[jira] [Assigned] (ATLAS-4127) Reduce number of Hive table calls in Atlas Hook

     [ https://issues.apache.org/jira/browse/ATLAS-4127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sarath Subramanian reassigned ATLAS-4127:
-----------------------------------------

    Assignee: Deep Singh

> Reduce number of Hive table calls in Atlas Hook
> -----------------------------------------------
>
>                 Key: ATLAS-4127
>                 URL: https://issues.apache.org/jira/browse/ATLAS-4127
>             Project: Atlas
>          Issue Type: Bug
>          Components:  atlas-core
>    Affects Versions: 2.1.0
>            Reporter: Deep Singh
>            Assignee: Deep Singh
>            Priority: Major
>              Labels: hive-hooks
>
> In Atlas Hive bridge, while calculating processQualifiedName, all partitions are processed. 
> For each partition, a hive call is made to get table details. Since multiple partitions can belong to the same table, there is a scope for improvement by avoiding repeated hive calls for the same table information. 
> This improvement becomes crucial particularly in the case where there are several partitions for a single table.  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)