You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@atlas.apache.org by "Sarath Subramanian (Jira)" <ji...@apache.org> on 2021/02/04 06:11:00 UTC
[jira] [Assigned] (ATLAS-4127) Reduce number of Hive table calls in
Atlas Hook
[ https://issues.apache.org/jira/browse/ATLAS-4127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sarath Subramanian reassigned ATLAS-4127:
-----------------------------------------
Assignee: Deep Singh
> Reduce number of Hive table calls in Atlas Hook
> -----------------------------------------------
>
> Key: ATLAS-4127
> URL: https://issues.apache.org/jira/browse/ATLAS-4127
> Project: Atlas
> Issue Type: Bug
> Components: atlas-core
> Affects Versions: 2.1.0
> Reporter: Deep Singh
> Assignee: Deep Singh
> Priority: Major
> Labels: hive-hooks
>
> In Atlas Hive bridge, while calculating processQualifiedName, all partitions are processed.
> For each partition, a hive call is made to get table details. Since multiple partitions can belong to the same table, there is a scope for improvement by avoiding repeated hive calls for the same table information.
> This improvement becomes crucial particularly in the case where there are several partitions for a single table.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)