You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@atlas.apache.org by "Sharmadha Sainath (JIRA)" <ji...@apache.org> on 2016/07/27 18:39:20 UTC
[jira] [Commented] (ATLAS-1060) Add composite indexes for exact
match performance improvements for selected/all attributes
[ https://issues.apache.org/jira/browse/ATLAS-1060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15396128#comment-15396128 ]
Sharmadha Sainath commented on ATLAS-1060:
------------------------------------------
Set
1.atlas.notification.hook.numthreads=5
2.ATLAS_HOOK created with 5 partitions
3. enabled only KafkaNotification and KafkaConsumer debug logs and disabled rest.
With ATLAS-1060.patch,
10,000 hive tables take 15 mins 31 secs 32 ms to be ingested in Atlas. table creation time in hive : 4 mins 48 secs 727 ms
With ATLAS-1060-all-attributes.patch ,
10,000 hive tables take 15 mins 50 secs 626 ms to be ingested in Atlas. table creation time in hive : 4 mins 51 secs 518 ms
> Add composite indexes for exact match performance improvements for selected/all attributes
> ------------------------------------------------------------------------------------------
>
> Key: ATLAS-1060
> URL: https://issues.apache.org/jira/browse/ATLAS-1060
> Project: Atlas
> Issue Type: Bug
> Affects Versions: 0.7-incubating, 0.8-incubating
> Reporter: Suma Shivaprasad
> Assignee: Suma Shivaprasad
> Fix For: 0.8-incubating
>
> Attachments: ATLAS-1060-all-attributes.patch, ATLAS-1060.patch
>
>
> Proposal is to add a flag for each attribute which is by default 'false' for creating exact match indexes (titan composite indexes). By default mixed idexes are created but not used for exact matches. The proposal is to add them for selected attributes.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)