You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@atlas.apache.org by "Ashutosh Mestry (Jira)" <ji...@apache.org> on 2020/03/29 16:50:00 UTC

[jira] [Created] (ATLAS-3702) Entity Creation: Improve Edge Creation

Ashutosh Mestry created ATLAS-3702:
--------------------------------------

             Summary: Entity Creation: Improve Edge Creation
                 Key: ATLAS-3702
                 URL: https://issues.apache.org/jira/browse/ATLAS-3702
             Project: Atlas
          Issue Type: Improvement
          Components:  atlas-core
    Affects Versions: trunk
            Reporter: Ashutosh Mestry
            Assignee: Ashutosh Mestry
             Fix For: trunk


*Background*

When creating entities with Atlas at scale, few inefficiencies were observed.

They were:
 * _GraphHelper.getAdjacentEdgesByLabel_: The existing approach results in high memory usage. The method could use graph api that already exists.
 * _AtlasRelationshipStoreV2.getRelationshipEdge_: This does full vertex comparison. This is expensive.
 * Edge label is not index. Indexing this will improve speed of edge by label lookup.

*Solution*

Profile Atlas with (using metrics) to establish baseline.

Use the fixes mentioned to the places above and profile.

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)