You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@atlas.apache.org by "ASF subversion and git services (JIRA)" <ji...@apache.org> on 2018/09/13 22:21:00 UTC
[jira] [Commented] (ATLAS-2864) Export Process: Incremental:
Improve Approach for Fetching Changed Entities
[ https://issues.apache.org/jira/browse/ATLAS-2864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16614123#comment-16614123 ]
ASF subversion and git services commented on ATLAS-2864:
--------------------------------------------------------
Commit 1dc0622a77a57b01f67e190b287743a4244fc888 in atlas's branch refs/heads/branch-0.8 from [~ashutoshm]
[ https://git-wip-us.apache.org/repos/asf?p=atlas.git;h=1dc0622 ]
ATLAS-2864: Improved incremental export queries.
Signed-off-by: Ashutosh Mestry <am...@hortonworks.com>
> Export Process: Incremental: Improve Approach for Fetching Changed Entities
> ---------------------------------------------------------------------------
>
> Key: ATLAS-2864
> URL: https://issues.apache.org/jira/browse/ATLAS-2864
> Project: Atlas
> Issue Type: Improvement
> Components: atlas-core
> Affects Versions: 0.8.2
> Reporter: Ashutosh Mestry
> Assignee: Ashutosh Mestry
> Priority: Major
> Fix For: 0.8.3
>
> Attachments: ATLAS-2864-Improved-incremental-export-queries-to-re.patch
>
>
> *Background*
> Existing approach for getting modified entities tends to iterate through the entire set of entities and then filter. This results in no benefit in terms of time and effort for incremental export. It does benefit Import, where smaller set is imported.
> *Approach*
> * User Gremlin queries to fetch entities that match criteria.
> * Modify existing logic that does deep traversal to support this new logic.
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)