You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@atlas.apache.org by "Carol Drummond (Jira)" <ji...@apache.org> on 2019/09/25 19:26:04 UTC
[jira] [Updated] (ATLAS-2738) Export Process: Add Support for
Incremental Export
[ https://issues.apache.org/jira/browse/ATLAS-2738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Carol Drummond updated ATLAS-2738:
----------------------------------
Labels: release-notes (was: )
> Export Process: Add Support for Incremental Export
> --------------------------------------------------
>
> Key: ATLAS-2738
> URL: https://issues.apache.org/jira/browse/ATLAS-2738
> Project: Atlas
> Issue Type: Improvement
> Components: atlas-core
> Affects Versions: 0.8.3
> Reporter: Ashutosh Mestry
> Assignee: Ashutosh Mestry
> Priority: Major
> Labels: release-notes
> Fix For: 0.8.3, 1.2.0, 2.0.0
>
> Attachments: ATLAS-2738-Support-for-incremental-export.patch
>
>
> *Background*
> Use case: Export & Import process is used to synchronize data between clusters.
> Data is exported from a cluster and imported into another cluster. Subsequent exports should only contain entities that have been created or updated since the last export. This helps makes the export process quicker and the payload will be smaller.
> *Implementation Approach*
> Add new _fetchType_: _incremental,_ with additional parameter _fromTime_ which is a timestamp. During Export process, entities' that have ___modificationTimestamp_ greater than _fromTime_ would be included in the export.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)