You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@geode.apache.org by kl...@apache.org on 2017/05/31 23:15:14 UTC

[15/35] geode git commit: GEODE-2994 Take backups when region ops are quiescent

GEODE-2994 Take backups when region ops are quiescent

    This closes #544


Project: http://git-wip-us.apache.org/repos/asf/geode/repo
Commit: http://git-wip-us.apache.org/repos/asf/geode/commit/c1288ac8
Tree: http://git-wip-us.apache.org/repos/asf/geode/tree/c1288ac8
Diff: http://git-wip-us.apache.org/repos/asf/geode/diff/c1288ac8

Branch: refs/heads/feature/GEODE-2632-19
Commit: c1288ac87f1cdee0e34441ab181eeb0506ad4554
Parents: a416a32
Author: Karen Miller <km...@pivotal.io>
Authored: Fri May 26 10:29:29 2017 -0700
Committer: Karen Miller <km...@pivotal.io>
Committed: Wed May 31 15:01:08 2017 -0700

----------------------------------------------------------------------
 .../disk_storage/backup_restore_disk_store.html.md.erb | 10 ++++++++++
 .../tools_modules/lucene_integration.html.md.erb       | 13 ++++++++-----
 2 files changed, 18 insertions(+), 5 deletions(-)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/geode/blob/c1288ac8/geode-docs/managing/disk_storage/backup_restore_disk_store.html.md.erb
----------------------------------------------------------------------
diff --git a/geode-docs/managing/disk_storage/backup_restore_disk_store.html.md.erb b/geode-docs/managing/disk_storage/backup_restore_disk_store.html.md.erb
index 123ae31..deb942b 100644
--- a/geode-docs/managing/disk_storage/backup_restore_disk_store.html.md.erb
+++ b/geode-docs/managing/disk_storage/backup_restore_disk_store.html.md.erb
@@ -38,6 +38,16 @@ Do not try to create backup files from a running system by using your operating
 **Preparing to Make a Backup**
 
 -   Consider compacting your disk store before making a backup. If auto-compaction is turned off, you may want to do a manual compaction to save on the quantity of data copied over the network by the backup. For more information on configuring a manual compaction, see [Manual Compaction](compacting_disk_stores.html#compacting_disk_stores__li_63CF8C35153D4173AADF7DC35FEC61F9).
+-   Take the backup when region operations are quiescent,
+to avoid the possibility of an inconsistency between region data and
+an asynchronous event queue (AEQ) or a WAN Gateway sender
+(which uses a persistent queue).
+A region operation that causes a persisted write to a region
+involves a disk operation.
+The associated queue operation also causes a disk operation.
+These two disk operations are not made atomically,
+so if a backup is made between the two disk operations,
+then the backup represents inconsistent data in the region and the queue.
 -   Run the backup during a period of low activity in your system. The backup does not block system activities, but it uses file system resources on all hosts in your distributed system, and it can affect performance.
 -   Configure each member with any additional files or directories to be backed up by modifying the member's `cache.xml` file. Additional items that ought to be included in the backup:
 

http://git-wip-us.apache.org/repos/asf/geode/blob/c1288ac8/geode-docs/tools_modules/lucene_integration.html.md.erb
----------------------------------------------------------------------
diff --git a/geode-docs/tools_modules/lucene_integration.html.md.erb b/geode-docs/tools_modules/lucene_integration.html.md.erb
index 457fff7..2788338 100644
--- a/geode-docs/tools_modules/lucene_integration.html.md.erb
+++ b/geode-docs/tools_modules/lucene_integration.html.md.erb
@@ -296,8 +296,11 @@ will return `object_2`.
 will return `object_3`.
 - Backups should only be made for regions with Lucene indexes
 when there are no puts, updates, or deletes in progress.
-Incremental backups will not be consistent for the region and
-its index upon restart if these operations were in progress,
-due to the delayed processing associated with the asynchronous event queue.
-If region data needs to be restored from a backup,
-follow the same procedure as given for changing an index.
+A backup might cause an inconsistency between region data and a Lucene index.
+Both the region operation and the associated index operation
+cause disk operations,
+yet those disk operations are not done atomically.
+Therefore, if a backup were taken between
+the persisted write to a region
+and the resulting persisted write to the Lucene index,
+then the backup represents inconsistent data in the region and Lucene index.