You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@kudu.apache.org by "Grant Henke (Code Review)" <ge...@cloudera.org> on 2019/04/15 16:27:47 UTC

[kudu-CR] [backup] Add initial incremental backup/restore support

Hello Will Berkeley, Mike Percy, Kudu Jenkins, Adar Dembo, 

I'd like you to reexamine a change. Please visit

    http://gerrit.cloudera.org:8080/12879

to look at the new patch set (#3).

Change subject: [backup] Add initial incremental backup/restore support
......................................................................

[backup] Add initial incremental backup/restore support

This patch adds initial support for incremental backup
and restore.

A high level overview of the changes in this patch is:
- Added a version to the TableMetadata for future use.
- Broke out io/layout logic to a SessionIO class so it
   could be easily shared.
- Unified the BackupOptions and RestoreOptions
   so common options could be shared.
- Introduced a BackupGraph class to handle chaining
   together backups for backup and restore jobs.
- Enhanced the BackupRDD to output an additional
   RowAction byte column on backup and restore.
- Enhanced the restore job to use the new RowAction
   column and translate them into operations for
   incremental restore jobs.
- Added the ability to restore to a given “time” on a
   per backup basis.
- Added example usage docs to the Backup and Restore
   classes.
- Added hasIsDeleted to RowResult and hasColumn to
   Schema.

Change-Id: I50b21d921fefbf4d7e8bd1766285258e8014d890
---
M java/kudu-backup/src/main/protobuf/backup.proto
A java/kudu-backup/src/main/scala/org/apache/kudu/backup/BackupGraph.scala
M java/kudu-backup/src/main/scala/org/apache/kudu/backup/KuduBackup.scala
D java/kudu-backup/src/main/scala/org/apache/kudu/backup/KuduBackupOptions.scala
M java/kudu-backup/src/main/scala/org/apache/kudu/backup/KuduBackupRDD.scala
M java/kudu-backup/src/main/scala/org/apache/kudu/backup/KuduRestore.scala
D java/kudu-backup/src/main/scala/org/apache/kudu/backup/KuduRestoreOptions.scala
A java/kudu-backup/src/main/scala/org/apache/kudu/backup/Options.scala
A java/kudu-backup/src/main/scala/org/apache/kudu/backup/RowAction.java
A java/kudu-backup/src/main/scala/org/apache/kudu/backup/SessionIO.scala
M java/kudu-backup/src/main/scala/org/apache/kudu/backup/TableMetadata.scala
A java/kudu-backup/src/test/scala/org/apache/kudu/backup/TestBackupGraph.scala
M java/kudu-backup/src/test/scala/org/apache/kudu/backup/TestKuduBackup.scala
M java/kudu-client/src/main/java/org/apache/kudu/Schema.java
M java/kudu-client/src/main/java/org/apache/kudu/client/AsyncKuduScanner.java
M java/kudu-client/src/main/java/org/apache/kudu/client/RowResult.java
M java/kudu-spark/src/main/scala/org/apache/kudu/spark/kudu/RowConverter.scala
M java/kudu-spark/src/test/scala/org/apache/kudu/spark/kudu/KuduTestSuite.scala
18 files changed, 1,112 insertions(+), 396 deletions(-)


  git pull ssh://gerrit.cloudera.org:29418/kudu refs/changes/79/12879/3
-- 
To view, visit http://gerrit.cloudera.org:8080/12879
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: I50b21d921fefbf4d7e8bd1766285258e8014d890
Gerrit-Change-Number: 12879
Gerrit-PatchSet: 3
Gerrit-Owner: Grant Henke <gr...@apache.org>
Gerrit-Reviewer: Adar Dembo <ad...@cloudera.com>
Gerrit-Reviewer: Grant Henke <gr...@apache.org>
Gerrit-Reviewer: Kudu Jenkins (120)
Gerrit-Reviewer: Mike Percy <mp...@apache.org>
Gerrit-Reviewer: Will Berkeley <wd...@gmail.com>