You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Ted Yu (JIRA)" <ji...@apache.org> on 2016/08/10 23:28:20 UTC
[jira] [Comment Edited] (HBASE-14450) HBase Backup/Restore Phase 3:
Multiwal support
[ https://issues.apache.org/jira/browse/HBASE-14450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15416189#comment-15416189 ]
Ted Yu edited comment on HBASE-14450 at 8/10/16 11:27 PM:
----------------------------------------------------------
Added more debug logging.
{code}
2016-08-10 15:46:16,306 DEBUG [sync.3] wal.FSHLog$SyncRunner(1275): syncing writer hdfs://localhost:56218/user/tyu/test-data/f650797e-abdc-4669-aac9-39b68914fcf9/WALs/10.22.16.34,56228,1470869104167/10.22.16.34%2C56228%2C1470869104167.regiongroup-2.1470869132540
...
2016-08-10 15:46:16,629 DEBUG [main] backup.TestIncrementalBackup(75): written 199 rows to ns1:test-1470869129051
2016-08-10 15:46:16,633 DEBUG [sync.3] wal.FSHLog$SyncRunner(1275): syncing writer hdfs://localhost:56218/user/tyu/test-data/f650797e-abdc-4669-aac9-39b68914fcf9/WALs/10.22.16.34,56228,1470869104167/10.22.16.34%2C56228%2C1470869104167.regiongroup-3.1470869134197
...
2016-08-10 15:46:16,797 DEBUG [sync.2] wal.FSHLog$SyncRunner(1275): syncing writer hdfs://localhost:56218/user/tyu/test-data/f650797e-abdc-4669-aac9-39b68914fcf9/WALs/10.22.16.34,56228,1470869104167/10.22.16.34%2C56228%2C1470869104167.regiongroup-1.1470869110496
...
2016-08-10 15:46:16,824 DEBUG [rs(10.22.16.34,56228,1470869104167)-backup-pool30-thread-1] regionserver.LogRollBackupSubprocedure$RSRollLogTask(72): ++ DRPC started: 10.22.16.34,56228,1470869104167
2016-08-10 15:46:16,824 DEBUG [member: '10.22.16.34,56228,1470869104167' subprocedure-pool2-thread-1] regionserver.LogRollBackupSubprocedurePool(84): Waiting for backup procedure to finish.
2016-08-10 15:46:16,824 INFO [rs(10.22.16.34,56228,1470869104167)-backup-pool30-thread-1] regionserver.LogRollBackupSubprocedure$RSRollLogTask(77): Trying to roll log in backup subprocedure, current log number: 1470869138221
2016-08-10 15:46:16,824 DEBUG [main-EventThread] procedure.ZKProcedureUtil(263): |----rolllog
2016-08-10 15:46:16,825 DEBUG [main-EventThread] procedure.ZKProcedureUtil(263): |-------10.22.16.34,56228,1470869104167
2016-08-10 15:46:16,826 DEBUG [main-EventThread] procedure.ZKProcedureUtil(263): |-------10.22.16.34,56226,1470869103454
2016-08-10 15:46:16,826 DEBUG [main-EventThread] procedure.ZKProcedureUtil(263): |-abort
2016-08-10 15:46:16,826 DEBUG [main-EventThread] procedure.ZKProcedureUtil(263): |-reached
2016-08-10 15:46:16,827 DEBUG [rs(10.22.16.34,56226,1470869103454)-backup-pool29-thread-1] wal.FSHLog(665): syncing writer hdfs://localhost:56218/user/tyu/test-data/f650797e-abdc-4669-aac9-39b68914fcf9/WALs/10.22.16.34,56226,1470869103454/10.22.16.34%2C56226%2C1470869103454.regiongroup-0.1470869176824
2016-08-10 15:46:16,827 DEBUG [main-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(238): Ignoring created notification for node:/1/rolllog-proc/reached/rolllog
2016-08-10 15:46:16,829 DEBUG [rs(10.22.16.34,56228,1470869104167)-backup-pool30-thread-1] wal.FSHLog(665): syncing writer hdfs://localhost:56218/user/tyu/test-data/f650797e-abdc-4669-aac9-39b68914fcf9/WALs/10.22.16.34,56228,1470869104167/10.22.16.34%2C56228%2C1470869104167.regiongroup-0.1470869176825
2016-08-10 15:46:16,833 DEBUG [sync.2] wal.FSHLog$SyncRunner(1275): syncing writer hdfs://localhost:56218/user/tyu/test-data/f650797e-abdc-4669-aac9-39b68914fcf9/WALs/10.22.16.34,56226,1470869103454/10.22.16.34%2C56226%2C1470869103454.regiongroup-0.1470869138221
2016-08-10 15:46:16,833 DEBUG [sync.3] wal.FSHLog$SyncRunner(1275): syncing writer hdfs://localhost:56218/user/tyu/test-data/f650797e-abdc-4669-aac9-39b68914fcf9/WALs/10.22.16.34,56228,1470869104167/10.22.16.34%2C56228%2C1470869104167.regiongroup-0.1470869138221
2016-08-10 15:46:17,249 DEBUG [sync.3] wal.FSHLog$SyncRunner(1275): syncing writer hdfs://localhost:56218/user/tyu/test-data/f650797e-abdc-4669-aac9-39b68914fcf9/WALs/10.22.16.34,56228,1470869104167/10.22.16.34%2C56228%2C1470869104167.regiongroup-1.1470869110496
2016-08-10 15:46:17,250 DEBUG [member: '10.22.16.34,56228,1470869104167' subprocedure-pool2-thread-1] procedure.Subprocedure(188): Subprocedure 'rolllog' locally completed
2016-08-10 15:46:17,250 DEBUG [member: '10.22.16.34,56228,1470869104167' subprocedure-pool2-thread-1] procedure.ZKProcedureMemberRpcs(269): Marking procedure 'rolllog' completed for member '10.22.16. 34,56228,1470869104167' in zk
2016-08-10 15:46:17,250 DEBUG [rs(10.22.16.34,56226,1470869103454)-backup-pool29-thread-1] impl.BackupSystemTable(254): write region server last roll log result to hbase:backup
2016-08-10 15:46:17,398 DEBUG [ProcedureExecutor-5] backup.BackupInfo(313): setting incr backup file list
2016-08-10 15:46:17,398 DEBUG [ProcedureExecutor-5] backup.BackupInfo(315): hdfs://localhost:56218/user/tyu/test-data/f650797e-abdc-4669-aac9-39b68914fcf9/WALs/10.22.16.34,56226,1470869103454/10.22.16. 34%2C56226%2C1470869103454.regiongroup-1.1470869108161
2016-08-10 15:46:17,398 DEBUG [ProcedureExecutor-5] backup.BackupInfo(315): hdfs://localhost:56218/user/tyu/test-data/f650797e-abdc-4669-aac9-39b68914fcf9/WALs/10.22.16.34,56228,1470869104167/10.22.16. 34%2C56228%2C1470869104167.regiongroup-1.1470869110496
2016-08-10 15:46:17,398 DEBUG [ProcedureExecutor-5] backup.BackupInfo(315): hdfs://localhost:56218/user/tyu/test-data/f650797e-abdc-4669-aac9-39b68914fcf9/WALs/10.22.16.34,56228,1470869104167/10.22.16. 34%2C56228%2C1470869104167.regiongroup-2.1470869132540
2016-08-10 15:46:17,398 DEBUG [ProcedureExecutor-5] backup.BackupInfo(315): hdfs://localhost:56218/user/tyu/test-data/f650797e-abdc-4669-aac9-39b68914fcf9/WALs/10.22.16.34,56228,1470869104167/10.22.16. 34%2C56228%2C1470869104167.regiongroup-3.1470869134197
2016-08-10 15:46:17,398 DEBUG [ProcedureExecutor-5] backup.BackupInfo(315): hdfs://localhost:56218/user/tyu/test-data/f650797e-abdc-4669-aac9-39b68914fcf9/oldWALs/10.22.16.34%2C56226%2C1470869103454. regiongroup-0.1470869138221
2016-08-10 15:46:17,398 DEBUG [ProcedureExecutor-5] backup.BackupInfo(315): hdfs://localhost:56218/user/tyu/test-data/f650797e-abdc-4669-aac9-39b68914fcf9/oldWALs/10.22.16.34%2C56228%2C1470869104167. regiongroup-0.1470869138221
{code}
Tip of the snippet shows the WAL files written after full backup was taken.
was (Author: yuzhihong@gmail.com):
Added more debug logging.
{code}
2016-08-10 15:46:16,306 DEBUG [sync.3] wal.FSHLog$SyncRunner(1275): syncing writer hdfs://localhost:56218/user/tyu/test-data/f650797e-abdc-4669-aac9-39b68914fcf9/WALs/10.22.16.34,56228,1470869104167/10.22.16.34%2C56228%2C1470869104167.regiongroup-2.1470869132540
2016-08-10 15:46:16,629 DEBUG [main] backup.TestIncrementalBackup(75): written 199 rows to ns1:test-1470869129051
2016-08-10 15:46:16,633 DEBUG [sync.3] wal.FSHLog$SyncRunner(1275): syncing writer hdfs://localhost:56218/user/tyu/test-data/f650797e-abdc-4669-aac9-39b68914fcf9/WALs/10.22.16.34,56228,1470869104167/10.22.16.34%2C56228%2C1470869104167.regiongroup-3.1470869134197
2016-08-10 15:46:16,797 DEBUG [sync.2] wal.FSHLog$SyncRunner(1275): syncing writer hdfs://localhost:56218/user/tyu/test-data/f650797e-abdc-4669-aac9-39b68914fcf9/WALs/10.22.16.34,56228,1470869104167/10.22.16.34%2C56228%2C1470869104167.regiongroup-1.1470869110496
2016-08-10 15:46:16,824 DEBUG [rs(10.22.16.34,56228,1470869104167)-backup-pool30-thread-1] regionserver.LogRollBackupSubprocedure$RSRollLogTask(72): ++ DRPC started: 10.22.16.34,56228,1470869104167
2016-08-10 15:46:16,824 DEBUG [member: '10.22.16.34,56228,1470869104167' subprocedure-pool2-thread-1] regionserver.LogRollBackupSubprocedurePool(84): Waiting for backup procedure to finish.
2016-08-10 15:46:16,824 INFO [rs(10.22.16.34,56228,1470869104167)-backup-pool30-thread-1] regionserver.LogRollBackupSubprocedure$RSRollLogTask(77): Trying to roll log in backup subprocedure, current log number: 1470869138221
2016-08-10 15:46:16,824 DEBUG [main-EventThread] procedure.ZKProcedureUtil(263): |----rolllog
2016-08-10 15:46:16,825 DEBUG [main-EventThread] procedure.ZKProcedureUtil(263): |-------10.22.16.34,56228,1470869104167
2016-08-10 15:46:16,826 DEBUG [main-EventThread] procedure.ZKProcedureUtil(263): |-------10.22.16.34,56226,1470869103454
2016-08-10 15:46:16,826 DEBUG [main-EventThread] procedure.ZKProcedureUtil(263): |-abort
2016-08-10 15:46:16,826 DEBUG [main-EventThread] procedure.ZKProcedureUtil(263): |-reached
2016-08-10 15:46:16,827 DEBUG [rs(10.22.16.34,56226,1470869103454)-backup-pool29-thread-1] wal.FSHLog(665): syncing writer hdfs://localhost:56218/user/tyu/test-data/f650797e-abdc-4669-aac9-39b68914fcf9/WALs/10.22.16.34,56226,1470869103454/10.22.16.34%2C56226%2C1470869103454.regiongroup-0.1470869176824
2016-08-10 15:46:16,827 DEBUG [main-EventThread] procedure.ZKProcedureCoordinatorRpcs$1(238): Ignoring created notification for node:/1/rolllog-proc/reached/rolllog
2016-08-10 15:46:16,829 DEBUG [rs(10.22.16.34,56228,1470869104167)-backup-pool30-thread-1] wal.FSHLog(665): syncing writer hdfs://localhost:56218/user/tyu/test-data/f650797e-abdc-4669-aac9-39b68914fcf9/WALs/10.22.16.34,56228,1470869104167/10.22.16.34%2C56228%2C1470869104167.regiongroup-0.1470869176825
2016-08-10 15:46:16,833 DEBUG [sync.2] wal.FSHLog$SyncRunner(1275): syncing writer hdfs://localhost:56218/user/tyu/test-data/f650797e-abdc-4669-aac9-39b68914fcf9/WALs/10.22.16.34,56226,1470869103454/10.22.16.34%2C56226%2C1470869103454.regiongroup-0.1470869138221
2016-08-10 15:46:16,833 DEBUG [sync.3] wal.FSHLog$SyncRunner(1275): syncing writer hdfs://localhost:56218/user/tyu/test-data/f650797e-abdc-4669-aac9-39b68914fcf9/WALs/10.22.16.34,56228,1470869104167/10.22.16.34%2C56228%2C1470869104167.regiongroup-0.1470869138221
2016-08-10 15:46:17,249 DEBUG [sync.3] wal.FSHLog$SyncRunner(1275): syncing writer hdfs://localhost:56218/user/tyu/test-data/f650797e-abdc-4669-aac9-39b68914fcf9/WALs/10.22.16.34,56228,1470869104167/10.22.16.34%2C56228%2C1470869104167.regiongroup-1.1470869110496
2016-08-10 15:46:17,250 DEBUG [member: '10.22.16.34,56228,1470869104167' subprocedure-pool2-thread-1] procedure.Subprocedure(188): Subprocedure 'rolllog' locally completed
2016-08-10 15:46:17,250 DEBUG [member: '10.22.16.34,56228,1470869104167' subprocedure-pool2-thread-1] procedure.ZKProcedureMemberRpcs(269): Marking procedure 'rolllog' completed for member '10.22.16. 34,56228,1470869104167' in zk
2016-08-10 15:46:17,250 DEBUG [rs(10.22.16.34,56226,1470869103454)-backup-pool29-thread-1] impl.BackupSystemTable(254): write region server last roll log result to hbase:backup
2016-08-10 15:46:17,398 DEBUG [ProcedureExecutor-5] backup.BackupInfo(313): setting incr backup file list
2016-08-10 15:46:17,398 DEBUG [ProcedureExecutor-5] backup.BackupInfo(315): hdfs://localhost:56218/user/tyu/test-data/f650797e-abdc-4669-aac9-39b68914fcf9/WALs/10.22.16.34,56226,1470869103454/10.22.16. 34%2C56226%2C1470869103454.regiongroup-1.1470869108161
2016-08-10 15:46:17,398 DEBUG [ProcedureExecutor-5] backup.BackupInfo(315): hdfs://localhost:56218/user/tyu/test-data/f650797e-abdc-4669-aac9-39b68914fcf9/WALs/10.22.16.34,56228,1470869104167/10.22.16. 34%2C56228%2C1470869104167.regiongroup-1.1470869110496
2016-08-10 15:46:17,398 DEBUG [ProcedureExecutor-5] backup.BackupInfo(315): hdfs://localhost:56218/user/tyu/test-data/f650797e-abdc-4669-aac9-39b68914fcf9/WALs/10.22.16.34,56228,1470869104167/10.22.16. 34%2C56228%2C1470869104167.regiongroup-2.1470869132540
2016-08-10 15:46:17,398 DEBUG [ProcedureExecutor-5] backup.BackupInfo(315): hdfs://localhost:56218/user/tyu/test-data/f650797e-abdc-4669-aac9-39b68914fcf9/WALs/10.22.16.34,56228,1470869104167/10.22.16. 34%2C56228%2C1470869104167.regiongroup-3.1470869134197
2016-08-10 15:46:17,398 DEBUG [ProcedureExecutor-5] backup.BackupInfo(315): hdfs://localhost:56218/user/tyu/test-data/f650797e-abdc-4669-aac9-39b68914fcf9/oldWALs/10.22.16.34%2C56226%2C1470869103454. regiongroup-0.1470869138221
2016-08-10 15:46:17,398 DEBUG [ProcedureExecutor-5] backup.BackupInfo(315): hdfs://localhost:56218/user/tyu/test-data/f650797e-abdc-4669-aac9-39b68914fcf9/oldWALs/10.22.16.34%2C56228%2C1470869104167. regiongroup-0.1470869138221
{code}
Tip of the snippet shows the WAL files written after full backup was taken.
> HBase Backup/Restore Phase 3: Multiwal support
> ----------------------------------------------
>
> Key: HBASE-14450
> URL: https://issues.apache.org/jira/browse/HBASE-14450
> Project: HBase
> Issue Type: Task
> Affects Versions: 2.0.0
> Reporter: Vladimir Rodionov
> Assignee: Vladimir Rodionov
> Labels: backup
> Fix For: 2.0.0
>
>
> We need to support multiwal configurations.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)