You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Zheng Hu (JIRA)" <ji...@apache.org> on 2017/09/14 08:46:01 UTC
[jira] [Commented] (HBASE-18806) VerifyRep by snapshot need not to
restore snapshot for each mapper
[ https://issues.apache.org/jira/browse/HBASE-18806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16165950#comment-16165950 ]
Zheng Hu commented on HBASE-18806:
----------------------------------
Actually, we can restore the snapshot once, and later mappers need not to restore again, they can just read the restored snapshot.
> VerifyRep by snapshot need not to restore snapshot for each mapper
> ------------------------------------------------------------------
>
> Key: HBASE-18806
> URL: https://issues.apache.org/jira/browse/HBASE-18806
> Project: HBase
> Issue Type: Improvement
> Components: Replication
> Affects Versions: 2.0.0-alpha-2
> Reporter: Zheng Hu
> Assignee: Zheng Hu
>
> In following method stack, seems like each mapper task will restore the snapshot. If we verify replication by a snapshot which has many hfiles, then we will take long time to restore snapshot. In our cluster, we took ~30min for the snapshot restoring when verify a big table.
> {code}
> Verifier.map
> |--------> replicatedScanner = new TableSnapshotScanner(...)
> |--------> TableSnapshotScanner.init()
> |-----> RestoreSnapshotHelper.copySnapshotForScanner
> {code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)