You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Zheng Hu (JIRA)" <ji...@apache.org> on 2017/09/13 11:31:00 UTC

[jira] [Updated] (HBASE-18806) VerifyRep by snapshot need not to restore snapshot for each mapper

     [ https://issues.apache.org/jira/browse/HBASE-18806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Zheng Hu updated HBASE-18806:
-----------------------------
    Issue Type: Improvement  (was: Bug)

> VerifyRep by snapshot need not to restore snapshot for each mapper
> ------------------------------------------------------------------
>
>                 Key: HBASE-18806
>                 URL: https://issues.apache.org/jira/browse/HBASE-18806
>             Project: HBase
>          Issue Type: Improvement
>          Components: Replication
>    Affects Versions: 2.0.0-alpha-2
>            Reporter: Zheng Hu
>            Assignee: Zheng Hu
>
> In following method stack,  seems like each mapper task will restore the snapshot.   If we verify replication  by a snapshot which has many hfiles,  then we will take long time to restore snapshot.   In our  cluster,   we took ~30min for the snapshot restoring when verify a big table.
> {code}
> Verifier.map
>     |-------->  replicatedScanner = new TableSnapshotScanner(...)
>                                                                 |-------->  TableSnapshotScanner.init()
>                                                                                           |-----> RestoreSnapshotHelper.copySnapshotForScanner
> {code} 



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)