You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@hbase.apache.org by "Harsh J (JIRA)" <ji...@apache.org> on 2014/04/05 04:40:15 UTC

[jira] [Created] (HBASE-10914) Improve the snapshot directory local copy during ExportSnapshot

Harsh J created HBASE-10914:
-------------------------------

             Summary: Improve the snapshot directory local copy during ExportSnapshot
                 Key: HBASE-10914
                 URL: https://issues.apache.org/jira/browse/HBASE-10914
             Project: HBase
          Issue Type: Bug
          Components: snapshots
    Affects Versions: 0.96.0
            Reporter: Harsh J
            Priority: Minor


For tables with a lot of regions, the ExportSnapshot appears to "hang" without progress cause it copies the .snapshot directory (which has tiny, reference/reference-like files I assume) and does not report its state. Would be good if it dumped its state for like say, every 50 files it copies.

This operation is also sequential, so takes a lot of time, and can be improved to do 5-10 threads at a time in parallel perhaps, since the actual writes are tiny (i.e. data transfer is no concern) and its mostly just NN interaction that's needed here.



--
This message was sent by Atlassian JIRA
(v6.2#6252)